R on the server - Revision history

Areinhar at 14:49, 29 June 2026

2026-06-29T14:49:44Z

@@ Line 1: / Line 1: @@
 The department's Leviathan cluster has R installed on each machine. It also has RStudio Server running on each machine, so there are two ways to run R code.
@@ Line 112: / Line 108: @@
 It is possible to also check your amount of RAM usage with OS-centric tools (e.g. Mac's: [https://support.apple.com/guide/activity-monitor/view-memory-usage-actmntr1004/mac Activity Monitor] or Window's: [https://www.crucial.com/articles/about-memory/how-to-check-ram-windows-10 Dask Management]).
 </li></ol>

Areinhar: hydra -> leviathans

2026-06-29T14:49:23Z

hydra -> leviathans

← Older revision		Revision as of 14:49, 29 June 2026
Line 3:		Line 3:
	[[Category:Department Servers]]		[[Category:Department Servers]]

	The department's ~~Hydra~~ cluster has R installed on each machine. It also has RStudio Server running on each machine, so there are two ways to run R code.		The department's Leviathan cluster has R installed on each machine. It also has RStudio Server running on each machine, so there are two ways to run R code.

	== Running R on the server ==		== Running R on the server ==

	=== Command line ===		=== Command line ===
	On the ~~Hydras~~, or on other servers that do not support RStudio, log into the server via SSH first. After getting onto the server (see [[Linux_and_department_servers\|Linux and the department server]]), you can start using <code>R</code> but opening an interactive session on the console with		On the Leviathans, or on other servers that do not support RStudio, log into the server via SSH first. After getting onto the server (see [[Linux_and_department_servers\|Linux and the department server]]), you can start using <code>R</code> but opening an interactive session on the console with

	<syntaxhighlight lang="bash">R</syntaxhighlight>		<syntaxhighlight lang="bash">R</syntaxhighlight>
Line 15:		Line 15:

	=== RStudio Server ===		=== RStudio Server ===
	RStudio Server is running on each ~~Hydra~~. Choose a ~~Hydra~~ with low usage. For example, suppose you choose <code>~~hydra3~~</code>. Then type the following URL into your web browser:		RStudio Server is running on each Leviathan. Choose a Leviathan with low usage. For example, suppose you choose <code>leviathan3</code>. Then type the following URL into your web browser:
	<nowiki>http://~~hydra3~~.stat.cmu.edu:8787/</nowiki>		<nowiki>http://leviathan3.stat.cmu.edu:8787/</nowiki>
	This will open RStudio Server. Use your statistics account (the same one you use to log in via SSH) to log in.		This will open RStudio Server. Use your statistics account (the same one you use to log in via SSH) to log in.

	You will be able to use the RStudio files pane to view all your files on the ~~hydras~~. It looks just like RStudio on your own computer. Files are shared across machines, but your RStudio session is specific to the ~~hydra~~ you started it on. Return to the same ~~hydra~~ to view your running code or output.		You will be able to use the RStudio files pane to view all your files on the Leviathans. It looks just like RStudio on your own computer. Files are shared across machines, but your RStudio session is specific to the Leviathan you started it on. Return to the same Leviathan to view your running code or output.

	== Library Management ==		== Library Management ==
Line 33:		Line 33:
	<li>The server’s version of <code>R</code> may different than you personal computer. It will also occasionally update. This will require you to re-install packages (see[[Renv\|<code>Renv</code>’s wiki (R package environments)]] for a way to make this less painful).</li>		<li>The server’s version of <code>R</code> may different than you personal computer. It will also occasionally update. This will require you to re-install packages (see[[Renv\|<code>Renv</code>’s wiki (R package environments)]] for a way to make this less painful).</li>
	<li>Compared to RStudio, you may need to debug package installation and dependence structure. Good luck!</li>		<li>Compared to RStudio, you may need to debug package installation and dependence structure. Good luck!</li>
			<li>Packages that use C, C++, or Fortran code will try to compile it from scratch, instead of downloading a pre-compiled version (like on Windows or macOS). This may require certain libraries to be installed on the servers; if package installation fails and tells you to use <code>apt</code> to install a library, you'll need to ask for help to install these, as you don't have the power to.
			</li>
	</ol>		</ol>

Line 57:		Line 59:
	==== Example uses of arguments ====		==== Example uses of arguments ====

	Examples of argument values abound in statistical analysis. If you're using [Slurm~~\|Slurm~~] you may use arguments to parallelize a task. These types of tasks could be running through complicated data observations, examining outcomes across a grid of hyperparameters, etc. It could also be useful to pass in the name of a file to process or folder to pull from.		Examples of argument values abound in statistical analysis. If you're using [[Slurm]] you may use arguments to parallelize a task. These types of tasks could be running through complicated data observations, examining outcomes across a grid of hyperparameters, etc. It could also be useful to pass in the name of a file to process or folder to pull from.

	=== <code>R CMD BATCH</code> ===		=== <code>R CMD BATCH</code> ===
Line 76:		Line 78:
	at the start and at the end		at the start and at the end
	<pre class="{r}">used_time <- Sys.time() - start		<pre class="{r}">used_time <- Sys.time() - start
	print(used_time)</pre>		print(used_time)</pre>If you're running a script, you can also use the <code>time</code> command, as in:<syntaxhighlight lang="shell">
	</li>		time Rscript some_script.R
			</syntaxhighlight></li>
	<li>'''Understanding memory usage:''' When you are running code in <code>R</code> or RStudio, you can get some understanding of how large an object is (and therefore get a lower bound on your potential RAM usage) using the package <code>pryr</code>. Calling <code>pryr::object_size(object_name)</code> will tell you what the approximate size of the object is. See [http://adv-r.had.co.nz/memory.html adv-r] on the package usage.		<li>'''Understanding memory usage:''' When you are running code in <code>R</code> or RStudio, you can get some understanding of how large an object is (and therefore get a lower bound on your potential RAM usage) using the package <code>pryr</code>. Calling <code>pryr::object_size(object_name)</code> will tell you what the approximate size of the object is. See [http://adv-r.had.co.nz/memory.html adv-r] on the package usage.

Ajshen at 03:28, 29 June 2026

2026-06-29T03:28:58Z

← Older revision		Revision as of 03:28, 29 June 2026
Line 1:		Line 1:

			[[Category:IDEs]]
			[[Category:Department Servers]]

	The department's Hydra cluster has R installed on each machine. It also has RStudio Server running on each machine, so there are two ways to run R code.		The department's Hydra cluster has R installed on each machine. It also has RStudio Server running on each machine, so there are two ways to run R code.

Areinhar: Mention RStudio Server option on hydras

2024-06-20T14:31:22Z

Mention RStudio Server option on hydras

← Older revision		Revision as of 14:31, 20 June 2024
Line 1:		Line 1:
			The department's Hydra cluster has R installed on each machine. It also has RStudio Server running on each machine, so there are two ways to run R code.

	== ~~General~~ ==		== Running R on the server ==

	~~Generally speaking (except suprisingly on~~ the ~~PSC)~~, ~~one can’t run <code>Rstudio</code> on a server. This means one needs to run <code>R</code> from the command line when you want to run jobs~~ on the server. ~~(It’s also more efficient when you’re looking to run lots of job.)~~		=== Command line ===
			On the Hydras, or on other servers that do not support RStudio, log into the server via SSH first. After getting onto the server (see [[Linux_and_department_servers\|Linux and the department server]]), you can start using <code>R</code> but opening an interactive session on the console with
	After getting onto the server (see [[Linux_and_department_servers\|Linux and the department server]]), you can start using <code>R</code> but opening an interactive session on the console with

	<syntaxhighlight lang="bash">R</syntaxhighlight>		<syntaxhighlight lang="bash">R</syntaxhighlight>

	You’ll be able to run code (except for visualization as the server can’t display graphics), from the console.		You’ll be able to run code (except for visualization as the server can’t display graphics), from the console.

			=== RStudio Server ===
			RStudio Server is running on each Hydra. Choose a Hydra with low usage. For example, suppose you choose <code>hydra3</code>. Then type the following URL into your web browser:
			<nowiki>http://hydra3.stat.cmu.edu:8787/</nowiki>
			This will open RStudio Server. Use your statistics account (the same one you use to log in via SSH) to log in.

			You will be able to use the RStudio files pane to view all your files on the hydras. It looks just like RStudio on your own computer. Files are shared across machines, but your RStudio session is specific to the hydra you started it on. Return to the same hydra to view your running code or output.

	== Library Management ==		== Library Management ==

	Compared to your personal computer (and your personal computer using ~~<code>Rstudio</code>~~), installing packages has a few nuances.		Compared to your personal computer (and your personal computer using RStudio), installing packages has a few nuances.

	<ol>		<ol>
Line 21:		Line 28:
	</li>		</li>
	<li>The server’s version of <code>R</code> may different than you personal computer. It will also occasionally update. This will require you to re-install packages (see[[Renv\|<code>Renv</code>’s wiki (R package environments)]] for a way to make this less painful).</li>		<li>The server’s version of <code>R</code> may different than you personal computer. It will also occasionally update. This will require you to re-install packages (see[[Renv\|<code>Renv</code>’s wiki (R package environments)]] for a way to make this less painful).</li>
	<li>Compared to ~~<code>Rstudio</code>~~, you may need to debug package installation and dependence structure. Good luck!</li>		<li>Compared to RStudio, you may need to debug package installation and dependence structure. Good luck!</li>
	</ol>		</ol>

Skipper: Created page with " == General == Generally speaking (except suprisingly on the PSC), one can’t run `Rstudio` on a server. This means one needs to run `R` from the comma..."

2024-03-29T23:59:54Z

Created page with " == General == Generally speaking (except suprisingly on the PSC), one can’t run <code>Rstudio</code> on a server. This means one needs to run <code>R</code> from the comma..."

New page

== General ==

Generally speaking (except suprisingly on the PSC), one can’t run <code>Rstudio</code> on a server. This means one needs to run <code>R</code> from the command line when you want to run jobs on the server. (It’s also more efficient when you’re looking to run lots of job.)

After getting onto the server (see [[Linux_and_department_servers|Linux and the department server]]), you can start using <code>R</code> but opening an interactive session on the console with

<syntaxhighlight lang="bash">R</syntaxhighlight>

You’ll be able to run code (except for visualization as the server can’t display graphics), from the console.

== Library Management ==

Compared to your personal computer (and your personal computer using <code>Rstudio</code>), installing packages has a few nuances.

<ol>
<li>The first time installing a package, e.g. <syntaxhighlight lang="bash">server$ R

R > install.packages("tidyverse")</syntaxhighlight>
you’ll be asked to set up a local folder to store your files.
</li>
<li>The server’s version of <code>R</code> may different than you personal computer. It will also occasionally update. This will require you to re-install packages (see[[Renv|<code>Renv</code>’s wiki (R package environments)]] for a way to make this less painful).</li>
<li>Compared to <code>Rstudio</code>, you may need to debug package installation and dependence structure. Good luck!</li>
</ol>

== Running Jobs ==

Beyond just opening up an interactive <code>R</code> session with <code lang="bash">R</code>, you can run files in 2 ways (as described below).

=== <code>Rscript</code> ===

<code>Rscript</code> is a more commonly used tool to run <code>.R</code> files, as it allows you to pass additional arguments to the file. For example:

<syntaxhighlight lang="bash">Rscript file.R arg1 arg2</syntaxhighlight>

In order to use <code>arg1</code> and <code>arg2</code> in your <code>R</code> code, you’ll access them (as strings) using <code>commandArgs()</code>, for example:
<pre class="{r}">args <- commandArgs(trailingOnly = TRUE)
if (length(args) > 0) {
first_parameter <- args[1]
second_parameter <- as.numeric(args[2])
...
}</pre>

<code>Rscript</code> also allows for standard output (printed to the terminal while running).

==== Example uses of arguments ====

Examples of argument values abound in statistical analysis. If you're using [Slurm|Slurm] you may use arguments to parallelize a task. These types of tasks could be running through complicated data observations, examining outcomes across a grid of hyperparameters, etc. It could also be useful to pass in the name of a file to process or folder to pull from.

=== <code>R CMD BATCH</code> ===

<code>R CMD BATCH</code> is an older approach (compared to <code>Rscript</code> you cannot pass in additional arguments nor see printouts to the standard output, but a <code>file_name.Rout</code> file will be generated with all print outs of the code.

<syntaxhighlight lang="bash">R CMD BATCH file.R</syntaxhighlight>

If you don't have any input arguments to access and want to save errors and messages that came from running your <code>.R</code> file, this might be a better approach.

== Additional useful tools ==

When approaching running code on different servers (and even on your own computer), it may be useful to understand the amount of time an analysis (or a part of an analysis) will run and how much memory it uses. This can help you decide what computing resources you need / what would make your analysis feasible. Knowing this information can also help you decide if you need to make your code more efficient (which can be done with the help of [http://adv-r.had.co.nz/Profiling.html profiles] and potentially C++ functions - link to come soon).

<ol>
<li>'''Estimating time usage''': To measure the amount of time code takes to run, one approach is to put <pre class="{r}">start <- Sys.time()</pre>

at the start and at the end
<pre class="{r}">used_time <- Sys.time() - start
print(used_time)</pre>
</li>
<li>'''Understanding memory usage:''' When you are running code in <code>R</code> or RStudio, you can get some understanding of how large an object is (and therefore get a lower bound on your potential RAM usage) using the package <code>pryr</code>. Calling <code>pryr::object_size(object_name)</code> will tell you what the approximate size of the object is. See [http://adv-r.had.co.nz/memory.html adv-r] on the package usage.

For example,

<syntaxhighlight lang="bash">
R> library(pryr)
R> dm_small <- as.matrix(dist(1:10))
R> object_size(dm_small)
2.1 kB
R> dm_medium <- as.matrix(dist(1:10-))
R> object_size(dm_medium)
87.7 kB
R> dm_large <- as.matrix(dist(1:1000))
R> object_size(dm_large)
8.07 MB
R> dm_large <- as.matrix(dist(1:10000))
R> object_size(dm_large)
801 MB
</syntaxhighlight>

If we did
<syntaxhighlight lang="bash">
R> dm_large <- as.matrix(dist(1:1000000))
</syntaxhighlight>
we'd expect <code>object_size(dm_large)</code> to be around 80 GB, which should crash your personal computer's <code>R</code>/Rstudio since you probably don't have that much RAM.

<br>

It is possible to also check your amount of RAM usage with OS-centric tools (e.g. Mac's: [https://support.apple.com/guide/activity-monitor/view-memory-usage-actmntr1004/mac Activity Monitor] or Window's: [https://www.crucial.com/articles/about-memory/how-to-check-ram-windows-10 Dask Management]).
</li></ol>

R on the server - Revision history

Areinhar at 14:49, 29 June 2026

Areinhar: hydra -> leviathans

Ajshen at 03:28, 29 June 2026

Areinhar: Mention RStudio Server option on hydras

Skipper: Created page with " == General == Generally speaking (except suprisingly on the PSC), one can’t run Rstudio on a server. This means one needs to run R from the comma..."

Skipper: Created page with " == General == Generally speaking (except suprisingly on the PSC), one can’t run `Rstudio` on a server. This means one needs to run `R` from the comma..."