Directory of Computing Resources for Statistical Research: Difference between revisions
Created page with "* Leviathans * Ghidorahs * OpenOnDemand * Wright * PSC" |
No edit summary |
||
| Line 1: | Line 1: | ||
* | [[Category:Computing_Resources|01]] | ||
* Ghidorahs | |||
* | {{ComputingSidebar}} | ||
* Wright | |||
* PSC | '''Computing Resources''' are essential for modern statistical research and data science. The department, university, and national organizations provide several High-Performance Computing (HPC) clusters to scale up your workflows, run massive simulations, or train deep learning models. | ||
This page provides an overview of the computing clusters available to members of the department, detailing who manages them, hardware capabilities, and where to find setup instructions. | |||
<div style="background-color: #e2eef9; border-left: 5px solid #005A9C; padding: 15px; margin-bottom: 20px; margin-top: 15px;"> | |||
'''Tip: Choosing the Right Cluster'''<br> | |||
Start local before scaling up. Use the department-managed clusters for prototyping, data preparation, and medium-scale CPU jobs. For massive parallelism or extensive GPU needs that exceed department limits, you should apply for time on external clusters like PSC Bridges-2. | |||
</div> | |||
== Available Computing Clusters == | |||
{| class="wikitable" style="width: 100%; border-collapse: collapse; text-align: left; box-shadow: 0 2px 5px rgba(0,0,0,0.1);" | |||
|- style="background-color: #f8f9fa; border-bottom: 2px solid #dee2e6;" | |||
! style="padding: 12px; width: 20%;" | HPC Cluster Name | |||
! style="padding: 12px; width: 25%;" | Management | |||
! style="padding: 12px; width: 15%;" | Has GPUs? | |||
! style="padding: 12px; width: 40%;" | Setup & Documentation Articles | |||
|- style="border-bottom: 1px solid #dee2e6;" | |||
| style="padding: 12px; font-weight: bold;" | Leviathans | |||
| style="padding: 12px;" | Statistics Department | |||
| style="padding: 12px;" | No (CPU focused) | |||
| style="padding: 12px;" | | |||
* [[Logging into Hydras]] | |||
* [[Running Docker locally and on Hydras]] | |||
* [[Submitting Slurm Jobs on Hydras]] | |||
|- style="border-bottom: 1px solid #dee2e6;" | |||
| style="padding: 12px; font-weight: bold;" | Ghidorahs | |||
| style="padding: 12px;" | Statistics Department | |||
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (3 nodes) | |||
| style="padding: 12px;" | | |||
* [[Logging into Hydras]] | |||
* [[Running Docker locally and on Hydras]] | |||
* [[Submitting Slurm Jobs on Hydras]] | |||
|- style="border-bottom: 1px solid #dee2e6; background-color: #fdfdfd;" | |||
| style="padding: 12px; font-weight: bold;" | Wright Cluster | |||
| style="padding: 12px;" | Statistics Department | |||
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (24 nodes) | |||
| style="padding: 12px;" | | |||
* [[Wright GPU Cluster Policy]] | |||
* [[Requesting GPU Resources via Slurm]] | |||
* [[CUDA Environments and Virtual Envs]] | |||
|- style="border-bottom: 1px solid #dee2e6; background-color: #fdfdfd;" | |||
| style="padding: 12px; font-weight: bold;" | PSC Clusters | |||
| style="padding: 12px;" | External (Pittsburgh Supercomputing Center) | |||
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (Many nodes) | |||
| style="padding: 12px;" | | |||
* [[Applying for PSC Allocations]] | |||
* [[Using Modules on Bridges-2]] | |||
* [[Transferring Data to PSC with Globus]] | |||
|} | |||
<div style="background-color: #fff3cd; border-left: 5px solid #ffc107; padding: 15px; margin-top: 20px;"> | |||
'''Note on Accounts:''' Department-managed clusters usually require you to request access via the department IT staff or faculty sponsor. External resources like PSC require writing a brief research proposal and creating an ACCESS account. | |||
</div> | |||
Revision as of 21:04, 28 June 2026
Computing Resources are essential for modern statistical research and data science. The department, university, and national organizations provide several High-Performance Computing (HPC) clusters to scale up your workflows, run massive simulations, or train deep learning models.
This page provides an overview of the computing clusters available to members of the department, detailing who manages them, hardware capabilities, and where to find setup instructions.
Tip: Choosing the Right Cluster
Start local before scaling up. Use the department-managed clusters for prototyping, data preparation, and medium-scale CPU jobs. For massive parallelism or extensive GPU needs that exceed department limits, you should apply for time on external clusters like PSC Bridges-2.
Available Computing Clusters
| HPC Cluster Name | Management | Has GPUs? | Setup & Documentation Articles |
|---|---|---|---|
| Leviathans | Statistics Department | No (CPU focused) | |
| Ghidorahs | Statistics Department | Yes (3 nodes) | |
| Wright Cluster | Statistics Department | Yes (24 nodes) | |
| PSC Clusters | External (Pittsburgh Supercomputing Center) | Yes (Many nodes) |
Note on Accounts: Department-managed clusters usually require you to request access via the department IT staff or faculty sponsor. External resources like PSC require writing a brief research proposal and creating an ACCESS account.