Directory of Computing Resources for Statistical Research: Difference between revisions

From Stat DS Computing Wiki
Line 16: Line 16:
{| class="wikitable" style="width: 100%; border-collapse: collapse; text-align: left; box-shadow: 0 2px 5px rgba(0,0,0,0.1);"
{| class="wikitable" style="width: 100%; border-collapse: collapse; text-align: left; box-shadow: 0 2px 5px rgba(0,0,0,0.1);"
|- style="background-color: #f8f9fa; border-bottom: 2px solid #dee2e6;"
|- style="background-color: #f8f9fa; border-bottom: 2px solid #dee2e6;"
! style="padding: 12px; width: 20%;" | HPC Cluster Name
! style="padding: 12px; width: 10%;" | HPC Cluster Name
! style="padding: 12px; width: 25%;" | Management
! style="padding: 12px; width: 15%;" | Management
! style="padding: 12px; width: 15%;" | Has GPUs?
! style="padding: 12px; width: 10%;" | Has GPUs?
! style="padding: 12px; width: 40%;" | Setup & Documentation Articles
! style="padding: 12px; width: 10%;" | Sharing Policy
! style="padding: 12px; width: 20%;" | How to access
! style="padding: 12px; width: 35%;" | Setup & Documentation Articles
|- style="border-bottom: 1px solid #dee2e6;"
|- style="border-bottom: 1px solid #dee2e6;"
| style="padding: 12px; font-weight: bold;" | Leviathans
| style="padding: 12px; font-weight: bold;" | Leviathans
| style="padding: 12px;" | Statistics Department
| style="padding: 12px;" | Statistics Department
| style="padding: 12px;" | No (CPU focused)
| style="padding: 12px;" | No
| style="padding: 12px;" | FCFS
| style="padding: 12px;" | Anytime direct ssh to server, e.g. <code>ssh [userid]@leviathan1.stat.cmu.edu</code>
| style="padding: 12px;" |  
| style="padding: 12px;" |  
* [[Logging into Hydras]]
* [[Logging into Hydras]]
Line 32: Line 36:
| style="padding: 12px;" | Statistics Department
| style="padding: 12px;" | Statistics Department
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (3 nodes)
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (3 nodes)
| style="padding: 12px;" | FCFS
| style="padding: 12px;" | Anytime direct ssh to server, e.g. <code>ssh [userid]@ghidorah1.stat.cmu.edu</code>
| style="padding: 12px;" |  
| style="padding: 12px;" |  
* [[Logging into Hydras]]
* [[Logging into Hydras]]
Line 40: Line 46:
| style="padding: 12px;" | Collaboration between several CMU departments
| style="padding: 12px;" | Collaboration between several CMU departments
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (24 nodes)
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (24 nodes)
| style="padding: 12px;" | Slurm
| style="padding: 12px;" | Apply for access here
| style="padding: 12px;" |  
| style="padding: 12px;" |  
* [[Wright GPU Cluster Policy]]
* [[Wright GPU Cluster Policy]]
Line 48: Line 56:
| style="padding: 12px;" | External (Pittsburgh Supercomputing Center)
| style="padding: 12px;" | External (Pittsburgh Supercomputing Center)
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (Many nodes)
| style="padding: 12px; color: #28a745; font-weight: bold;" | Yes (Many nodes)
| style="padding: 12px;" | Slurm
| style="padding: 12px;" | Apply for access here
| style="padding: 12px;" |  
| style="padding: 12px;" |  
* [[Applying for PSC Allocations]]
* [[Applying for PSC Allocations]]

Revision as of 21:11, 28 June 2026


Template:ComputingSidebar

Computing Resources are essential for modern statistical research and data science. The department, university, and national organizations provide several High-Performance Computing (HPC) clusters to scale up your workflows, run massive simulations, or train deep learning models.

This page provides an overview of the computing clusters available to members of the department, detailing who manages them, hardware capabilities, and where to find setup instructions.

Tip: Choosing the Right Cluster
Start local before scaling up. Use the department-managed clusters for prototyping, data preparation, and medium-scale CPU jobs. For massive parallelism or extensive GPU needs that exceed department limits, you should apply for time on external clusters like PSC Bridges-2.

Available Computing Clusters

HPC Cluster Name Management Has GPUs? Sharing Policy How to access Setup & Documentation Articles
Leviathans Statistics Department No FCFS Anytime direct ssh to server, e.g. ssh [userid]@leviathan1.stat.cmu.edu
Ghidorahs Statistics Department Yes (3 nodes) FCFS Anytime direct ssh to server, e.g. ssh [userid]@ghidorah1.stat.cmu.edu
Wright Cluster Collaboration between several CMU departments Yes (24 nodes) Slurm Apply for access here
PSC Clusters External (Pittsburgh Supercomputing Center) Yes (Many nodes) Slurm Apply for access here

Note on Accounts: Department-managed clusters usually require you to request access via the department IT staff or faculty sponsor. External resources like PSC require writing a brief research proposal and creating an ACCESS account.