SLURM Demo: Difference between revisions

From Stat DS Computing Wiki
Jacobg2 (talk | contribs)
Jacobg2 (talk | contribs)
Line 1: Line 1:
This page will walk you through submitting a job using SLURM. It will also cover basic Linux usage.
This page will walk you through submitting a job using SLURM. It will also cover basic Linux usage.


== Copy SLURM Demo Files ==
== 1 - Copy SLURM Demo Files ==


This section will cover copying example SLURM files to your own personal location.


Log in to the head node server using your StatDS computing account through your terminal. (If you forget your password, reset it here.) This cluster is used for demonstration purposes only. Actual compute jobs are not meant to be submitted to this cluster.<syntaxhighlight lang="bash">
1 - Log in to the head node server using your StatDS computing account through your terminal. (If you forget your password, reset it [https://util.stat.cmu.edu/passwordreset/ here].)  
 
* ''This cluster is used for demonstration purposes only. Actual compute jobs are not meant to be submitted to this cluster.''
<syntaxhighlight lang="bash">
ssh statdsuser@ood.stat.cmu.edu
ssh statdsuser@ood.stat.cmu.edu
</syntaxhighlight>Copy the SLURM Demo folder to your home directory. Do not run these files without moving them to your own working directory.<syntaxhighlight lang="bash">
</syntaxhighlight>2 - Copy the SLURM Demo folder to your home directory. Do not run these files without moving them to your own working directory.<syntaxhighlight lang="bash">
cp -r /share/slurmdemo ~/slurmdemo
cp -r /share/slurmdemo ~/slurmdemo
</syntaxhighlight>Navigate to your new SLURM Demo directory.<syntaxhighlight lang="bash">
</syntaxhighlight>3 - Navigate to your new SLURM Demo directory.<syntaxhighlight lang="bash">
cd ~/slurmdemo
cd ~/slurmdemo
</syntaxhighlight>View the contents of the SLURM Demo directory.<syntaxhighlight lang="bash">
</syntaxhighlight>4 - View the contents of the SLURM Demo directory.<syntaxhighlight lang="bash">
ls -l
ls -l
</syntaxhighlight>
</syntaxhighlight>


== Submit SLURM Job ==
== 2 - Submit SLURM Job ==
This section will cover submitting a job using SLURM.
 
Modify the “submit_bash.sh” script. Make sure that you are in the correct directory that has the SLURM files from the section above.
Modify the “submit_bash.sh” script. Make sure that you are in the correct directory that has the SLURM files from the section above.



Revision as of 14:35, 27 August 2025

This page will walk you through submitting a job using SLURM. It will also cover basic Linux usage.

1 - Copy SLURM Demo Files

This section will cover copying example SLURM files to your own personal location.

1 - Log in to the head node server using your StatDS computing account through your terminal. (If you forget your password, reset it here.)

  • This cluster is used for demonstration purposes only. Actual compute jobs are not meant to be submitted to this cluster.
ssh statdsuser@ood.stat.cmu.edu

2 - Copy the SLURM Demo folder to your home directory. Do not run these files without moving them to your own working directory.

cp -r /share/slurmdemo ~/slurmdemo

3 - Navigate to your new SLURM Demo directory.

cd ~/slurmdemo

4 - View the contents of the SLURM Demo directory.

ls -l

2 - Submit SLURM Job

This section will cover submitting a job using SLURM.

Modify the “submit_bash.sh” script. Make sure that you are in the correct directory that has the SLURM files from the section above.

You may use any text editor (vim, vi, nano, etc). In this example nano will be used.

nano submit_bash.sh

Change these three lines and make them more specific to you.

SBATCH --job-name=yourjobuniquename
This is the name of your job.

SBATCH --output=yourjoboutputfile_%j.out
This is the name of your job’s output file. Any intentional output generated from your job will be placed into this file. The “%j” will add the job’s unique JobID to the name.

SBATCH --error=yourjoberrorfile_%j.err
This is the name of your job’s error file. Any unintentional errors generated in the script will be placed into this file. The “%j” will add the job’s unique JobID to the name.

Run the submit script

sbatch submit_bash.sh

Once you submit your job, you can view the status of it by running the command below. This will show only your jobs

squeue -u $USER

To view every running job, run the command below.

squeue

Once your job has finished, view the output file once the script is finished (use your unique outfile name)

cat outputfile.out