Child pages
  • Running jobs on the NYU HPC clusters
58 more child pages

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Section
Column
width20%

Include Page
Running jobs on the HPC clusters - Links
Running jobs on the HPC clusters - Links
 

Column
Excerpt

Working on the HPC clusters is not the same as working at a desktop workstation: in order to provide high performance computing to many users simultaneously, computational work must be packaged into a job - a script specifying what resources the job will need and the commands necessary to perform the work - and submitted to the system to be run without further input from the user. The system then schedules and runs the job on a dedicated portion of the cluster. ( Note that there is a way to work interactively within this model, for work which cannot be scripted, such as debugging.)

Job Scheduling

Excerpt Include
Running jobs - Scheduling
Running jobs - Scheduling
nopaneltrue
(more...)

Login and Compute Nodes

Excerpt Include
Running jobs - Nodes
Running jobs - Nodes
nopaneltrue
(more...)

Queues

Excerpt Include
Running jobs - Queues
Running jobs - Queues
nopaneltrue
(more...)

Writing a Job Script

Excerpt Include
Writing and submitting a job
Writing and submitting a job
nopaneltrue
(more...)

Submitting a Job

Excerpt Include
Running jobs - Submitting
Running jobs - Submitting
nopaneltrue
(more...)

Monitoring Jobs

Excerpt Include
Monitoring jobs with qstat
Monitoring jobs with qstat
nopaneltrue

Excerpt Include
Interpreting pbstop
Interpreting pbstop
nopaneltrue

(more...)

Canceling a Job

Excerpt Include
Running jobs - cancel a job
Running jobs - cancel a job
nopaneltrue