HPC Job Scheduler
By default, when running anything on the CQ University HPC systems, unless you are preforming simple tasks or doing a "quick test", all programs must be executed on the "compute nodes.
The CQ University's HPC Facilities are "Large Shared" resources. Unlike personal computers, these system are used by multiple users at the same time. Given the usage of the HPC can vary at times, there is a need for a "HPC Scheduler" to me implemented. This scheduler will check if the requested resources are available. If they are available, they will execute the job on one of the available compute resources, if no resources are available, the request is "queued", until resources become available.
If users execute large jobs on any of the "Login" nodes, this will slow down usability and will impact other users performance.
The CQ University's HPC Facilities uses "PBS Pro" as the scheduler for resource management. Information on PBS commands can be found on the "PBS Commands" user guide.
In an effort to make using the scheduler easier, as number of PBS sample scripts have been created (See here for sample information). Additionally, some simple scripts have been created to highlight current HPC usage and to assist with deleting HPC jobs.
| Command | Usage | Example Output |
|---|---|---|
qusers | This will provide an overall summary of HPC usage | Thu Sep 12 12:32:30 EST 2013There are 3 users with jobs on: hawking Username #jobs #run #cpus #Memory #queued #other Real Name========================================================================= moserg 150 150 150 3000 gb 0 0 Gerhard Moser vanderj2 1 1 16 20 gb 0 0 Jeremy VanDerWal wuq1 1 1 1 1 gb 0 0 Qing Wu=========================================================================Totals 152 152 167 3021 gb 0 0========================================================================= |
myjobs | This command will provide information on your current HPC jobs, as well a providing a comparison of HPC Scheduler Requested Resources vs Actual Compute resources used for all (R)unning jobs. |
|
deletemyjobs | This command will delete all your submitted jobs (both "R"unning and "Q"ueued) |
