SLURM is similar in many ways to most other queue systems. You write a batch script then submit it to the queue manager. The queue manager then schedules your job to run on the queue (or partition in SLURM parlance) that you designate. Below we will provide an outline of how to submit jobs to SLURM, how SLURM decides when to schedule your job and how to monitor progress.

SLURM has a number of valuable features compared to other job management systems:

• Kill and Requeue SLURM’s ability to kill and requeue is superior to that of other systems. It waits for jobs to be cleared before scheduling the high priority job. It also does kill and requeue on memory rather than just on core count.
• Memory Memory requests are sacrosanct in SLURM. Thus the amount of memory you request at run time is guaranteed to be there. No one can infringe on that memory space and you cannot exceed the amount of memory that you request.
• Accounting Tools SLURM has a back end database which stores historical information about the cluster. This information can be queried by the users who are curious about how much resources they have used.

Summary of SLURM commands

The table below shows a summary of SLURM commands. These commands are described in more detail below along with links to the SLURM doc site.

Address of the bookmark: https://bioinfo.noble.org/GWASPRO/

https://software.broadinstitute.org/morpheus/

Address of the bookmark: https://software.broadinstitute.org/morpheus/

Address of the bookmark: http://frodock.chaconlab.org/

No previous programming knowledge is assumed. By following this tutorial you will learn the fundamental concepts of programming by using scripting languages: variables, types, arrays, cycles, conditional statements, functions, objects, regular expressions, files reading and manipulation et-cetera.

Address of the bookmark: http://www.cellbiol.com/bioinformatics_web_development/introduction/

Address of the bookmark: http://huanglab.phys.hust.edu.cn/hnadock/

The following table shows SLURM commands on the SOE cluster.

For more information, run man on the commands above. See some examples below.

1. Info about the partitions and nodes
List all the partitions available to you and the nodes therein:

sinfo

Nodes in state idle can accept new jobs.

Show a partition configuratuin, for example, SOE_main

scontrol show partition=SOE_main

Show current info about a specific node:

scontrol show node=<nodename>

You can also specify a group of nodes in the command above. For example, if your MPI job is running across soenode05,06,35,36, you can execute the command below to get the info on the nodes you are interested in:

scontrol show node=soenode[05-06,35-36]

An informative parameter in the output to look at would be CPULoad. It allows you to see how your application utilizes the CPUs on the running nodes.

2. Submit scripts
The header in a submit script specifies job name, partition (queue), time limit, memory allocation, number of nodes, number of cores, and files to collect standard output and error at run time, for example

#!/bin/bash

#SBATCH --job-name=OMP_run     # job name, "OMP_run"
#SBATCH --partition=SOE_main   # partition (queue)
#SBATCH -t 0-2:00              # time limit: (D-HH:MM) 
#SBATCH --mem=32000            # memory per node in MB 
#SBATCH --nodes=1              # number of nodes
#SBATCH --ntasks-per-node=16   # number of cores
#SBATCH --output=slurm.out     # file to collect standard output
#SBATCH --error=slurm.err      # file to collect standard errors

If the time limit is not specified in the submit script, SLURM will assign the default run time, 3 days. This means the job will be terminated by SLURM in 72 hrs. The maximum allowed run time is two weeks, 14-0:00.
If the memory limit is not requested, SLURM will assign the default 16 GB. The maximum allowed memory per node is 128 GB. To see how much RAM per node your job is using, you can run commands sacct or sstat to query MaxRSS for the job on the node - see examples below.
Depending on a type of application you need to run, the submit script may contain commands to create a temporary space on a computational node - see the discussion about using the file systems on the cluster.
Then it sets the environment specific to the application and starts the application on one or multiple nodes - see sbatch sample scripts in directory /usr/local/Samples on soemaster1.hpc.rutgers.edu.
You can submit your job to the cluster with sbatch command:

sbatch myscript.sh

3. Query job information
List all currently submitted jobs in running and pending states for a user:

squeue -u <username>

Command squeue can be run with format options to expose specific information, for example, when pending job #706 is scheduled to start running:

squeue -j 706 --format="%S"

START_TIME
2015-04-30T09:54:32

More info can be shown by placing additional format options, for example:

squeue -j 706 --format="%i %P %j %u %T %l %C %S"

JOBID PARTITION   NAME    USER STATE   TIMELIMIT  CPUS START_TIME
706   SOE_main  Par_job_3 mike PENDING 3-00:00:00 64   2015-04-30T09:54:32

To see when all the jobs, pending in the queue, are scheduled to start:

squeue --start 

List all running and completed jobs for a user

sqlog -u <username>

or

sqlog -j <JobID>

The following appreviations are used for the job states:

       CA   CANCELLED      Job was cancelled.

       CD   COMPLETED      Job completed normally.

       CG   COMPLETING     Job is in the process of completing.

       F    FAILED         Job termined abnormally.

       NF   NODE_FAIL      Job terminated due to node failure.

       PD   PENDING        Job is pending allocation.

       R    RUNNING        Job currently has an allocation.

       S    SUSPENDED      Job is suspended.

       TO   TIMEOUT        Job terminated upon reaching its time limit.

You can specify the fields you would like to see in the output of sqlog:

sqlog --format=list

The command below, for example, provides Job ID, user name, exit state, start date-time, and end date-time for job #2831:

sqlog -j 2831 --format=jid,user,state,start,end

List status info for a currently running job:

sstat -j <jobid>

A formatted output can be used to gain only a specific info, for example, the maximum resident RAM usage on a node:

sstat --format="JobID,MaxRSS" -j <jobid>

To get statistics on completed jobs by jobID:

sacct --format="JobID,JobName,MaxRSS,Elapsed" -j <jobid>

To view the same information for all jobs of a user:

sacct --format="JobID,JobName,MaxRSS,Elapsed" -u <username>

To print a list of fields that can be specified with the --format option:

sacct --helpformat

For example, to get Job ID, Job name, Exit state, start date-time, and end date-time for job #2831:

sacct -j 2831 --format="JobID,JobName,State,Start,End"

Another useful command to gain information about a running job is scontrol:

scontrol show job=<jobid>

4. Cancel a job
To cancel one job:

scancel <jobid>

To cancel one job and delete the TMP directory created by the submit script on a node:

sdel <jobid>

To cancel all the jobs for a user:

scancel -u <username>

To cancel one or more jobs by name:

scancel --name <myJobName>

.NET Bio

http://blogs.msdn.com/b/msr_er/archive/2011/10/18/microsoft-biology-foundation-evolves-into-new-toolkit-net-bio.aspx

A language-neutral bioinformatics toolkit built using the Microsoft 4.0 .NET Framework to help developers, researchers, and scientists.

AMPHORA ("AutoMated Phylogenomic infeRence Application")

http://wolbachia.biology.virginia.edu/WuLab/Software.html

Metagenomics analysis software

Anduril

http://www.anduril.org/anduril/site/

Component-based workflow framework for data analysis

Armadillo workflow platform

Tool for designing and executing phylogenetic workflows

AutoDock

http://autodock.scripps.edu/

suite of automated docking tools

Biochemical Algorithms Library (BALL)

http://www.ball-project.org/

C++ library and framework for molecular modeling and visualization designed for rapid prototyping

Bio4j

http://bio4j.com/

Bio4j is a bioinformatics platform and graph based database built around most data available in UniProt KB(Swiss-Prot + TrEMBL), Gene Ontology (GO), UniRef (50,90,100), RefSeq, NCBI taxonomy, and Expasy Enzyme DB

Bioclipse

www.bioclipse.net

Visual platform for chemo- and bioinformatics based on the Eclipse Rich Client Platform (RCP).

Bioconductor

http://www.bioconductor.org/

R (programming language) language toolkit

Bioinformatics Learning Tutorial (BLT)

http://sourceforge.net/projects/biotutorial/

Educational interactive tutorials and 3D animations for Replication, Transcription, and Translation

BioHaskell

http://biohaskell.org/

Haskell (programming language)

BioJava

http://biojava.org/wiki/Main_Page

Java (programming language)

BioMOBY

http://biomoby.org/

registry of web services

BioPerl

http://www.bioperl.org/wiki/Main_Page

Perl language toolkit

BioPHP

http://www.biophp.org/

PHP language toolkit

Biopython

http://biopython.org/wiki/Main_Page

Python language toolkit

BioRails

https://github.com/biorails

a data management system designed to support researchers in drug discovery

BioRuby

http://bioruby.org/

Ruby language toolkit

BioSmalltalk

https://code.google.com/p/biosmalltalk/

Smalltalk language toolkit

BioUno

http://www.biouno.org/

BioUno is a project that applies Continuous Integration tools and techniques in Bioinformatics. It uses Jenkins and its plug-in API to create biology workflows and manage computer clusters.

caCORE

ontologic representation environment

caArray

https://cabig-stage.nci.nih.gov/community/tools/caArray

ontologic representation environment

EMBOSS

http://emboss.sourceforge.net/

Suite of packages for sequencing, searching, etc.

Gaggle

https://www.gaggle.net/

A framework for interoperability between systems biology software

Galaxy

http://galaxyproject.org/

Scientific workflow and data integration system

GenePattern

http://www.broadinstitute.org/cancer/software/genepattern/

Scientific workflow system that provides access to more than 150 genomic analysis tools

GeWorkbench

http://wiki.c2b2.columbia.edu/workbench/index.php/Home

Genomic data integration platform

GMOD

http://www.gmod.org/wiki/Main_Page

Toolkit for addressing many common challenges at biological databases.

GeneProf

http://www.geneprof.org/GeneProf/

A web-based, bioinformatics software suite for the analysis of functional genomics experiments, e.g. RNA-seq or ChIP-seq.

GeneTalk

http://www.gene-talk.de/

Tool for filtering sequence variants in VCF files. Network for scientists and clinicians for expertise and knowledge exchange. Database of annotations aboute sequence variants with clinically relevant information.

GenGIS

http://kiwi.cs.dal.ca/GenGIS/Main_Page

Application that allows users to combine digital map data with information about biological sequences collected from the environment.

GenomeSpace

http://www.genomespace.org/

Centralized web application that provides data format transformations and facilitates connections with other bioinformatics tools

GENtle

http://directory.fsf.org/wiki/GENtle

An equivalent to the proprietary Vector NTI, a tool to analyze and edit DNA sequence files

Integrated Genome Browser

http://bioviz.org/igb/

Java-based desktop genome browser

Integrative Genomics Viewer (IGV)

http://www.broadinstitute.org/igv/

High-performance desktop tool for interactive visual exploration of diverse genomic data

IntAct

http://www.ebi.ac.uk/intact/

molecular interaction database

InterMine

http://intermine.github.io/intermine.org/

Extensive data warehouse system for the analysis and integration of biological datasets

Java Treeview

http://jtreeview.sourceforge.net/

microarray data viewer

LabKey Server

http://labkey.com/

platform for integrating, analyzing and sharing data

OpenClinica

https://www.openclinica.com/

software for capturing and managing data in clinical trials

PromKappa

http://xbioinformatics.wordpress.com/tag/promkappa/

PromKappa (Promoter analysis by Kappa) software program used for promoter pattern generation and promoter analysis.

MeV: Multi-Experiment Viewer

http://www.tm4.org/mev.html

a desktop application for the analysis, visualization and data-mining of large-scale genomic data

PathVisio

http://www.pathvisio.org/

a desktop software for drawing, analysis and visualization of biological pathways

REDCRAFT

software for determining tertiary protein structure given assigned Residual Dipolar Coupling data

SAM Tools

Data format (SAM) and accompanying tool suite, for storing large nucleotide sequence alignments

Staden Package

Sequence assembly, editing and analysis, primarily consisting of gap4, gap5 and spin.

STAMP

Software package for analyzing metagenomic profiles that promotes ‘best practices’ in choosing appropriate statistical techniques and reporting results.

supraHex

An open-source R/Bioconductor package for omics data analysis using a supra-hexagonal map

Taverna workbench

Tool for designing and executing workflows

TGAC Browser

Genome Browser, visualisation solutions for big data in the genomic era

T-REX WebServer

Bioinformatics and phylogenetics webserver (NJ, PhyML, RAxML, MAFFT, MUSCLE, Newick viewer, Horizontal gene transfer detection, Reticulograms, Substitution models)

UGENE

integrated bioinformatics tools

Visomics

bioinformatics tools for omics data

Genome Analysis Toolkit 1.0 (GATK 1.0)

a software package to analyse next-generation resequencing data