BOL: Related items

Linux Commands Cheat Sheet for Bioinformatics and Computational Biology Professionals

Rahul Nayak — Mon, 05 Feb 2018 18:50:41 -0600

The purpose of this cheat sheet is to introduce biologist and bioinformatician to the frequently used tools for NGS analysis as well as giving experience in writing one-liners.

File System
ls — list items in current directory
ls -l — list items in current directory and show in long format to see perimissions, size, and modification date
ls -a — list all items in current directory, including hidden files
ls -F — list all items in current directory and show directories with a slash and executables with a star
ls dir — list all items in directory dir
cd dir — change directory to dir
cd .. — go up one directory
cd / — go to the root directory
cd ~ — go to to your home directory
cd - — go to the last directory you were just in
pwd — show present working directory
mkdir dir — make directory dir
rm file — remove file
rm -r dir — remove directory dir recursively
cp file1 file2 — copy file1 to file2
cp -r dir1 dir2 — copy directory dir1 to dir2 recursively
mv file1 file2 — move (rename) file1 to file2
ln -s file link — create symbolic link to file
touch file — create or update file
cat file — output the contents of file
less file — view file with page navigation
head file — output the first 10 lines of file
tail file — output the last 10 lines of file
tail -f file — output the contents of file as it grows, starting with the last 10 lines
vim file — edit file
alias name 'command' — create an alias for a command
System
shutdown — shut down machine
reboot — restart machine
date — show the current date and time
whoami — who you are logged in as
finger user — display information about user
man command — show the manual for command
df — show disk usage
du — show directory space usage
free — show memory and swap usage
whereis app — show possible locations of app
which app — show which app will be run by default
Process Management
ps — display your currently active processes
top — display all running processes
kill pid — kill process id pid
kill -9 pid — force kill process id pid
Permissions
ls -l — list items in current directory and show permissions
chmod ugo file — change permissions of file to ugo - u is the user's permissions, g is the group's permissions, and o is everyone else's permissions. The values of u, g, and o can be any number between 0 and 7.
7 — full permissions
6 — read and write only
5 — read and execute only
4 — read only
3 — write and execute only
2 — write only
1 — execute only
0 — no permissions
chmod 600 file — you can read and write - good for files
chmod 700 file — you can read, write, and execute - good for scripts
chmod 644 file — you can read and write, and everyone else can only read - good for web pages
chmod 755 file — you can read, write, and execute, and everyone else can read and execute - good for programs that you want to share
Networking
wget file — download a file
curl file — download a file
scp user@host:file dir — secure copy a file from remote server to the dir directory on your machine
scp file user@host:dir — secure copy a file from your machine to the dir directory on a remote server
scp -r user@host:dir dir — secure copy the directory dir from remote server to the directory dir on your machine
ssh user@host — connect to host as user
ssh -p port user@host — connect to host on port as user
ssh-copy-id user@host — add your key to host for user to enable a keyed or passwordless login
ping host — ping host and output results
whois domain — get information for domain
dig domain — get DNS information for domain
dig -x host — reverse lookup host
lsof -i tcp:1337 — list all processes running on port 1337
Searching
grep pattern files — search for pattern in files
grep -r pattern dir — search recursively for pattern in dir
grep -rn pattern dir — search recursively for pattern in dir and show the line number found
grep -r pattern dir --include='*.ext — search recursively for pattern in dir and only search in files with .ext extension
command | grep pattern — search for pattern in the output of command
find file — find all instances of file in real system
locate file — find all instances of file using indexed database built from the updatedb command. Much faster than find
sed -i 's/day/night/g' file — find all occurrences of day in a file and replace them with night - s means substitude and g means global - sed also supports regular expressions
Compression
tar cf file.tar files — create a tar named file.tar containing files
tar xf file.tar — extract the files from file.tar
tar czf file.tar.gz files — create a tar with Gzip compression
tar xzf file.tar.gz — extract a tar using Gzip
gzip file — compresses file and renames it to file.gz
gzip -d file.gz — decompresses file.gz back to file
Shortcuts
ctrl+a — move cursor to beginning of line
ctrl+f — move cursor to end of line
alt+f — move cursor forward 1 word
alt+b — move cursor backward 1 word

Ph.D. Fellowship (Computational Biology/Bioinformatics) : Cork, Ireland : Cork, Ireland

Thu, 15 Aug 2013 14:09:00 -0500

Ph.D. Fellowship (18,000 euro/pa, plus tuition fees at the EU students rate) is available for four years to work on development of Bioinformatics resources for the analysis and visualization of ribosome profiling data. Ribosome profiling (ribo-seq) is a technology that allows mapping positions of the ribosomes on the whole transcriptome level with a nucleotide precision. The technology allows obtaining high resolution digital snapshots of gene expression in cells. The position is available starting on the 1st of October, 2013.

Candidate:
The candidate is expected to have B.S. or M.S. degree in the disciplines such as Computer Science, Statistics, Applied Mathematics, Physics or Electrical Engineering. The candidates with the backgrounds in Life Science disciplines such as Bioinformatics, Computational or Quantitative Biology will also be considered.

Location:
The position is available at LAPTI (http://lapti.ucc.ie) that is located in the Western Gate Building (http://www.stwarchitects.com/project-information.php?c=1&p=09993) at University College Cork. Western Gate Building Research Complex hosts several UCC departments and provides ideal environment for interdisciplinary research. Cork (sometimes referenced as “Venice of Ireland”) is the second most populous city in the Republic. It has friendly cosmopolitan atmosphere and vibrant culture. A number of American industrial giants such as Apple , EMC and Pfizer have chosen Cork as a home for their European headquarters.

Application process:
The details of the application process are given at http://lapti.ucc.ie/jobs.html. To ensure prompt processing of your application use the subject line: ‘Ph.D. computational’. All applications received prior to August the 1st are guaranteed equal consideration. However, applications at the later dates will also be considered until the position is filled.

Some useful Bioinformatics links

Jit — Fri, 16 Mar 2018 20:50:10 -0500

Reference-free prediction of rearrangement breakpoint reads | Bioinformatics | Oxford Academic

https://academic.oup.com/bioinformatics/article/30/18/2559/2475628
Reference-free SNP detection: dealing with the data deluge

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4083407/
GATB/DiscoSnp: DiscoSnp is designed for discovering all kinds of SNPs (not only isolated ones), as well as insertions and deletions, from raw set(s) of reads.

https://github.com/GATB/DiscoSnp
De novo assembly | Oxford Nanopore Technologies

https://nanoporetech.com/taxonomy/term/131
De novo long-read assembly of a complex animal genome | bioRxiv

https://www.biorxiv.org/content/early/2017/09/10/187054
Rapid de novo assembly of the European eel genome from nanopore sequencing reads | Scientific Reports

https://www.nature.com/articles/s41598-017-07650-6.epdf?author_access_token=dktG7e98wyRJnaEEMTcPqtRgN0jAjWel9jnR3ZoTv0P7E7t-wVGo30iojNO7dICajNY_7PE5xVPv6OoLe7hn9TeUjcZ5umREOzNoPMWkfYH58RS6uxm3vm4e4BG2AA_WKW84i6egKK271NwMq-NfzA%3D%3D
nanoporetech/ont-assembly-polish: ONT assembly and Illumina polishing pipeline

https://github.com/nanoporetech/ont-assembly-polish
Generade-nl/TULIP: TULIP - The Uncorrected Long read Itegration Pipeline

https://github.com/Generade-nl/TULIP
www.nature.com

https://www.nature.com/articles/s41598-017-03996-z
Example gallery of NanoPlot – Gigabase or gigabyte

https://gigabaseorgigabyte.wordpress.com/2017/06/01/example-gallery-of-nanoplot/
Tool documentation

https://broadinstitute.github.io/picard/command-line-overview.html
Chromosome-scale scaffolding of de novo genome assemblies based on chromatin interactions. - PubMed - NCBI

https://www.ncbi.nlm.nih.gov/pubmed/24185095
MAFFT ver.7 - a multiple sequence alignment program

https://mafft.cbrc.jp/alignment/software/algorithms/algorithms.html
Measuring the distance between multiple sequence alignments | Bioinformatics | Oxford Academic

https://academic.oup.com/bioinformatics/article/28/4/495/212883
The MUMmer 3 examples

http://mummer.sourceforge.net/examples/
MAFFT ver.7 - a multiple sequence alignment program

https://mafft.cbrc.jp/alignment/software/tips.html
Omega | Overlap-graph de novo Assembler for Metagenomics

https://omega.omicsbio.org/
abiswas-odu/Disco: Multi-threaded Distributed Memory Overlap-Layout-Consensus (OLC) Metagenome Assembler

https://github.com/abiswas-odu/Disco
SAGE: String-overlap Assembly of GEnomes | BMC Bioinformatics | Full Text

https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-15-302

Fast and sensitive mapping of nanopore sequencing reads with GraphMap | Nature Communications

https://www.nature.com/articles/ncomms11307
lumpy-sv/extractSplitReads_BwaMem at master · arq5x/lumpy-sv

https://github.com/arq5x/lumpy-sv/blob/master/scripts/extractSplitReads_BwaMem
jts/nanocorrect: Experimental pipeline for correcting nanopore reads

https://github.com/jts/nanocorrect

video - how to install flash plugin on ubuntu 14.04 LTS 64-bit version - Ask Ubuntu

https://askubuntu.com/questions/469553/how-to-install-flash-plugin-on-ubuntu-14-04-lts-64-bit-version
lh3/fermi: A WGS de novo assembler based on the FMD-index for large genomes

https://github.com/lh3/fermi
Multi-metagenome

http://madsalbertsen.github.io/multi-metagenome/docs/step9.html
Bandage by rrwick

https://rrwick.github.io/Bandage/
Codon Optimization OnLine (COOL): a web-based multi-objective optimization platform for synthetic gene design | Bioinformatics | Oxford Academic

https://academic.oup.com/bioinformatics/article/30/15/2210/2391162
Genome Architecture and Evolution of a Unichromosomal Asexual Nematode - ScienceDirect

https://www.sciencedirect.com/science/article/pii/S096098221731076X?via%3Dihub#fig4
How to determine chimeras in my de novo assembly? - SEQanswers

http://seqanswers.com/forums/showthread.php?t=26721
samtools(1) manual page

http://www.htslib.org/doc/samtools.html
How To Filter Mapped Reads With Samtools

https://www.biostars.org/p/56246/
The MUMmer 3 manual

http://mummer.sourceforge.net/manual/#nucmer
assembly_olc.pdf

http://www.cs.jhu.edu/~langmea/resources/lecture_notes/assembly_olc.pdf
SAM and BAM filtering oneliners

https://gist.github.com/davfre/8596159
Inroduction to dot-plots

http://www.code10.info/index.php%3Foption%3Dcom_content%26view%3Darticle%26id%3D64:inroduction-to-dot-plots%26catid%3D52:cat_coding_algorithms_dot-plots%26Itemid%3D76
RepeatFinder Home Page

http://www.cbcb.umd.edu/software/RepeatFinder/
RepeatFinderReprint.pdf

http://www.cbcb.umd.edu/software/RepeatFinder/RepeatFinderReprint.pdf
https://bernatgel.github.io/karyoploter_tutorial//Tutorial/CreateIdeogram/CreateIdeogram.html

https://bernatgel.github.io/karyoploter_tutorial//Tutorial/CreateIdeogram/CreateIdeogram.html
Circular Visualization in R

http://zuguang.de/circlize_book/book/introduction.html#a-qiuck-glance
Creating a coverage plot using BEDTools and R

https://davetang.org/muse/2015/08/05/creating-a-coverage-plot-using-bedtools-and-r/
Eval: A software package for analysis of genome annotations | BMC Bioinformatics | Full Text

https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-4-50
eval-documentation.pdf

http://mblab.wustl.edu/media/software/eval-documentation.pdf
OmicCircos: A Simple-to-Use R Package for the Circular Visualization of Multidimensional Omics Data

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3921174/
sequence - download.tardigrades.org > v1 > sequence

http://download.tardigrades.org/v1/sequence/
ksahlin/BESST: BESST - scaffolder for genomic assemblies

https://github.com/ksahlin/BESST
reubwn/scripts: Useful scripts for various things

https://github.com/reubwn/scripts
ICEberg

http://db-mml.sjtu.edu.cn/ICEberg/index.php
Satsuma - Evolution and Genomics

http://evomics.org/learning/genomics/satsuma/
A complete bacterial genome assembled de novo using only nanopore sequencing data | Nature Methods

https://www.nature.com/articles/nmeth.3444
vezzi/FRC_align: Computes FRC from SAM/BAM file and not from afg files

https://mail.google.com/mail/u/0/#inbox
Read GTF file into R - Dave Tang's blog

https://davetang.org/muse/2017/08/04/read-gtf-file-r/

https://bernatgel.github.io/karyoploter_tutorial//Tutorial/CustomGenomes/CustomGenomes.html

https://bernatgel.github.io/karyoploter_tutorial//Tutorial/CustomGenomes/CustomGenomes.html
Dot: Interactive dot plot for genome-genome alignments

https://dnanexus.github.io/dot/
Zoho Accounts

https://accounts.zoho.eu/signin?servicename=ZohoProjects&serviceurl=https%3A%2F%2Fprojects.zoho.eu%2Fportal%2Favaga2
lh3/minimap2: A versatile pairwise aligner for genomic and spliced nucleotide sequences

https://github.com/lh3/minimap2
SSPACE-LongRead: scaffolding bacterial draft genomes using long read sequence information | BMC Bioinformatics | Full Text

https://bmcbioinformatics.biomedcentral.com/articles/10.1186/1471-2105-15-211
Palindromic gene amplification — an evolutionarily conserved role for DNA inverted repeats in the genome | Nature Reviews Cancer

https://www.nature.com/articles/nrc2591
bioinformatics - BLAST DNA Sequences Reversed - Biology Stack Exchange

https://biology.stackexchange.com/questions/8160/blast-dna-sequences-reversed
LASTZ

http://www.bx.psu.edu/miller_lab/dist/README.lastz-1.02.00/README.lastz-1.02.00a.html
SOGo - (1652) Inbox

https://sogo.unamur.be/SOGo/so/jnarayan/Mail/view
Tetra-Nucleotide Analysis (TNA) | BIOiPLUG Help center

http://help.bioiplug.com/tetra-nucleotide-analysis-tna/

Clustering metagenomic contigs on tetranucleotide frequency — CGAT documentation

http://cgat.readthedocs.io/en/latest/recipes/metagenome_contigs_kmers.html

3rd Annual Next Generation Sequencing Asia Congress 2013 at Singapore, Singapore

Wed, 14 Aug 2013 09:55:04 -0500

The 3rd Annual Next Generation Sequencing Asia Congress is to be held on the 22nd and 23rd of October 2013 in Singapore. Over the 2 days, the conference will provide an overview of the current options of next-generation sequencing platforms, technologies, applications and the newest computational tools for the analysis of next-generation sequencing data and analytical genomics as well as overcoming data management problems. The event will attract over 200 senior-level decision makers working in areas such as next generation sequencing, analytical genomics, computational biology, oncology, RNA profiling, molecular genomics, biomarkers, bioinformatics & data management and clinical & diagnostics development.

Dated : 22 Nov 2013 -23 Nov 2013

http://www.ngsasia-congress.com/

BINC (Bioinformatics National Certification) Examination 2018

Jit — Mon, 23 Apr 2018 03:34:53 -0500

Bioinformatics National Certification (BINC) was instituted by Department of Biotechnology, Government of India in 2005 at Savitribai Phule Pune University, formerly University of Pune, Pune to certify bioinformatics professionals and recognizing candidate's theoretical and practical ability and fostering interdisciplinary research. Later on, it was transferred to Jawaharlal Nehru University, New Delhi and then to Pondicherry University, Puducherry. Pondicherry University conducted the BINC examination in 2015, 2016 and 2017.

Biotech Consortium India Limited (BCIL), New Delhi is conducting the BINC 2018 examination on behalf Department of Biotechnology, Government of India.

BINC is a certification programme for graduate and post-graduate students for recognizing their exceptional bioinformatics knowledge and skills and to improve their employment opportunities. There is a growing need for trained manpower in the area of Bioinformatics. Currently, various universities and institutions, both government and private, impart Bioinformatics education in India. The qualifying candidates will be awarded a lifetime certificate. This certification would facilitate industries and potential employers in recruitment of Bioinformatics professionals having exceptionally good bioinformatics skills.

The certification under Bioinformatics National Certification (BINC) scheme is given to the candidates after three tier selection process. The successful candidates are also eligible for availing Junior Research Fellowship (JRF) for pursuing Ph.D. in Bioinformatics at recognized Indian universities/institutes. The research fellowships of all BINC qualified Indian nationals are funded by DBT. BINC qualified candidates are called DBT certified Bioinformaticians while the individuals availing the fellowships are called as DBT-BINC Junior Research Fellows (DBT-BINC-JRF). Cash prize of 10,000/- each is awarded to the top 10 BINC qualifiers.

Eligibility

i) Bachelor's/Master's degree in Life Sciences, Physical Sciences, Chemical Sciences, Mathematical Sciences, Agriculture, Veterinary, Medicine, Pharmacy, Engineering and Technology.

ii) No formal training, diploma or certificate in bioinformatics is required.

iii) Candidates in final year of Bachelor's/ Master's degree are also eligible to apply.

Pattern of Examination

Syllabus

The syllabus consists of six sections - Bioinformatics, Biology, Physical Science, Chemical Science, Mathematics & Statistics, and Information Technology.

Note: Paper-III will be computer based practical and will include programming on Bioinformatics

Important Dates

Examination Centers

BINC Fellowship

Forms & Downloads

FAQs

Contact Us

Nisha Singh
Biotech Consortium India Limited
(CIN: U73100DL1990PLC041486)
5th Floor, Anuvrat Bhawan 210, Deen Dayal Upadhyaya Marg New Delhi - 110 002
Tel.: 011-2321 9064-67 Ext. 231, 236
Email - For general BINC queries:binc.dbt@biotech.co.in
Helpline for Application submission related queries:binchelpdesk@biotech.co.in
Website: www.bcil.nic.in/BINC.html

Golden Rules of Bioinformatics

Jitendra Narayan — Wed, 14 Aug 2013 21:11:33 -0500

All constant are variable.
Copy and paste is a genetic error.
First solve the problem, then write the code.
No matter what goes wrong, it will probably look right.
Any simple problem can be insoluble if enough metting are held to discuss it. :P
Stastics is a systematic method of comming to the wrong conclusion with confidence.
Bug is a undocumented feature in programming languages.
Good biological programmer goes on summer holiday with raincoat. [because see 1]
Thanks god Google know python is not a python and multiplication and division are the same thing.
Don' be clever, complex biology will trick you.

Interview Puzzles for Bioinformatician !

Rahul Nayak — Tue, 17 Jul 2018 05:26:18 -0500

These are some of the most famous Interview Puzzles being asked in top tech companies.

Here is a list of Top 25 puzzles which have been asked in top Tech Interview.

Specially for Microsoft Interview Puzzles, you may refer,
Top 15 Microsoft Interview Puzzles
Microsoft Interview Puzzles

Other MOST COMMON Interview Puzzles-
Top 25 Tech Interview Logical Puzzles

Each of the puzzles got repeated a number of times in interviews even for top tech companies

Taverna Workflow Management System

Madhvan Reddy — Thu, 15 Aug 2013 19:34:32 -0500

Taverna is an open source domain independent Workflow Management System – a suite of tools used to design and execute scientific workflows. Taverna has been created by the myGrid project and is funded through a range of organisations and projects.

The Taverna suite is written in Java and includes the Taverna Engine(used for enacting workflows) that powers both the Taverna Workbench(the desktop client application) and the Taverna Server (which allows remote execution of workflows). Taverna is also available as a Command Line Tool for a quick execution of workflows from a terminal.

Address of the bookmark: http://www.taverna.org.uk/

Bioinformatics Programme Officer @ International Centre for Genetic ICGEB Engineering and Biotechnology

Fri, 23 Nov 2018 03:50:16 -0600

The following vacancies are available in the DBT Apex Biotechnology Information project at ICGEB, New Delhi, India. These positions are available for a period of approx. two years, however, initial appointment offer will be for 6 months, which will be extended based on performance of work. Salaries will be offered as per DBT, educational qualification and experience. Depending on requirements, selected candidates may be required to work on location from the Department of Biotechnology, New Delhi. Shortlisted candidates will be invited for an interview at ICGEB. Only the selected candidates will be informed individually. No TA/DA or accommodation will be offered to the candidates attending the interview.

4 Programme Officer 1
5 Technical Research Assistant 1

Minimum Educational Qualification, desirable experience and expected duties:

4: The applicants should be Postgraduates with experience in Data collection and Statistics, especially in Biotechnology-related data.

Expected duties: Collection of Biotechnology related information from India, to facilitate the Apex BTIC experts committee review of programmes at centres and R&D programs funded by DBT.

5: The applicants should be Postgraduates in Science with experience in Bioinformatics-related projects.
Expected duties: The candidates will assist the senior staff of the centre in daily activities and help in the preparation of the Annual Training Calendar, seminar and training podcasts/videos, repository of training material and Apex BTIC Newsletter.

Interested candidates should submit their full, updated Curriculum Vitae with a detailed description of relevant experience, along with two references by December 14th, 2018, addressed to, The Chairperson, DBT- Apex BTIC, ICGEB, Aruna Asaf Ali Marg, New Delhi 110067, Email: abtic@icgeb.res.in, kindly write “Application for DBT Apex BTIC vacancy” in the subject of the email or envelope, if sending by post.

Advertisement: http://www.icgeb.org/tl_files/Vacancies/dbt-abtic-vac-annmntrevsk.pdf

Bioinformatics Infrastructure Facility (BIF), Gargi College, University of Delhi @ Traineeship

Mon, 19 Aug 2013 18:43:03 -0500

Gargi College was established in the year 1967 and is a leading South Campus college of the University of Delhi. It is a college for women and offers education in Arts and Humanities, Commerce, Science and Education.

Gargi believes in its mission statement that every student who passes through the portals of the college emerges as a wholly developed individual symbolizing the spirit of enterprise and inquiry that characterizes Gargi.

Bioinformatics Infrastructure Facility (BIF), Gargi College, University of Delhi invites candidates for filling up the following purely temporary positions sponsored by DBT, New Delhi.

1. Name of the post: Traineeship
Essential Qualification: Post Graduate degree in Bioinformatics or any other branch of Life Sciences preferably with dissertation in Bioinformatics.
Desirable Qualification: Prior knowledge of programming languages such as C, VB, SQL etc. and software/database development.

2. Name of the post: Research Associate
Essential Qualification: PhD in Bioinformatics/Biological Sciences/Computer Science or allied sciences with proven experience in bioinformatics.

3. Name of the post: Studentship
Essential Qualifications: Final year Post Graduate students pursuing a degree in Bioinformatics or any branch of Life Science with knowledge of bioinformatics.

How to apply:
Interested candidates are required to appear for the walk in interview on 29th Aug, 2013 at 10.00 AM in Principal’s Office, Gargi College, Sirifort Road, N. Delhi-110049, with their CVs, original documents and a set of Photostat copies of all original documents.

http://www.du.ac.in/fileadmin/DU/students/Pdf/du/advt/2013/16082013_Gargi_RAplus2_Advt.pdf