View AREs in the human transcriptome and study the comparative genomics of AREs in model organisms.

Find information about orthologous genes in prokaryotes.

Search for publicly available QTL data on livestocks and animal species.

Find information about bovine genomics data.

A multi-organism web-based resource system designed to easily retrieve, correlate and interpret data across species.

A database resource of developmentally associated conserved non-coding elements.

Delineate conserved non-coding blocks from upstream regions of putative orthologous gene pairs from man, mouse, rat, fugu, Mus musculus, Danio rerio, and zebrafish.

Find coexpressed gene lists and networks in human and mouse.

Construct phylogenetic tree of microorganisms based on oligopeptide content of their complete proteomes.

A novel database server that classifies GenBank's dbEST (database of expressed gene sequences) libraries and removes contaminants.

Find information about the ancestral relationship between genes.

Provides an overview of the genomic organization of microRNAs and extent of conservation during evolution in different metazoan species.

Conduct comparative biometric analysis of chromosomes of different organisms.

Search for Indices of gene and transcripts in human and mouse.

Search and compare 12 new and old Drosophila genomes.

Access to whole genome alignments of human, mouse, rat and fish sequences.

Find eukaryotic paralog/paralogon information.

Analyze the evolutionary process of overlapping genes when comparing different species.

The first publicly available system reported to handle inter-species gene mention normalization.

A web-based software/database system aimed at an improved and accelerated annotation of prokaryotic genomes.

Visualize gene indices of human, mouse, Arabidopsis, Zebrafish, Drosophila and Sheep.

Use comparative genomics approach to characterize gene models and identify putative cis-regulatory regions of RefSeq Gene Orthologs.

Find information about mutated mouse genes.

A data management and analysis system for metagenomes

Search for influenza sequence, vaccine, and drug resistance information.

LAMHDI, the initiative to Link Animal Models to Human DIsease, is designed to accelerate the research process by providing biomedical researchers with a simple, comprehensive Web-based resource to find the best animal models for their research.

The missing link between multi-species full genome comparisons and functional analysis.

Conduct comparative analysis of completely sequenced microbial genomes.

A biologist-centric software for evolutionary analysis of DNA and protein sequences.

Conduct single nucleotide polymorphisms diversity measurements among homologous sequences from the Mammalia class.

Find information about 1000s of microbial genomes.

A database dedicated to the study of genome conservation.

Explore orthologous relations across 352 complete genomes.

Browse complete genomes in several clades.

Find groups of orthologous genes.

A database of orthologous genomic markers for placental mammal phylogenetics.

Conduct genome wide functional and structural analysis.

Conduct genome-wide cis-regulatory module (CRM) predictions for both the human and the mouse genomes.

Compare phenotypes of a given gene or gene set in different model organisms.

Phylemon is a web server that integrates a selected suite of more than 20 different tools from the most popular stand-alone programs of phylogenetic and evolutionary analysis.

Use this database to see where in the evolution some phylogenetic lineages were started, and over which species they were contained.

Search for genomic information on nematode satellite species Pristionchus pacificus.

Find information about related protein sequences.

Database hosting genomics and post-genomics data from multiple protozoans.

A database of pseudogene families based on the protein families from the Pfam database.

Find genomic information about mammals.

Find information about predicted regulons in prokaryotic transcription regulation.

Perform systematic comparison of proteome data among species.

A comparative map viewer dedicated to the biology of the Solanaceae family.

Analyze data from functional analysis on fragmented microbial genetic material.

Visualize and explore comparative genomic hybridization data sets.

Search for genome-wide annotations of regulatory sites in yeast and prokaryotes genomes.

Compare and select individual biomarkers.

Search for information on adaptive evolution in gene families of higher plants and chordate.

Generate graphical maps of circular genomes that show sequence features, base composition plots, analysis results and sequence similarity plots.

Conduct a comprehensive analysis of genes and genomes.

An interactive online poster presentation on the Macaque genome, including high-quality images, video clips, and Web resources

Search for annotated genetic information of expressed sequence tags (ESTs) in different eukaryotic organisms.

Find mapping and expression information for a unigene cluster (ESTs and full-length mRNA sequences organized into clusters that each represent a unique known or putative gene)

A public online resource for identifying or designing 'universal' overgo-hybridization probes from conserved sequences that can be used to efficiently screen one or more genomic libraries from a designated group of species.

Comprehensive suite of programs and databases for comparative analysis of genomic sequences.

Find information about ictalurid catfish.

Discover orthologous groups of genes.

Find metabolic networks and phylogenomic information on a taxonomically diverse range of eukaryotes.

Conduct bacterial comparative genomics.

Install software

Copy and paste the following commands

sudo apt-get update && sudo apt-get -y install python ncbi-blast+

This updates the software list and installs the Python programming language and NCBI BLAST+.

Get Data

Grab some data to play with. Grab some cow and human RefSeq proteins:

wget ftp://ftp.ncbi.nih.gov/refseq/B_taurus/mRNA_Prot/cow.1.protein.faa.gz
wget ftp://ftp.ncbi.nih.gov/refseq/H_sapiens/mRNA_Prot/human.1.protein.faa.gz

This is only the first part of the human and cow protein files - there are 24 files total for human.

The database files are both gzipped, so lets unzip them

gunzip *gz
ls

Take a look at the head of each file:

head cow.1.protein.faa
head human.1.protein.faa

These are protein sequences in FASTA format. FASTA format is something many of you have probably seen in one form or another – it’s pretty ubiquitous. It’s just a text file, containing records; each record starts with a line beginning with a ‘>’, and then contains one or more lines of sequence text.

Note that the files are in fasta format, even though they end if ”.faa” instead of the usual ”.fasta”. This NCBI’s way of denoting that this is a fasta file with amino acids instead of nucleotides.

How many sequences are in each one?

grep -c '^>' cow.1.protein.faa
grep -c '^>' human.1.protein.faa

This grep command uses the c flag, which reports a count of lines with match to the pattern. In this case, the pattern is a regular expression, meaning match only lines that begin with a >.

This is a bit too big, lets take a smaller set for practice. Lets take the first two sequences of the cow proteins, which we can see are on the first 6 lines

head -6 cow.1.protein.faa > cow.small.faa

BLAST

Now we can blast these two cow sequences against the set of human sequences. First, we need to tell blast about our database. BLAST needs to do some pre-work on the database file prior to searching. This helps to make the software work a lot faster. Because you installed your own version of the sotware, you need to tell the shell where the software is located. Use the full path and the makeblastdb command:

makeblastdb -in human.1.protein.faa -dbtype prot
ls

Note that this makes a lot of extra files, with the same name as the database plus new extensions (.pin, .psq, etc). To make blast work, these files, called index files, must be in the same directory as the fasta file.

blastp [-h] [-help] [-import_search_strategy filename]
[-export_search_strategy filename] [-task task_name] [-db database_name]
[-dbsize num_letters] [-gilist filename] [-seqidlist filename]
[-negative_gilist filename] [-negative_seqidlist filename]
[-entrez_query entrez_query] [-db_soft_mask filtering_algorithm]
[-db_hard_mask filtering_algorithm] [-subject subject_input_file]
[-subject_loc range] [-query input_file] [-out output_file]
[-evalue evalue] [-word_size int_value] [-gapopen open_penalty]
[-gapextend extend_penalty] [-qcov_hsp_perc float_value]
[-max_hsps int_value] [-xdrop_ungap float_value] [-xdrop_gap float_value]
[-xdrop_gap_final float_value] [-searchsp int_value]
[-sum_stats bool_value] [-seg SEG_options] [-soft_masking soft_masking]
[-matrix matrix_name] [-threshold float_value] [-culling_limit int_value]
[-best_hit_overhang float_value] [-best_hit_score_edge float_value]
[-window_size int_value] [-lcase_masking] [-query_loc range]
[-parse_deflines] [-outfmt format] [-show_gis]
[-num_descriptions int_value] [-num_alignments int_value]
[-line_length line_length] [-html] [-max_target_seqs num_sequences]
[-num_threads int_value] [-ungapped] [-remote] [-comp_based_stats compo]
[-use_sw_tback] [-version]

Now we can run the blast job. We will use blastp, which is appropriate for protein to protein comparisons.

blastp -query cow.small.faa -db human.1.protein.faa

This gives us a lot of information on the terminal screen. But this is difficult to save and use later - Blast also gives the option of saving the text to a file.

    blastp -query cow.small.faa -db human.1.protein.faa -out cow_vs_human_blast_results.txt
ls

Take a look at the results using less. Note that there can be more than one match between the query and the same subject. These are referred to as high-scoring segment pairs (HSPs).

less cow_vs_human_blast_results.txt

So how do you know about all the options, such as the flag to create an output file? Lets also take a look at the help pages. Unfortunately there are no man pages (those are usually reserved for shell commands, but some software authors will provide them as well), but there is a text help output

blastp -help

To scroll through slowly

blastp -help | less

To quit the less screen, press the q key.

Parameters of interest include the -evalue (Default is 10?!?) and the -outfmt

Lets filter for more statistically significant matches with a different output format:

blastp \
-query cow.small.faa \
-db human.1.protein.faa \
-out cow_vs_human_blast_results.tab \
-evalue 1e-5 \
-outfmt 7

I broke the long single command into many lines with by “escaping” the newline. That forward slash tells the command line “Wait, I’m not done yet!”. So it waits for the next line of the command before executing.

Check out the results with less.

Lets try a medium sized data set next

head -199 cow.1.protein.faa > cow.medium.faa

What size is this db?

grep -c '^>' cow.medium.faa

Lets run the blast again, but this time lets return only the best hit for each query.

blastp \
-query cow.medium.faa \
-db human.1.protein.faa \
-out cow_vs_human_blast_results.tab \
-evalue 1e-5 \
-outfmt 6 \
-max_target_seqs 1

Summary

Review:

• command line programs such as blast use flags to get information about how and what to do
• blast options can be found by typing blastp -help
• break a command up over many lines by using `` to “escape” the new line

Blastn

blastn [-h] [-help] [-import_search_strategy filename]
[-export_search_strategy filename] [-task task_name] [-db database_name]
[-dbsize num_letters] [-gilist filename] [-seqidlist filename]
[-negative_gilist filename] [-negative_seqidlist filename]
[-entrez_query entrez_query] [-db_soft_mask filtering_algorithm]
[-db_hard_mask filtering_algorithm] [-subject subject_input_file]
[-subject_loc range] [-query input_file] [-out output_file]
[-evalue evalue] [-word_size int_value] [-gapopen open_penalty]
[-gapextend extend_penalty] [-perc_identity float_value]
[-qcov_hsp_perc float_value] [-max_hsps int_value]
[-xdrop_ungap float_value] [-xdrop_gap float_value]
[-xdrop_gap_final float_value] [-searchsp int_value]
[-sum_stats bool_value] [-penalty penalty] [-reward reward] [-no_greedy]
[-min_raw_gapped_score int_value] [-template_type type]
[-template_length int_value] [-dust DUST_options]
[-filtering_db filtering_database]
[-window_masker_taxid window_masker_taxid]
[-window_masker_db window_masker_db] [-soft_masking soft_masking]
[-ungapped] [-culling_limit int_value] [-best_hit_overhang float_value]
[-best_hit_score_edge float_value] [-window_size int_value]
[-off_diagonal_range int_value] [-use_index boolean] [-index_name string]
[-lcase_masking] [-query_loc range] [-strand strand] [-parse_deflines]
[-outfmt format] [-show_gis] [-num_descriptions int_value]
[-num_alignments int_value] [-line_length line_length] [-html]
[-max_target_seqs num_sequences] [-num_threads int_value] [-remote]
[-version]

DESCRIPTION
Nucleotide-Nucleotide BLAST 2.7.0+