BOL: Related items

HiGlass: a tool for exploring genomic contact matrices and tracks.

Jit — Mon, 11 Jun 2018 09:44:49 -0500

HiGlass is a tool for exploring genomic contact matrices and tracks. Please take a look at the examples and documentation for a description of the ways that it can be configured to explore and compare contact matrices. To load private data, HiGlass can be run locally within a Docker container. The HiC data in the examples below is from Rao et al. (2014) http://higlass.io/

Address of the bookmark: http://higlass.io/

Osprey: Network Visualization System

BioJoker — Sun, 20 Jan 2019 05:34:24 -0600

Osprey is a software platform for the visualization of complex biological interaction networks. Osprey builds data-rich graphical representations from Gene Ontology (GO) annotated interaction data maintained by the BioGRID.

Osprey is developed by the TyersLab and is a part of the BioGRID family of software. It utilizes both MySQL and Java to operate and is compatible with Windows, Linux, and Apple operating systems.

These works were published in Breitkreutz, BJ., Stark, C., Tyers M. "Osprey: A Network Visualization System." Genome Biology 2003 4(3):R22 [Genome Biology] [PDF] [PubMed] and supported by the National Institutes of Health, Canadian Institutes of Health Research, and Genome Canada.

Address of the bookmark: https://osprey.thebiogrid.org/

Comprehensive list of visualization tools for biological pathways

Neel — Tue, 30 Jan 2018 06:01:31 -0600

The study of biological pathways is a key to understand the different processes inside a cell: proteins exert their function not in isolation but in a tightly controlled network of interactions and reactions. Activation of a pathway typically leads to a change of state in the cell. Pathways come in different flavors, depending on their functions in the cell – the three main types are metabolic pathways, gene regulatory pathways, and signaling pathways. These biological pathways and networks are not only an appropriate approach to visualize molecular reactions. They have also become one leading method in -omics data analysis and visualization.

Following are the comprehensive list of visualization tools for biological pathways:

BiNA

Drawings of metabolic networks supporting hiding of cofactors and drawing of chemical structures

http://bina.unipax.info/

BioTapestry

Interactive tool for building, visualizing and sharing gene regulatory network models over the web

http://www.biotapestry.org/

Caleydo

Visual analysis framework targeted at biomolecular data. Visualization of interdependencies between multiple datasets

http://www.caleydo.org/

CellDesigner

A modeling tool for biochemical networks

http://www.celldesigner.org/

Edinburgh Pathway Editor

Edit and draw pathway diagrams

http://epe.sourceforge.net/SourceForge/EPE.html

GenMAPP

Visualization of gene expression and other genomic data on maps representing biological pathways and groupings of genes

http://www.genmapp.org/

Ingenuity IPA

Data integration platform and manually annotated pathways

http://tinyurl.com/IngenuityPath

JDesigner

Graphical modeling environment for biochemical reaction networks

http://jdesigner.sourceforge.net/Site/JDesigner.html

KaPPA View

Plant pathways

http://kpv.kazusa.or.jp/

KEGG Atlas

Interactive Kyoto Encyclopedia of Genes and Genomes pathways

http://www.genome.jp/kegg/

Omix

Visualizing multi-omics data in metabolic networks

https://www.omix-visualization.com

PathVisio

Biological pathway analysis software that allows drawing, editing and analysis of biological pathways

http://www.pathvisio.org/

VitaPad

Application to visualize biological pathways and map experimental data to them

http://tinyurl.com/vitapad/

Web tools for pathways

ArrayXPath

Mapping and visualizing microarray gene-expression data and integrated biological pathway resources using SVG

http://tinyurl.com/ArrayXPath/

GEPAT

Integrated analysis of transcriptome data in genomic, proteomic and metabolic contexts

http://gepat.sourceforge.net/

iPath

Web-based tool for the visualization, analysis and customization of pathway maps

http://pathways.embl.de/

Kegg-Based Viewer

KEGG-based pathway visualization tool for complex high-throughput data

http://www.g-language.org/data/marray/

MapMan

User-driven tool that displays large datasets onto diagrams of metabolic pathways or other processes

http://mapman.gabipd.org/web/guest/mapman

MetPA

Analysis and visualization of metabolomic data within the biological context of metabolic pathways

http://metpa.metabolomics.ca

Omics Viewer

Data mapping on BioCyc pathways (collection of 5500 pathway/genome databases)

http://www.biocyc.org/

Pathway Explorer

Interactive Java drawing tool for the construction of biological pathway diagrams in a visual way and the annotation of the components and interactions between them

http://genome.tugraz.at/pathwayexplorer/pathwayexplorer_description.shtml

Pathway projector

Zoomable pathway browser using KEGG atlas and Google Maps API

http://www.g-language.org/PathwayProjector/

PATIKA

Integrated environment composed of a central database and a visual editor, built around an extensive ontology and an integration framework

http://www.cs.bilkent.edu.tr/~patikaweb/

Reactome SkyPainter

Visualization of over-represented pathways and reactions from gene lists

http://www.reactome.org/skypainter-2

WikiPathways

Wiki-based, open, public platform dedicated to the curation of biological pathways by and for the scientific community

http://www.wikipathways.org/

Harvest: a suite of core-genome alignment and visualization tools

Jit — Fri, 08 Dec 2017 07:16:03 -0600

Harvest is a suite of core-genome alignment and visualization tools for quickly analyzing thousands of intraspecific microbial genomes, including variant calls, recombination detection, and phylogenetic trees.

Tools

Parsnp - Core-genome alignment and analysis
Gingr - Interactive visualization of alignments, trees and variants
HarvestTools - Archiving and postprocessing

Address of the bookmark: https://harvest.readthedocs.io/en/latest/

NanoPack: visualizing and processing long-read sequencing data

Jit — Fri, 10 Aug 2018 18:41:34 -0500

The NanoPack tools are written in Python3 and released under the GNU GPL3.0 License. The source code can be found at https://github.com/wdecoster/nanopack, together with links to separate scripts and their documentation. The scripts are compatible with Linux, Mac OS and the MS Windows 10 subsystem for Linux and are available as a graphical user interface, a web service at http://nanoplot.bioinf.be and command line tools.

https://academic.oup.com/bioinformatics/article/34/15/2666/4934939

Address of the bookmark: https://github.com/wdecoster/nanoQC

PANEV: an R package for a pathway-based network visualization

Jit — Sun, 09 Feb 2020 12:41:52 -0600

PANEV (PAthway NEtwork Visualizer) is an R package set for gene/pathway-based network visualization. Based on information available on KEGG, it visualizes genes within a network of multiple levels (from 1 to n) of interconnected upstream and downstream pathways. The network graph visualization helps to interpret functional profiles of a cluster of genes.

https://bmcbioinformatics.biomedcentral.com/articles/10.1186/s12859-020-3371-7

Address of the bookmark: https://github.com/vpalombo/PANEV

ReConPlot: an R package for the visualization and interpretation of genomic rearrangements

LEGE — Thu, 14 Dec 2023 12:33:19 -0600

ReConPlot (REarrangement and COpy Number PLOT), an R package that provides functionalities for the joint visualization of SCNAs and SVs across one or multiple chromosomes. ReConPlot is based on the popular ggplot2 package, thus allowing customization of plots and the generation of publication-quality figures with minimal effort.

Address of the bookmark: https://academic.oup.com/bioinformatics/article/39/12/btad719/7460198?login=false

karyoploteR: plot whole genomes with arbitrary data

Abhimanyu Singh — Fri, 02 Feb 2018 03:24:28 -0600

karyoploteR is an R package to create karyoplots, that is, representations of whole genomes with arbitrary data plotted on them. It is inspired by the R base graphics system and does not depend on other graphics packages. The aim of karyoploteR is to offer the user an easy way to plot data along the genome to get broad genome-wide view to facilitate the identification of genome wide relations and distributions.

Address of the bookmark: https://bernatgel.github.io/karyoploter_tutorial/

KAST: Perform Alignment-free k-tuple frequency comparisons from sequences

Jit — Thu, 20 Sep 2018 08:56:35 -0500

Perform Alignment-free k-tuple frequency comparisons from sequences. This can be in the form of two input files (e.g. a reference and a query) or a single file for pairwise comparisons to be made.

Address of the bookmark: https://github.com/martinjvickers/KAST

Public Databases for Bioinformatics !

Jit — Tue, 23 Mar 2021 05:32:15 -0500

https://www.nature.com/articles/s41467-020-17155-y

Server Infrastructure:

File Server:

dhara: Synology 3614 Storage Appliance
4 Core Xeon
108TB disk storage
10Gb ethernet to SCG3
Access atx: dhara:5000
Has btsync server (try it - its much better than dropbox)

Compute Servers:

nandi: Kundaje and Phi Server
24 intel cores
256GB RAM
500GB of SSD storage 
36TB RAID6 local storage
4 Intel Phi's (space for 4 more GPU's)


durga: Montgomery and sensitive data
24 intel cores
256GB RAM
500GB of SSD RAID0 storage 
60TB RAID6 local storage

mitra: Bassik and Web/DB Server
24 core
256GB RAM 
500GB of SSD RAID0 storage 
36TB RAID6 local storage

vayu: Kundaje GPU server
4 core
64GB RAM 
200GB of SSD storage 
8TB RAID10 local storage
4 Nvidia GTX 970 4GB GPUs

amold: Bickel and SGE server
32 AMD core
128GB RAM 
200GB of SSD storage 
12TB RAID5 local storage

wotan: Bickel and SGE server
64 AMD core
256GB RAM 
200GB of SSD storage 
12TB RAID5 local storage

Filesystem:

/users/$USER
default home directory
full backups nightly 
nfs mount to dhara
should store code, papers, and other highly processed data here

/mnt/data/
globally accessible data
should store common data here
e.g. genomes and indexes, annotations, ENCODE data  
if you dont want this to count towards your quote you must chown

/mnt/lab_data/$LAB/
lab accessible data
should store lab project data here 
e.g. ATAC-seq prediction data, enhancer prediction, motif calls

/srv/scratch/$USER
fast local storage
not backed up, but on raid and data will never be deleted
most analysis should be performed here

/srv/persistent/$USER
fast local storage
synced nightly, but not backed up
       ie if the hard drives fail or you delete something and notice 
       within 24 hours we can recover. Otherwise not. (vs home which is 
       properly backed up )  
intermediate analysis products that would be hard to recover should be stored here 
       e.g. stochastic analysis results that need to be kept so that paper 
       results can be reproduced

/srv/www/$LABNAME/
web accessible from mitra.stanford.edu
*NOT BACKED UP*

Some parallel programming patterns:

# gzip a bunch of files
parallel gzip -- *.FILESTOGZIP

# fork example in python:
(for more detailed examples look at 
 https://github.com/nboley/grit/ grit/lib/multiprocessing_utils.py)

import os
import time
import random

import multiprocessing

class ProcessSafeOPStream( object ):
    def __init__( self, writeable_obj ):
        self.writeable_obj = writeable_obj
        self.lock = multiprocessing.Lock()
        self.name = self.writeable_obj.name
        return
    
    def write( self, data ):
        self.lock.acquire()
        self.writeable_obj.write( data )
        self.writeable_obj.flush()
        self.lock.release()
        return
    
    def close( self ):
        self.writeable_obj.close()

def worker(queue, ofp):
    # Try without this
    random.seed()
    while True:
        i = queue.get()
        if i == 'FINISHED': return
        # simulate an expensive function
        x = random.random()
        time.sleep(x/10)
        print i, x
        ofp.write("%i\t%s\n" % (i, x))

NSIMS = 10000
NPROC = 25

# populate queue
todo = multiprocessing.Queue()
for i in xrange(NSIMS): todo.put(i)
for i in xrange(NPROC): todo.put('FINISHED')

ofp = ProcessSafeOPStream( open("output.txt", "w") )

pids = []
for i in xrange(NPROC):
    pid = os.fork()
    if pid == 0:
       worker(todo, ofp)
       os._exit(0)
    else:
       pids.append(pid)  

for pid in pids:
    os.waitpid(pid, 0)

ofp.close()

print "FINISHED"

For use case 1 we obtained the following ENCODE and ROADMAP datasets https://www.encodeproject.org/files/ENCFF446WOD/@@download/ENCFF446WOD.bed.gz, https://www.encodeproject.org/files/ENCFF546PJU/@@download/ENCFF546PJU.bam, https://www.encodeproject.org/files/ENCFF059BEU/@@download/ENCFF059BEU.bam. Blacklisted regions were obtained from http://mitra.stanford.edu/kundaje/akundaje/release/blacklists/hg38-human/hg38.blacklist.bed.gz. The human genome version hg38 was obtained from http://hgdownload.cse.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz.

For use case 2 we used the set of narrowPeak files summarized in https://github.com/wkopp/janggu_usecases/tree/master/extra/urls.txt (archived version v1.0.1). The human genome version hg19 was obtained from http://hgdownload.cse.ucsc.edu/goldenPath/hg19/bigZips/hg19.fa.gz

For use case 3 we used the ENCODE datasets https://www.encodeproject.org/files/ENCFF591XCX/@@download/ENCFF591XCX.bam, https://www.encodeproject.org/files/ENCFF736LHE/@@download/ENCFF736LHE.bigWig, https://www.encodeproject.org/files/ENCFF177HHM/@@download/ENCFF177HHM.bam as we as the GENCODE annotation v29 from ftp://ftp.ebi.ac.uk/pub/databases/gencode/Gencode_human/release_29/gencode.v29.annotation.gtf.gz.

Address of the bookmark: http://mitra.stanford.edu/