BOL: Related items

PhylomeDB

Poonam Mahapatra — Mon, 12 Aug 2013 11:55:39 -0500

PhylomeDB is a public database for complete collections of gene phylogenies (phylomes). It allows users to interactively explore the evolutionary history of genes through the visualization of phylogenetic trees and multiple sequence alignments.

Moreover, phylomeDB provides genome-wide orthology and paralogy predictions which are based on the analysis of the phylogenetic trees. The automated pipeline used to reconstruct trees aims at providing a high-quality phylogenetic analysis of different genomes , including Maximum Likelihood or Bayesian tree inference, alignment trimming and evolutionary model testing. PhylomeDB includes also a public download section with the complete set of trees, alignments and orthology predictions.

More at http://phylomedb.org/

GPS DNA tracking - University of Sheffield

Sat, 10 May 2014 04:33:28 -0500

University of Sheffield geneticist and bioinformatics expert Dr Eran Elhaik demonstrates the power of his new DNA research, which allows people to discover their genetic homeland from 1000 years ago. Find out more about our biological research here http://www.sheffield.ac.uk/aps

AMR Database !

LEGE — Tue, 04 Jun 2024 13:37:21 -0500

ARG-ANNOT. PMID: 24145532
CARD. PMID: 23650175
MEGARes PMID: 27899569
NCBI BioProject: PRJNA313047
plasmidfinder PMID: 24777092
resfinder. PMID: 22782487
VFDB. PMID: 26578559
SRST2's version of ARG-ANNOT. PMID: 25422674.
VirulenceFinder PMID: 24574290.

Address of the bookmark: https://github.com/sanger-pathogens/ariba/wiki/Task%3A-getref

Managing and Analyzing Next-Generation Sequence Data

Rahul Agarwal — Sat, 10 May 2014 06:28:06 -0500

Centralized Bioinformatics Core Facilities provide shared resources for the computational and IT requirements of the investigators in their department or institution. As such, they must be able to effectively react to new types of experimental technology. Recently faced with an unprecedented flood of data generated by the next generation of DNA sequencers, these groups found it necessary to respond quickly and efficiently to the informatics and infrastructure demands. Centralized Facilities newly facing this challenge need to anticipate time and design considerations of necessary components, including infrastructure upgrades, staffing, and tools for data analyses and management ...

More at http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1000369

Address of the bookmark: http://www.ploscompbiol.org/article/info%3Adoi%2F10.1371%2Fjournal.pcbi.1000369

Public Databases for Bioinformatics !

Jit — Tue, 23 Mar 2021 05:32:15 -0500

https://www.nature.com/articles/s41467-020-17155-y

Server Infrastructure:

File Server:

dhara: Synology 3614 Storage Appliance
4 Core Xeon
108TB disk storage
10Gb ethernet to SCG3
Access atx: dhara:5000
Has btsync server (try it - its much better than dropbox)

Compute Servers:

nandi: Kundaje and Phi Server
24 intel cores
256GB RAM
500GB of SSD storage 
36TB RAID6 local storage
4 Intel Phi's (space for 4 more GPU's)


durga: Montgomery and sensitive data
24 intel cores
256GB RAM
500GB of SSD RAID0 storage 
60TB RAID6 local storage

mitra: Bassik and Web/DB Server
24 core
256GB RAM 
500GB of SSD RAID0 storage 
36TB RAID6 local storage

vayu: Kundaje GPU server
4 core
64GB RAM 
200GB of SSD storage 
8TB RAID10 local storage
4 Nvidia GTX 970 4GB GPUs

amold: Bickel and SGE server
32 AMD core
128GB RAM 
200GB of SSD storage 
12TB RAID5 local storage

wotan: Bickel and SGE server
64 AMD core
256GB RAM 
200GB of SSD storage 
12TB RAID5 local storage

Filesystem:

/users/$USER
default home directory
full backups nightly 
nfs mount to dhara
should store code, papers, and other highly processed data here

/mnt/data/
globally accessible data
should store common data here
e.g. genomes and indexes, annotations, ENCODE data  
if you dont want this to count towards your quote you must chown

/mnt/lab_data/$LAB/
lab accessible data
should store lab project data here 
e.g. ATAC-seq prediction data, enhancer prediction, motif calls

/srv/scratch/$USER
fast local storage
not backed up, but on raid and data will never be deleted
most analysis should be performed here

/srv/persistent/$USER
fast local storage
synced nightly, but not backed up
       ie if the hard drives fail or you delete something and notice 
       within 24 hours we can recover. Otherwise not. (vs home which is 
       properly backed up )  
intermediate analysis products that would be hard to recover should be stored here 
       e.g. stochastic analysis results that need to be kept so that paper 
       results can be reproduced

/srv/www/$LABNAME/
web accessible from mitra.stanford.edu
*NOT BACKED UP*

Some parallel programming patterns:

# gzip a bunch of files
parallel gzip -- *.FILESTOGZIP

# fork example in python:
(for more detailed examples look at 
 https://github.com/nboley/grit/ grit/lib/multiprocessing_utils.py)

import os
import time
import random

import multiprocessing

class ProcessSafeOPStream( object ):
    def __init__( self, writeable_obj ):
        self.writeable_obj = writeable_obj
        self.lock = multiprocessing.Lock()
        self.name = self.writeable_obj.name
        return
    
    def write( self, data ):
        self.lock.acquire()
        self.writeable_obj.write( data )
        self.writeable_obj.flush()
        self.lock.release()
        return
    
    def close( self ):
        self.writeable_obj.close()

def worker(queue, ofp):
    # Try without this
    random.seed()
    while True:
        i = queue.get()
        if i == 'FINISHED': return
        # simulate an expensive function
        x = random.random()
        time.sleep(x/10)
        print i, x
        ofp.write("%i\t%s\n" % (i, x))

NSIMS = 10000
NPROC = 25

# populate queue
todo = multiprocessing.Queue()
for i in xrange(NSIMS): todo.put(i)
for i in xrange(NPROC): todo.put('FINISHED')

ofp = ProcessSafeOPStream( open("output.txt", "w") )

pids = []
for i in xrange(NPROC):
    pid = os.fork()
    if pid == 0:
       worker(todo, ofp)
       os._exit(0)
    else:
       pids.append(pid)  

for pid in pids:
    os.waitpid(pid, 0)

ofp.close()

print "FINISHED"

For use case 1 we obtained the following ENCODE and ROADMAP datasets https://www.encodeproject.org/files/ENCFF446WOD/@@download/ENCFF446WOD.bed.gz, https://www.encodeproject.org/files/ENCFF546PJU/@@download/ENCFF546PJU.bam, https://www.encodeproject.org/files/ENCFF059BEU/@@download/ENCFF059BEU.bam. Blacklisted regions were obtained from http://mitra.stanford.edu/kundaje/akundaje/release/blacklists/hg38-human/hg38.blacklist.bed.gz. The human genome version hg38 was obtained from http://hgdownload.cse.ucsc.edu/goldenPath/hg38/bigZips/hg38.fa.gz.

For use case 2 we used the set of narrowPeak files summarized in https://github.com/wkopp/janggu_usecases/tree/master/extra/urls.txt (archived version v1.0.1). The human genome version hg19 was obtained from http://hgdownload.cse.ucsc.edu/goldenPath/hg19/bigZips/hg19.fa.gz

For use case 3 we used the ENCODE datasets https://www.encodeproject.org/files/ENCFF591XCX/@@download/ENCFF591XCX.bam, https://www.encodeproject.org/files/ENCFF736LHE/@@download/ENCFF736LHE.bigWig, https://www.encodeproject.org/files/ENCFF177HHM/@@download/ENCFF177HHM.bam as we as the GENCODE annotation v29 from ftp://ftp.ebi.ac.uk/pub/databases/gencode/Gencode_human/release_29/gencode.v29.annotation.gtf.gz.

Address of the bookmark: http://mitra.stanford.edu/

Visiting Scientist - Computational Genomics (two positions)

Mon, 07 Jul 2014 22:53:41 -0500

Scientific/Managerial & International Recruitment

ICRISAT seeks applications from Indian nationals Visiting Scientist-Computational Genomics (2 positions), to be part of a team of Centre of Excellence in Genomics (CEG), (www.icrisat.org/ceg) to work on legume genomics projects. The positions will be based at ICRISAT’s Headquarters in Patancheru, Hyderabad, India.

ICRISAT is a non-profit, non-political organization that conducts agricultural research for development in Asia and sub-Saharan Africa with a wide array of partners throughout the world. Covering 6.5 million square kilometers of land in 55 countries, the semi-arid tropics is home to over 2 billion people, with 650 million of these are the poorest of the poor. ICRISAT and its partners help empower those living in the semi-arid tropics, especially smallholder farmers, to overcome poverty, hunger, malnutrition and a degraded environment through more efficient and profitable agriculture. ICRISAT is headquartered in Greater Hyderabad, Andhra Pradesh, India and belongs to the Consortium of Centers supported by the Consultative Group on International Agricultural Research (CGIAR).

The Job: Responsibilities for these positions include:

Analyzing and handling large-scale next generation sequencing DNA and RNA data
Data mining and development of pipelines and troubleshooting
Genome diversity analysis such as SNPs, Indels, Structural Variations, population structure
Genome wide association study (GWAS) related analysis- LD analysis, hapmap and trait mapping
Expression analysis based on RNA-Seq data, annotation, gene ontology and metabolic pathway analysis
Epigenome analysis, small RNA identification
Gene family analysis, sequence level protein analysis, orthology/paralogy and molecular modelling
Compiling and analysis of results, writing reports and research papers

The Person: Ph.D. or MSc/MTech/PGDCA with two years research experience in Biotechnology, Computational biology, Agricultural/ Plant Biotechnology, Genetics, Molecular Biology or related discipline. Good knowledge of programming/scripting in at least two of following languages: Perl, C, C++, R, Shell Scripting and Python is plus.

How to apply: Please apply latest by 20 July 2014. The application should include the name of the position applied for, a letter of motivation, a full Curriculum Vita (CV), and the names and contact information of three references that are knowledgeable of the candidate’s professional qualifications and work experience. Technical details and more information about these positions can be obtained from R.K.VARSHNEY@CGIAR.ORG. All applications will be acknowledged, however only short listed candidates will be contacted.

Apply here https://recruit.zoho.com/ats/Portal.na?digest=T642sgLYWZOStExJ77cPrcM*sIMGZETWw4yPxngbmHA-

Updated ranking of institutes and countries based on developed biological databases

Rahul Nayak — Fri, 11 Jan 2019 09:35:26 -0600

Updated ranking of institutes and countries based on developed biological databases is available at https://lnkd.in/fiVAdM6 , India is maintaing 4th position and "Institute of Microbial Technology, Chandigarh" is on 3rd Position (after EBI and NCBI). This is a big achievement for any institute to reach on 3rd position in the world.

More at http://bigd.big.ac.cn/databasecommons/stat

R programming and Jobs website

Pragati Singh — Sun, 25 May 2014 14:43:57 -0500

Welcome to the R Jobs section of ProgrammingR.com. If your organization has an R employment opportunity that you would like to have posted here, submit it via the contact page. Prospective employees: use the contact information provided in the position listing to apply or contact the hiring organization.

Address of the bookmark: http://www.programmingr.com/category/stype/r-job-listings/

BUSCO datasets !

Jit — Wed, 13 Jan 2021 19:44:33 -0600

The BUSCO software now directly downloads the necessary datasets, specified by the user or automatically selected.

To display all available datasets

busco --list-datasets

You can also download them manually and see a list with the number of marker genes.

Earlier versions: v3, v2, v1

../
acidobacteria_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     14M
aconoidasida_odb10.2020-08-05.tar.gz               16-Oct-2020 13:19     51M
actinobacteria_class_odb10.2020-03-06.tar.gz       16-Oct-2020 13:19      8M
actinobacteria_phylum_odb10.2020-03-06.tar.gz      16-Oct-2020 13:20      9M
actinopterygii_odb10.2020-08-05.tar.gz             16-Oct-2020 13:20    173M
agaricales_odb10.2020-08-05.tar.gz                 16-Oct-2020 13:20    186M
agaricomycetes_odb10.2020-08-05.tar.gz             16-Oct-2020 13:19    152M
alphaproteobacteria_odb10.2020-03-06.tar.gz        16-Oct-2020 13:20     11M
alteromonadales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:20     18M
alveolata_odb10.2020-09-10.tar.gz                  16-Oct-2020 13:20     13M
apicomplexa_odb10.2020-09-10.tar.gz                16-Oct-2020 13:19     27M
aquificae_odb10.2020-03-06.tar.gz                  16-Oct-2020 13:19     12M
arachnida_odb10.2020-08-05.tar.gz                  16-Oct-2020 13:19    136M
archaea_odb10.2020-03-06.tar.gz                    16-Oct-2020 13:20      4M
arthropoda_odb10.2020-09-10.tar.gz                 16-Oct-2020 13:20     95M
ascomycota_odb10.2020-09-10.tar.gz                 16-Oct-2020 13:20    295M
aves_odb10.2020-09-10.tar.gz                       16-Oct-2020 13:20    465M
bacillales_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:20     10M
bacilli_odb10.2020-03-06.tar.gz                    16-Oct-2020 13:19      7M
bacteria_odb10.2020-03-06.tar.gz                   16-Oct-2020 13:20      6M
bacteroidales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:20     13M
bacteroidetes-chlorobi_group_odb10.2020-03-06.t..> 16-Oct-2020 13:19      9M
bacteroidetes_odb10.2020-03-06.tar.gz              16-Oct-2020 13:20     10M
bacteroidia_odb10.2020-03-06.tar.gz                16-Oct-2020 13:20     13M
basidiomycota_odb10.2020-09-10.tar.gz              16-Oct-2020 13:19    165M
betaproteobacteria_odb10.2020-03-06.tar.gz         16-Oct-2020 13:19     13M
boletales_odb10.2020-08-05.tar.gz                  16-Oct-2020 13:19    197M
brassicales_odb10.2020-08-05.tar.gz                16-Oct-2020 13:20    158M
burkholderiales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     16M
campylobacterales_odb10.2020-03-06.tar.gz          16-Oct-2020 13:20     14M
capnodiales_odb10.2020-08-05.tar.gz                16-Oct-2020 13:19    178M
carnivora_odb10.2020-08-05.tar.gz                  16-Oct-2020 13:19    376M
cellvibrionales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     19M
cetartiodactyla_odb10.2020-08-05.tar.gz            16-Oct-2020 13:19    407M
chaetothyriales_odb10.2020-08-05.tar.gz            16-Oct-2020 13:20    288M
chlamydiae_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:20     13M
chlorobi_odb10.2020-03-06.tar.gz                   16-Oct-2020 13:20     22M
chloroflexi_odb10.2020-03-06.tar.gz                16-Oct-2020 13:20      6M
chlorophyta_odb10.2020-08-05.tar.gz                16-Oct-2020 13:20     58M
chromatiales_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     14M
chroococcales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     27M
clostridia_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:19      6M
clostridiales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:20      6M
coccidia_odb10.2020-08-05.tar.gz                   16-Oct-2020 13:20     24M
coriobacteriales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:19     12M
coriobacteriia_odb10.2020-03-06.tar.gz             16-Oct-2020 13:20      9M
corynebacteriales_odb10.2020-03-06.tar.gz          16-Oct-2020 13:19     16M
cyanobacteria_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     17M
cyprinodontiformes_odb10.2020-08-05.tar.gz         16-Oct-2020 13:19    504M
cytophagales_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     18M
cytophagia_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:20     18M
delta-epsilon-subdivisions_odb10.2020-03-06.tar.gz 16-Oct-2020 13:19      6M
deltaproteobacteria_odb10.2020-03-06.tar.gz        16-Oct-2020 13:19      6M
desulfobacterales_odb10.2020-03-06.tar.gz          16-Oct-2020 13:20     13M
desulfovibrionales_odb10.2020-03-06.tar.gz         16-Oct-2020 13:19     17M
desulfurococcales_odb10.2020-03-06.tar.gz          16-Oct-2020 13:20      9M
desulfuromonadales_odb10.2020-03-06.tar.gz         16-Oct-2020 13:19     18M
diptera_odb10.2020-08-05.tar.gz                    16-Oct-2020 13:19    185M
dothideomycetes_odb10.2020-08-05.tar.gz            16-Oct-2020 13:19    194M
embryophyta_odb10.2020-09-10.tar.gz                16-Oct-2020 13:19    138M
endopterygota_odb10.2020-09-10.tar.gz              16-Oct-2020 13:19    190M
enterobacterales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:19     11M
entomoplasmatales_odb10.2020-03-06.tar.gz          16-Oct-2020 13:19      7M
epsilonproteobacteria_odb10.2020-03-06.tar.gz      16-Oct-2020 13:20     13M
euarchontoglires_odb10.2020-09-10.tar.gz           16-Oct-2020 13:20    728M
eudicots_odb10.2020-09-10.tar.gz                   16-Oct-2020 13:19    168M
euglenozoa_odb10.2020-08-05.tar.gz                 16-Oct-2020 13:20     10M
eukaryota_odb10.2020-09-10.tar.gz                  16-Oct-2020 13:19    100M
eurotiales_odb10.2020-08-05.tar.gz                 16-Oct-2020 13:19    211M
eurotiomycetes_odb10.2020-08-05.tar.gz             16-Oct-2020 13:19    197M
euryarchaeota_odb10.2020-03-06.tar.gz              16-Oct-2020 13:20      5M
eutheria_odb10.2020-09-10.tar.gz                   16-Oct-2020 13:20    920M
fabales_odb10.2020-08-05.tar.gz                    16-Oct-2020 13:19    184M
firmicutes_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:20      6M
flavobacteriales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:19     18M
flavobacteriia_odb10.2020-03-06.tar.gz             16-Oct-2020 13:20     18M
fungi_odb10.2020-09-10.tar.gz                      16-Oct-2020 13:19    181M
fusobacteria_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     11M
fusobacteriales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     11M
gammaproteobacteria_odb10.2020-03-06.tar.gz        16-Oct-2020 13:19     10M
glires_odb10.2020-08-05.tar.gz                     16-Oct-2020 13:19    549M
glomerellales_odb10.2020-08-05.tar.gz              16-Oct-2020 13:19    259M
halobacteria_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     18M
halobacteriales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:20     18M
haloferacales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     20M
helotiales_odb10.2020-08-05.tar.gz                 16-Oct-2020 13:19    224M
hemiptera_odb10.2020-08-05.tar.gz                  16-Oct-2020 13:19    115M
hymenoptera_odb10.2020-08-05.tar.gz                16-Oct-2020 13:19    321M
hypocreales_odb10.2020-08-05.tar.gz                16-Oct-2020 13:19    224M
insecta_odb10.2020-09-10.tar.gz                    16-Oct-2020 13:20    119M
lactobacillales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19      9M
laurasiatheria_odb10.2020-09-10.tar.gz             16-Oct-2020 13:20    688M
legionellales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     16M
leotiomycetes_odb10.2020-08-05.tar.gz              16-Oct-2020 13:19    164M
lepidoptera_odb10.2020-08-05.tar.gz                16-Oct-2020 13:20    241M
liliopsida_odb10.2020-09-10.tar.gz                 16-Oct-2020 13:20    163M
mammalia_odb10.2020-09-10.tar.gz                   16-Oct-2020 13:19    677M
metazoa_odb10.2020-09-10.tar.gz                    16-Oct-2020 13:19    127M
methanobacteria_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     15M
methanococcales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:20     17M
methanomicrobia_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     12M
methanomicrobiales_odb10.2020-03-06.tar.gz         16-Oct-2020 13:20     16M
micrococcales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     12M
microsporidia_odb10.2020-08-05.tar.gz              16-Oct-2020 13:20     26M
mollicutes_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:20      3M
mollusca_odb10.2020-08-05.tar.gz                   16-Oct-2020 13:20    266M
mucorales_odb10.2020-08-05.tar.gz                  16-Oct-2020 13:20    105M
mucoromycota_odb10.2020-08-05.tar.gz               16-Oct-2020 13:19     75M
mycoplasmatales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19      4M
natrialbales_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     24M
neisseriales_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     16M
nematoda_odb10.2020-08-05.tar.gz                   16-Oct-2020 13:20    138M
nitrosomonadales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:19     15M
nostocales_odb10.2020-03-06.tar.gz                 16-Oct-2020 13:19     35M
oceanospirillales_odb10.2020-03-06.tar.gz          16-Oct-2020 13:19     13M
onygenales_odb10.2020-08-05.tar.gz                 16-Oct-2020 13:19    233M
oscillatoriales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     29M
passeriformes_odb10.2020-08-05.tar.gz              16-Oct-2020 13:20    298M
pasteurellales_odb10.2020-03-06.tar.gz             16-Oct-2020 13:19     19M
planctomycetes_odb10.2020-03-06.tar.gz             16-Oct-2020 13:19     13M
plasmodium_odb10.2020-08-05.tar.gz                 16-Oct-2020 13:20    199M
pleosporales_odb10.2020-08-05.tar.gz               16-Oct-2020 13:19    288M
poales_odb10.2020-08-05.tar.gz                     16-Oct-2020 13:19    186M
polyporales_odb10.2020-08-05.tar.gz                16-Oct-2020 13:20    206M
primates_odb10.2020-08-05.tar.gz                   16-Oct-2020 13:19    451M
propionibacteriales_odb10.2020-03-06.tar.gz        16-Oct-2020 13:19     14M
proteobacteria_odb10.2020-03-06.tar.gz             16-Oct-2020 13:19      8M
pseudomonadales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     17M
rhizobiales_odb10.2020-03-06.tar.gz                16-Oct-2020 13:19     15M
rhizobium-agrobacterium_group_odb10.2020-03-06...> 16-Oct-2020 13:19     34M
rhodobacterales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     19M
rhodospirillales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:19     14M
rickettsiales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19      8M
saccharomycetes_odb10.2020-08-05.tar.gz            16-Oct-2020 13:20    109M
sauropsida_odb10.2020-09-10.tar.gz                 16-Oct-2020 13:19    499M
selenomonadales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     16M
solanales_odb10.2020-08-05.tar.gz                  16-Oct-2020 13:19    196M
sordariomycetes_odb10.2020-08-05.tar.gz            16-Oct-2020 13:19    206M
sphingobacteriia_odb10.2020-03-06.tar.gz           16-Oct-2020 13:20     21M
sphingomonadales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:19     22M
spirochaetales_odb10.2020-03-06.tar.gz             16-Oct-2020 13:20      8M
spirochaetes_odb10.2020-03-06.tar.gz               16-Oct-2020 13:20      6M
spirochaetia_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19      6M
stramenopiles_odb10.2020-08-05.tar.gz              16-Oct-2020 13:19      5M
streptomycetales_odb10.2020-03-06.tar.gz           16-Oct-2020 13:20     31M
streptosporangiales_odb10.2020-03-06.tar.gz        16-Oct-2020 13:19     22M
sulfolobales_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19     22M
synechococcales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     16M
synergistetes_odb10.2020-03-06.tar.gz              16-Oct-2020 13:19     14M
tenericutes_odb10.2020-03-06.tar.gz                16-Oct-2020 13:20      4M
tetrapoda_odb10.2020-09-10.tar.gz                  16-Oct-2020 13:19    561M
thaumarchaeota_odb10.2020-03-06.tar.gz             16-Oct-2020 13:20     13M
thermoanaerobacterales_odb10.2020-03-06.tar.gz     16-Oct-2020 13:19     10M
thermoplasmata_odb10.2020-03-06.tar.gz             16-Oct-2020 13:20      7M
thermoproteales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19      8M
thermoprotei_odb10.2020-03-06.tar.gz               16-Oct-2020 13:20      6M
thermotogae_odb10.2020-03-06.tar.gz                16-Oct-2020 13:19     16M
thiotrichales_odb10.2020-03-06.tar.gz              16-Oct-2020 13:20     11M
tissierellales_odb10.2020-03-06.tar.gz             16-Oct-2020 13:19      9M
tissierellia_odb10.2020-03-06.tar.gz               16-Oct-2020 13:19      8M
tremellomycetes_odb10.2020-08-05.tar.gz            16-Oct-2020 13:19    210M
verrucomicrobia_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     11M
vertebrata_odb10.2020-09-10.tar.gz                 16-Oct-2020 13:19    409M
vibrionales_odb10.2020-03-06.tar.gz                16-Oct-2020 13:20     26M
viridiplantae_odb10.2020-09-10.tar.gz              16-Oct-2020 13:20     36M
xanthomonadales_odb10.2020-03-06.tar.gz            16-Oct-2020 13:19     24M

Address of the bookmark: https://busco-data.ezlab.org/v4/data/lineages/

Perl one-liner for bioinformatician !!!

Abhimanyu Singh — Fri, 30 May 2014 05:49:07 -0500

With the emergence of NGS technologies, and sequencing data most of the bioinformaticians mung and wrangle around massive amounts of genomics text. There are several "standardized" file formats (FASTQ, SAM, VCF, etc.) and some tools for manipulating them (fastx toolkit, samtools, vcftools, etc.), there are still times where knowing a little bit of Perl onliner is extremely helpful.

Perl one-liners are small and awesome Perl programs that fit in a single line of code and they do one thing really well. These things include changing line spacing, numbering lines, doing calculations, converting and substituting text, deleting and printing certain lines, parsing logs, editing files in-place, doing statistics, carrying out system administration tasks, updating a bunch of files at once, and many more. Perl one-liners will make you the shell warrior. Anything that took you minutes to solve, will now take you seconds!

perl -pe '$\="\n"'
#double space a file

perl -pe '$_ .= "\n" unless /^$/'
#double space a file except blank lines

perl -pe '$_.="\n"x7'
#7 space in a line.

perl -ne 'print unless /^$/'
#remove all blank lines

perl -lne 'print if length($_) < 20'
#print all lines with length less than 20.

perl -00 -pe ''
#If there are multiple spaces, delete all leaving one(make the file a single spaced file).

perl -00 -pe '$_.="\n"x4'
#Expand single blank lines into 4 consecutive blank lines

perl -pe '$_ = "$. $_"'
#Number all lines in a file

perl -pe '$_ = ++$a." $_" if /./'
#Number only non-empty lines in a file

perl -ne 'print ++$a." $_" if /./'
#Number and print only non-empty lines in a file

perl -pe '$_ = ++$a." $_" if /regex/'
#Number only lines that match a pattern

perl -ne 'print ++$a." $_" if /regex/'
#Number and print only lines that match a pattern

perl -ne 'printf "%-5d %s", $., $_ if /regex/'
#Left align lines with 5 white spaces if matches a pattern (perl -ne 'printf "%-5d %s", $., $_' : for all the lines)

perl -le 'print scalar(grep{/./}<>)'
#prints the total number of non-empty lines in a file

perl -lne '$a++ if /regex/; END {print $a+0}'
#print the total number of lines that matches the pattern

perl -alne 'print scalar @F'
#print the total number fields(words) in each line.

perl -alne '$t += @F; END { print $t}'
#Find total number of words in the file

perl -alne 'map { /regex/ && $t++ } @F; END { print $t }'
#find total number of fields that match the pattern

perl -lne '/regex/ && $t++; END { print $t }'
#Find total number of lines that match a pattern

perl -le '$n = 20; $m = 35; ($m,$n) = ($n,$m%$n) while $n; print $m'
#will calculate the GCD of two numbers.

perl -le '$a = $n = 20; $b = $m = 35; ($m,$n) = ($n,$m%$n) while $n; print $a*$b/$m'
#will calculate lcd of 20 and 35.

perl -le '$n=10; $min=5; $max=15; $, = " "; print map { int(rand($max-$min))+$min } 1..$n'
#Generates 10 random numbers between 5 and 15.

perl -le 'print map { ("a".."z",”0”..”9”)[rand 36] } 1..8'
#Generates a 8 character password from a to z and number 0 – 9.

perl -le 'print map { ("a",”t”,”g”,”c”)[rand 4] } 1..20'
#Generates a 20 nucleotide long random residue.

perl -le 'print "a"x50'
#generate a string of ‘x’ 50 character long

perl -le 'print join ", ", map { ord } split //, "hello world"'
#Will print the ascii value of the string hello world.

perl -le '@ascii = (99, 111, 100, 105, 110, 103); print pack("C*", @ascii)'
#converts ascii values into character strings.

perl -le '@odd = grep {$_ % 2 == 1} 1..100; print "@odd"'
#Generates an array of odd numbers.

perl -le '@even = grep {$_ % 2 == 0} 1..100; print "@even"'
#Generate an array of even numbers

perl -lpe 'y/A-Za-z/N-ZA-Mn-za-m/' file
#Convert the entire file into 13 characters offset(ROT13)

perl -nle 'print uc'
#Convert all text to uppercase:

perl -nle 'print lc'
#Convert text to lowercase:

perl -nle 'print ucfirst lc'
#Convert only first letter of first word to uppercas

perl -ple 'y/A-Za-z/a-zA-Z/'
#Convert upper case to lower case and vice versa

perl -ple 's/(\w+)/\u$1/g'
#Camel Casing

perl -pe 's|\n|\r\n|'
#Convert unix new lines into DOS new lines:

perl -pe 's|\r\n|\n|'
#Convert DOS newlines into unix new line

perl -pe 's|\n|\r|'
#Convert unix newlines into MAC newlines:

perl -pe '/regexp/ && s/foo/bar/'
#Substitute a foo with a bar in a line with a regexp.

Reference/Sources:

http://genomics-array.blogspot.in/2010/11/some-unixperl-oneliners-for.html

http://genomespot.blogspot.com/2013/08/a-selection-of-useful-bash-one-liners.html

http://biowize.wordpress.com/2012/06/15/command-line-magic-for-your-gene-annotations/

http://genomics-array.blogspot.com/2010/11/some-unixperl-oneliners-for.html

http://bioexpressblog.wordpress.com/2013/04/05/split-multi-fasta-sequence-file/