BOL: Related items

Understanding kmer !

BioStar — Wed, 18 Aug 2021 04:27:51 -0500

What is a k-mer anyway? A k-mer is just a sequence of k characters in a string (or nucleotides in a DNA sequence). Now, it is important to remember that to get all k-mers from a sequence you need to get the first k characters, then move just a single character for the start of the next k-mer and so on. Effectively, this will create sequences that overlap in k-1 positions.

Address of the bookmark: https://bioinfologics.github.io/post/2018/09/17/k-mer-counting-part-i-introduction/

SqueezeMeta: a fully automated metagenomics pipeline, from reads to bins

BioStar — Sat, 06 Jul 2024 04:29:16 -0500

SqueezeMeta is a full automatic pipeline for metagenomics/metatranscriptomics, covering all steps of the analysis. SqueezeMeta includes multi-metagenome support allowing the co-assembly of related metagenomes and the retrieval of individual genomes via binning procedures. Thus, SqueezeMeta features several unique characteristics:

Co-assembly procedure with read mapping for estimation of the abundances of genes in each metagenome
Co-assembly of a large number of metagenomes via merging of individual metagenomes
Includes binning and bin checking, for retrieving individual genomes
The results are stored in a database, where they can be easily exported and shared, and can be inspected anywhere using a web interface.
Internal checks for the assembly and binning steps inform about the consistency of contigs and bins, allowing to spot potential chimeras.
Metatranscriptomic support via mapping of cDNA reads against reference metagenomes

Address of the bookmark: https://github.com/jtamames/SqueezeMeta

Multi-metagenome assembly

Radha Agarkar — Fri, 03 Mar 2017 10:14:18 -0600

This project contains scripts and tutorials on how to assemble individual microbial genomes from metagenomes, as described in:

Genome sequences of rare, uncultured bacteria obtained by differential coverage binning of multiple metagenomes

Mads Albertsen, Philip Hugenholtz, Adam Skarshewski, Gene W. Tyson, Kåre L. Nielsen and Per .H. Nielsen

Nature Biotechnology 2013, doi: 10.1038/nbt.2579

Address of the bookmark: https://github.com/MadsAlbertsen/multi-metagenome

GAPPadder: A Sensitive Approach for Closing Gaps on Draft Genomes with Short Sequence Reads

Jit — Mon, 14 May 2018 05:25:48 -0500

This software is provided ``as is” without warranty of any kind. In no event shall the author be held responsible for any damage resulting from the use of this software. The program package, including source codes, executables, and this documentation, is distributed free of charge. If you use this program in a publication, please cite the following reference:
Chong Chu, Xin Li, and Yufeng Wu. "GAPPadder: A Sensitive Approach for Closing Gaps on Draft Genomes with Short Sequence Reads." bioRxiv (2017): 125534.

Address of the bookmark: https://github.com/Reedwarbler/GAPPadder

Protocol for De novo Genome Assembly using Illumina Reads

BioStar — Sat, 16 Jan 2021 21:42:11 -0600

In this protocol, we address and describe the de novo assembly method for small to medium-sized genomes.

What is de novo genome assembly?
The method of taking a large number of short DNA sequences and placing them back together to create a reflection of the original chromosomes from which the DNA originated relates to genome assembly. No previous knowledge of the source DNA sequence length, structure or composition is inferred by De novo genome assemblies. The DNA of the target organism is split up into millions of tiny parts and read on a sequencing computer in a genome sequencing experiment. Depending on the sequencing system used, these "reads" range from 20 to 1000 nucleotide base pairs (bp) in length. Usually, length reads of 36 - 150 bp are produced for Illumina style short read sequencing. These reads can be either “single ended” as described above or “paired end.”

Why genome assembly?
In basic research into why and how they live, as well as in applied topics, identifying the DNA sequence of an organism is useful. Awareness of a DNA sequence may be useful in virtually any biological research because of the relevance of DNA to living things. For example, it may be used in medicine to classify, diagnose and eventually improve genetic disorder therapies. Similarly, pathogens study can lead to treatments for infectious diseases.

Raw NGS data
Reads can be saved as a Fasta file as text or in a FastQ file with their attributes. FastQ is the most common read file format since this is what the Illumina sequencing pipeline creates. This will henceforth be the subject of our conversation.

In a nutshell the protocol:
Get the sequence file(s) read from the sequencing machine (s).
Look at the readings - have an idea of what you have and what the standard is like.
If required, raw data cleanup/quality trimming.
Choose an adequate parameter set for assembly.
Assemble the data into scaffolds/contigs.
Examine the assembly performance and determine the efficiency of the assembly.

Read Quality Control:
Check the qualiy with fastQC.
Script
https://bioinformaticsonline.com/snippets/view/42540/install-fastqc-using-conda

Quality trimming/cleanup of read files.
This function trims adapters, barcodes and other contaminants from the reads.
Script
https://bioinformaticsonline.com/snippets/view/42542/trimmomatic-command

Genome Assembly:
The object of this portion of the protocol is to explain the method of assembling the reads trimmed by quality into draft contigs.

spades.py -1 illumina_R1.fastq.gz -2 illumina_R2.fastq.gz --careful --cov-cutoff auto -o result_of_spades_assembly_all_illumina

A significant range of short-read assemblers are available. Everyone with strengths and disadvantages of their own.
Some of the assemblers available include:
Velvet
SOAP-denovo
MIRA
ALLPATHS

Next step is to assess the suitability and what to do with a draft package of contiguous details for the remainder of the study now. Few stuff you can note about the contigs you just created: They're the draft Contigs. Any mis-assemblies can occur.

Mis-assembly checking and assembly metric tools:
QUAST - Quality assessment tool for genome assembly http://bioinf.spbau.ru/quast
Mauve assembly metrics - http://code.google.com/p/ngopt/wiki/How_To_Score_Genome_Assemblies_with_Mauve
InGAP-SV - https://sites.google.com/site/nextgengenomics/ingap and http://ingap.sourceforge.net/
inGAP is also useful for finding structural variants between genomes from read mappings.

Genome finishing tools:
Semi-automated gap fillers:
Gap filler - http://www.baseclear.com/landingpages/basetools-a-wide-range-of-bioinformatics-solutions/gapfiller/

IMAGE (V2) - http://sourceforge.net/apps/mediawiki/image2/index.php?title=Main_Page

Genome visualisers and editors:
Artemis - http://www.sanger.ac.uk/resources/software/artemis/
IGV - http://www.broadinstitute.org/igv/

Automated and semi automated annotation tools:
Prokka - https://github.com/tseemann/prokka
RAST - http://www.nmpdr.org/FIG/wiki/view.cgi/FIG/RapidAnnotationServer
JCVI Annotation Service - http://www.jcvi.org/cms/research/projects/annotation-service/

Frequent command use for the analysis are at:

https://bioinformaticsonline.com/blog/view/38765/list-of-tools-frequently-used-while-genome-assembly
https://bioinformaticsonline.com/pages/view/42275/frequent-parameters-for-bioinformatics-tools

Perl Special Vars Quick Reference

Abhimanyu Singh — Tue, 07 Feb 2017 05:08:47 -0600

`$_`	The default or implicit variable.
`@_`	Subroutine parameters.
`$a` `$b`	sort comparison routine variables.
`@ARGV`	The command-line args.
Regular Expressions
`$`	Regexp parenthetical capture holders.
`$&`	Last successful match (degrades performance).
`${^MATCH}`	Similar to `$&` without performance penalty. Requires /p modifier.
$`	Prematch for last successful match string (degrades performance).
`${^PREMATCH}`	Similar to $` without performance penalty. Requires `/p` modifier.
`$'`	Postmatch for last successful match string (degrades performance).
`${^POSTMATCH}`	Similar to `$'` without performance penalty. Requires `/p` modifier.
`$+`	Last paren match.
`$^N`	Last closed paren match (last submatch).
`@+`	Offsets of ends of successful submatches in scope.
`@-`	Offsets of starts of successful submatches in scope.
`%+`	Like `@+`, but for named submatches.
`%-`	Like `@-`, but for named submatches.
`$^R`	Last regexp (?{code}) result.
`${^RE_DEBUG_FLAGS}`	Current value of regexp debugging flags. See `use re 'debug';`
`${^RE_TRIE_MAXBUF}`	Control memory allocations for RE optimizations for large alternations.
Encoding
`${^ENCODING}`	The object reference to the Encode object, used to convert the source code to Unicode.
`${^OPEN}`	Internal use: \0 separated Input / Output layer information.
`${^UNICODE}`	Read-only Unicode settings.
`${^UTF8CACHE}`	State of the internal UTF-8 offset caching code.
`${^UTF8LOCALE}`	Indicates whether UTF8 locale was detected at startup.
IO and Separators
`$.`	Current line number (or record number) of most recent filehandle.
`$/`	Input record separator.
`$\|`	Output autoflush. 1=autoflush, 0=default. Applies to currently selected handle.
`$,`	Output field separator (lists)
`$\`	Output record separator.
`$"`	Output list separator. (interpolated lists)
`$;`	Subscript separator. (Use a real multidimensional array instead.)
Formats
`$%`	Page number for currently selected output channel.
`$=`	Current page length.
`$-`	Number of lines left on page.
`$~`	Format name.
`$^`	Name of top-of-page format.
`$:`	Format line break characters
`$^L`	Form feed (default "\f").
`$^A`	Format Accumulator
Status Reporting
`$?`	Child error. Status code of most recent system call or pipe.
`$!`	Operating System Error. (What just went 'bang'?)
`%!`	Error number hash
`$^E`	Extended Operating System Error (Extra error explanation).
`$@`	Eval error.
`${^CHILD_ERROR_NATIVE}`	Native status returned by the last pipe close, backtick (`` ) command, successful call to wait() or waitpid(), or from the system() operator.
ID's and Process Information
`$$`	Process ID
`$<`	Real user id of process.
`$>`	Effective user id of process.
`$(`	Real group id of process.
`$)`	Effective group id of process.
`$0`	Program name.
`$^O`	Operating System name.
Perl Status Info
`$]`	Old: Version and patch number of perl interpreter. Deprecated.
`$^C`	Current value of flag associated with -c switch.
`$^D`	Current value of debugging flags
`$^F`	Maximum system file descriptor.
`$^I`	Value of the -i (inplace edit) switch.
`$^M`	Emergency Memory pool.
`$^P`	Internal variable for debugging support.
`$^R`	Last regexp (?{code}) result.
`$^S`	Exceptions being caught. (eval)
`$^T`	Base time of program start.
`$^V`	Perl version.
`$^W`	Status of -w switch
`${^WARNING_BITS}`	Current set of warning checks enabled by `use warnings;`
`$^X`	Perl executable name.
`${^GLOBAL_PHASE}`	Current phase of the Perl interpreter.
`$^H`	Internal use only: Hook into Lexical Scoping.
`%^H`	Internaluse only: Useful to implement scoped pragmas.
`${^TAINT}`	Taint mode read-only flag.
`${^WIN32_SLOPPY_STAT}`	If true on Windows `stat()` won't try to open the file.
Command Line Args
`ARGV`	Filehandle iterates over files from command line (see also `<>`).
`$ARGV`	Name of current file when reading <>
`@ARGV`	List of command line args.
`ARGVOUT`	Output filehandle for -i switch
Miscellaneous
`@F`	Autosplit (-a mode) recipient.
`@INC`	List of library paths.
`%INC`	Keys are filenames, values are paths to modules included via `use, require,` or `do`.
`%ENV`	Hash containing current environment variables
`%SIG`	Signal handlers.
`$[`	Array and substr first element (Deprecated!).

See perlvar for detailed descriptions of each of these (and a few more) special variables.

kSNP3.0: SNP detection and phylogenetic analysis of genomes without genome alignment or reference genome

Jit — Fri, 08 Dec 2017 16:48:40 -0600

Sept. 20, 2017 Version 3.1 released. Major upgrade. Version 3.1 fixes the problems with SNP annotation that arose when NCBI discontinued use of GI numbers. Please read carefully the Preface (page 3) and the File of annotated genomes section (pages 9-10) in the version 3.1 User Guide. Thanks to Tom Slezak for revsing the get_genbank_file3 script and to Tod Stuber (USDA) for testing version 3.1 even though he doesn't need the annotation feature. All users are encouraged to upgrade to version 3.1.

Address of the bookmark: https://sourceforge.net/projects/ksnp/files/

ARC: pipeline which facilitates iterative, reference guided de novo assemblies

Jit — Thu, 26 Jul 2018 09:20:26 -0500

ARC is a pipeline which facilitates iterative, reference guided de novo assemblies with the intent of:

Reducing time in analysis and increasing accuracy of results by only considering those reads which should assemble together.
Reducing/removing reference bias as compared to mapping based approaches.

The software is designed to work in situations where a whole-genome assembly is not the objective, but rather when the researcher wishes to assemble discreet 'targets' contained within next-generation shotgun sequence data. ARC decomplexifies the traditionally difficult problem of assembly by breaking the reads into small, manageable subsets which can then be assembled quickly and efficiently in parallel. Applications include those in which the researcher wishes to de novo assemble specific content and a set of semi-similar reference targets is available to initialize the assembly process.

https://ibest.github.io/ARC/

Address of the bookmark: https://ibest.github.io/ARC/

D-GENIES: A tool for Dotplot large Genomes in an Interactive, Efficient and Simple way

Jit — Mon, 11 Jun 2018 09:41:22 -0500

D-GENIES – for Dotplot large Genomes in an Interactive, Efficient and Simple way – is an online tool designed to compare two genomes. It supports large genome and you can interact with the dot plot to improve the visualisation. We use minimap version 2 to align the two genomes. Then, the PAF file is parsed and plotted into an interactive plot written with d3.js library. D-Genies also allows to display dot plots from other aligners by uploading their PAF or MAF alignment file. http://dgenies.toulouse.inra.fr/

Address of the bookmark: http://dgenies.toulouse.inra.fr/

gVolante: Completeness Assessment of Genome/Transcriptome Sequences

Jit — Tue, 06 Aug 2019 21:37:56 -0500

gVolante provides an online interface for completeness assessment of user’s original or publicly available sequence datasets as well as for browsing results of completeness assessment performed on publicly available genome and transcriptome assemblies.

Address of the bookmark: https://gvolante.riken.jp/