BOL: Related items

Free Books on Machine Learning and Artificial Intelligent !

BioStar — Thu, 16 Mar 2023 00:10:24 -0500

An Introduction to Statistical Learning
This book provides a broad and less technical treatment of key topics in statistical learning. Each chapter includes an R lab. This book is appropriate for anyone who wishes to use contemporary tools for data analysis.

https://hastie.su.domains/ISLR2/ISLRv2_website.pdf

Python Data Science Handbook
You’ll learn how to use the core libraries essential for working with data in Python: particularly IPython, NumPy, Pandas, Matplotlib, Scikit-Learn, and related packages. This resource is perfect for tackling day-to-day issues such as cleaning, manipulating, and transforming data — or building machine learning models.

https://jakevdp.github.io/PythonDataScienceHandbook/

Dive into Deep Learning
Interactive deep learning book with code, math, and discussions. Implemented with PyTorch, NumPy/MXNet, JAX, and TensorFlow. Adopted at 400 universities from 60 countries

https://d2l.ai/

Approaching (Almost) Any Machine Learning Problem
This book is for people who have some theoretical knowledge of machine learning and deep learning and want to dive into applied machine learning. The book is more oriented towards how and what should you use to solve machine learning and deep learning problems. The book is for you if you are looking for guidance on approaching machine learning problems.

https://github.com/abhishekkrthakur/approachingalmost/blob/master/AAAMLP.pdf

Machine Learning for Genomics

Jit — Thu, 09 Sep 2021 11:26:32 -0500

Module 1: Statistics for genomics (2-8 August 2021)

A simple intro to statistical distributions
hypothesis testing
linear models.

reading: http://compgenomr.github.io/book/stats.html

slides: https://github.com/BIMSBbioinfo/compgen2021/tree/main/week1/compgen2021_stats.pdf

exercises+code: https://github.com/BIMSBbioinfo/compgen2021/tree/main/week1/

Module 2: Unsupervised learning for genomics (9-15 August 2021)

Understanding basic intuition behind machine learning approaches.
Using unsupervised learning to cluster and visualise data points
Dimension reduction techniques for visualisation and as input to clustering methods

reading: http://compgenomr.github.io/book/unsupervisedLearning.html

slides: https://github.com/BIMSBbioinfo/compgen2021/tree/main/week2/compgen2021_unsupervisedLearning.pdf

exercises+code: https://github.com/BIMSBbioinfo/compgen2021/tree/main/week2/

Module 3: Supervised learning for genomics (16-22 August 2021)

Understanding and using supervised learning methods for predictive purposes
How to measure prediction performance
Understand and use cross-validation and related concepts

reading: http://compgenomr.github.io/book/supervisedLearning.html

slides: https://github.com/BIMSBbioinfo/compgen2021/tree/main/week3/compgen2021_supervisedLearning.pdf

exercises+code: https://github.com/BIMSBbioinfo/compgen2021/tree/main/week3/

https://github.com/BIMSBbioinfo/compgen2021

Address of the bookmark: https://github.com/BIMSBbioinfo/compgen2021

A guide to machine learning for biologists

Abhi — Tue, 28 Dec 2021 01:43:25 -0600

Because of the increasing size and inherent complexity of biological data, there has been an increase in the application of machine learning in biology to create useful and predictive models of the underlying biological processes. All machine learning techniques fit models to data; nevertheless, the specific methods are highly variable and can appear baffling at first glance. In this Review, we hope to give readers a moderate introduction to a few fundamental machine learning techniques, including the most recently created and frequently used deep neural network techniques. We illustrate how different algorithms may be adapted to specific types of biological data, as well as some best practises and points to consider when embarking on machine learning studies. There is also discussion of several upcoming directions in machine learning methodology.

Address of the bookmark: https://www.nature.com/articles/s41580-021-00407-0

Detect the sequence pattern and its location in fasta file with match and mismatches information.

Jit — Thu, 26 Sep 2013 15:02:53 -0500

This script is one of my old script to detect some centromeric pattern in chromosomes. User can also control the number of mismatches allowed through command line ..

To run:

perl centro.pl

AI Uncovers Hidden Secrets in Bacterial DNA, Opening New Frontiers in Genomic Research

Jitendra Narayan — Fri, 25 Sep 2026 22:38:42 -0500

Scientists are now using artificial intelligence in order to examine sections of bacterial DNA that have not been looked at before. This method is showing potential RNA interactions and previously unknown genetic systems which could alter our understanding of microbes. A new study presents Minerva, a genome language model, demonstrating that AI can assist researchers in identifying biological patterns that traditional techniques might fail to detect.

The study, which was made available as a preprint on bioRxiv on 23 September 2026, focuses on the non-coding sections of DNA that are still largely unknown. Although these areas do not produce proteins, they can contain important signals and instructions which have an effect on cell function. The research presents a novel approach to investigating how bacteria handle and control their genetic information.

AI maps previously unexplored genomic regions

The team developed Minerva in order to identify possible interactions between different regions in microbial genomes; rather than depending on similarities with known sequences, Minerva predicts these relationships directly from the DNA by using patterns learned by a genome language model.

On 150 bacterial genomes, Minerva identified a large number of interactions that were not included in the existing annotations. The researchers stated that 84.3 per cent of the predicted intergenic base-pairing interactions were not present in the current annotations, which demonstrates that AI can be of help in generating new ideas in biology.

Unusual RNA structures and viral genetic systems identified

The study also examined a bacterial RNA family known as TwoAYGGAY in Pseudomonas; the model anticipated longer RNA structures and identified associations with repeated DNA sequences, thus providing new insights into how these non-coding elements are organised and how they have evolved.

In a separate section of the study, the researchers examined reverse transcriptase systems associated with bacteriophages, which are viruses that infect bacteria. They identified RNA arrays that maintain their structure but have different sequences and were linked to Unknown Group 27 reverse transcriptases. The findings indicate that these RNAs could function as templates for the production of complementary DNA that is capable of forming hairpin shapes.

The researchers also observed that Minerva was able to detect patterns associated with protein-coding areas, even though it had not been trained to do so. This indicates that genome language models may pick up on biological signals that go beyond what they were intended to identify.

Implications for future genomic research

The fact that artificial intelligence is becoming increasingly important in the field of microbial genomics is shown by the fact that models such as Minerva are able to predict interactions and identify patterns in areas which have not been extensively studied, thus helping researchers to decide what to study next and enabling them to gain a better understanding of biological systems that are still not well understood.

Yet the predictions do not reveal the exact function of each element identified. In order to verify which of the predicted interactions actually take place in living cells and the way in which they affect the microbes, experiments will be necessary. Although the study has undergone peer review, it does nonetheless offer a promising illustration of how machine learning can complement traditional genomics and assist scientists in moving from the identification of known genes to the exploration of the complex relationships that shape microbial life.

More at https://www.biorxiv.org/content/10.64898/2026.09.22.753630v2.full.pdf

scikit-learn

Jitendra Prajapati — Mon, 29 Feb 2016 17:39:24 -0600

Machine Learning in Python

Simple and efficient tools for data mining and data analysis
Accessible to everybody, and reusable in various contexts
Built on NumPy, SciPy, and matplotlib
Open source, commercially usable - BSD license

More at http://scikit-learn.org/stable/index.html

Address of the bookmark: http://scikit-learn.org/stable/auto_examples/index.html

R tuorial

Rahul Nayak — Mon, 31 Jul 2017 08:41:40 -0500

R learning resources

https://flowingdata.com/

Address of the bookmark: https://flowingdata.com/

Introduction to Bioinformatics and Computational Biology

Jit — Mon, 25 Jan 2021 01:32:30 -0600

This is the course material for STAT115/215 BIO/BST282 at Harvard University.

Xiaole Shirley Liu (lead instructor)
Joshua Starmer
Martin Hemberg
Ting Wang
Feng Yue

Ming Tang
Yang Liu
Jack Kang
Scarlett Ge
Jiazhen Rong
Phillip Nicol
Maartin De Vries

We thank many colleagues in the community, who helped Dr. Liu in prepare the STAT115/215 BIO/BST282 course over the years.

Address of the bookmark: https://liulab-dfci.github.io/bioinfo-combio/

Bioinformatics in Africa: Part6 - Sudan

BioStar — Sat, 06 Feb 2021 21:20:59 -0600

Commission for Biotechnology & Genetic Engineering Khartoum: The Commission for Biotechnology and Genetic Engineering was established in 9/2/1993 as research unit. In addition to research activities it acts as focal point for the International Center for Biotechnology and Genetic Engineering. The commission conducts researches in order to play a part in solving economical, environmental, health and nutritional problems using modern research techniques with an emphasis on the applied researches in these areas. The laboratories were well furnished with the essential equipments and the catalyst infrastructure to facilitate emergence of a successful for research. The Commission equipped with a computer center and information to serve as informatics and Digital library.

Research Interest and Activities: 1. Plant Genetic Transformations
2. Molecular Population Genetics 3. Detection of human and Animals diseases 4. Breast Cancerspecific protein marker 5. Phytochemical 6. Genomic map 7. Bioremediation 8. Tissue Culture.

Web site and links: www.geocity.cbge.com

Basic Structure of Snakemake Pipeline Run !

Abhi — Thu, 14 Oct 2021 07:01:38 -0500

/user/snakemake-demo$ ls

config.json data envs scripts slurm-240702.out Snakefile

data = mock data for the snakefile to use
Snakefile = name of the snakemake “formula” file
- Note: The default file that snakemake looks for in the current working directory is the Snakefile. If you would like to override that you can specify it following the -s
  - snakemake -s snakefile.py
envs = directory for storing the conda environments that the workflow will use.
scripts = directory for storing python scripts called by the snakemake formula.
config.json = json format file with extra parameters for our snakemake file to use.
cluster.json = json format file with specification for running on the HPC
samples.txt = file we will use later relating to the config.json file.

Run the snakemake file as a dry run (the example workflow shown above).

This will build a DAG of the jobs to be run without actually executing them.
snakemake --dry-run

User can execute rules of interest.

snakemake --dry-run all VS. snakemake --dry-run call VS. snakemake --dry-run bwa

Run the snakemake file in order to produce an image of the DAG of jobs to be run.

snakemake --dag | dot -Tsvg > dag.svg OR snakemake --dag | dot -Tsvg > dag.svg

Run the snakemake (this time not as a dry run)

snakemake --use-conda