More at https://boards.greenhouse.io/twistbioscience/jobs/3135495?gh_src=9ecc0b941us

Address of the bookmark: https://astrobiomike.github.io/

Reference@http://www.datasciencecentral.com/profiles/blogs/one-page-r-a-survival-guide-to-data-science-with-r

• Templates for the Data Scientist
  1. A Template for Preparing Data: *OnePageR - *R
  2. A Template for Building Models: *OnePageR - *R
• Getting Started as a Data Scientist
  1. Getting Started with R and Rattle: *Lecture - *Laboratory
  2. Introducing and Interacting with R: *Lecture - *Laboratory
  3. BasicR - OnePage(R) - Writing R scripts
• Dealing With Data
  1. Read Data into R: *OnePageR - *R
  2. Explore and Summarise Data: *OnePageR - *R
  3. Transform Data: *OnePageR - *R
  4. Dealing with Dates and Time: (PDF, R) Dates and Time
  5. Visualising Data with GGPlot2: *OnePageR - *R
  6. Visualising Data with Maps *OnePageR - *R
  7. Spatial (R) Spatial Analysis
  8. Handling Big Data *OnePageR - *R
• Descriptive Analytics
  1. Cluster Analysis: *Lecture - *OnePageR - *R
  2. Association Analysis: *Lecture
• Predictive Analytics
  1. Decision Trees: *Lecture - *OnePageR - *R - *Rattle
  2. Ensembles of Decision Trees: *Lecture - *OnePageR - *R
  3. SVM (R)
  4. KernLab (R)
  5. NeuralNetworks (R)
  6. NNet (R)
• Model Delivery
  1. Evaluating Models: *OnePageR - *R
  2. Evaluation (R)
  3. Scoring (R)
  4. PMML (R) Exporting Models for Deployment
• Advanced Topics
  1. Text Mining: *OnePageR - *R
• Advanced R Topics
  1. Plots (PDF, R) Miscellaneous Plots
  2. Functions (PDF, R) Writing Functions in R
  3. Parallel (PDF, R) Parallel Execution
  4. Packaging (R) Pulling it Together into a Package
  5. Doing R with Style: *OnePageR - *R
  6. Literate Data Mining with KnitR: *Lecture - *OnePageR - *

Address of the bookmark: http://cbb.sjtu.edu.cn/course/database/beginning.pdf

More at https://bioinformaticsonline.com/snippets/view/42919/perl-ipcopen2-module

2. exec””

 syntax: exec "command";

3. Backticks “ or qx//

syntax: `command`;

syntax: qx/command/;

4. IPC::Open3

syntax: $output = open3(\*CHLD_IN, \*CHLD_OUT, \*CHLD_ERR, 'command arg1 arg2', 'optarg',...);

It is very similar to IPC::Open2 with the capability to capture all three file handles of the process, i.e., STDIN, STDOUT, and STDERR. It can also be used with or without the shell. You can read about it more in the documentation: IPC::Open3.

$output = open3(my $o ut, my $in, 'command arg1 arg2');

OR without using the shell

$output = open3(my $out, my $in, 'command', 'arg1', 'arg2');

5.a2p

syntax: a2p [options] [awkscript]

There is a Perl utility known as a2p which translates awk command to Perl. It takes awk script as input and generates a comparable Perl script as the output. Suppose, you want to execute the following awk statement

awk '{$1 = ""; $2 = ""; print}' f1.txt

This statement gives error sometimes even after escaping the variables (\$1, \$2) but by using a2p it can be easily converted to Perl script:

For further information, you can read it’s documentation: a2p

More help at https://bioinformaticsonline.com/snippets/view/42920/perl-script-to-run-awk-inside-perl

6. system()

syntax: system( "command" );

It is also a Perl function (perlfunc) that executes a command and waits for it to get finished first and then resume the Perl script. The return value is the exit status of the command. It can be called in two ways:

system( "command arg1 arg2" );

OR

system( "command", "arg1", "arg2" );

HELP

Here are some useful Perl cheat sheets that can be used as a quick reference guide.-- https://www.pcwdld.com/perl-cheat-sheet

• -e Makes the line of code be executed instead of a script
• -n Forces your line to be called in a loop. Allows you to take lines from the diamond operator (or stdin)
• -p Forces your line to be called in a loop. Prints $_ at the end

• This counts the number of quotation marks in each line and prints it

  perl -ne '$cnt = tr/"//;print "$cnt\n"' inputFileName.txt

• Adds string to each line, followed by tab

  perl -pe 's/(.*)/string\t$1/' inFile > outFile

• Append a new line to each line

  perl -pe 's//\n/' all.sent.classOnly > all.sent.classOnly.sep

• Replace all occurrences of pattern1 (e.g. [0-9]) with pattern2

  perl -p -i.bak -w -e 's/pattern1/pattern2/g' inputFile

• Go through file and only print words that do not have any uppercase letters.

  perl -ne 'print unless m/[A-Z]/' allWords.txt > allWordsOnlyLowercase.txt

• Go through file, split line at each space and print words one per line.

  perl -ne 'print join("\n", split(/ /,$_));print("\n")' someText.txt > wordsPerLine.txt

• or in other words, delete every character that is not a letter, white space or line end (replace with nothing)

  perl -pne 's/[^a-zA-Z\s]*//g' text_withSpecial.txt > text_lettersOnly.txt

• perl -pne 'tr/[A-Z]/[a-z]/' textWithUpperCase.txt > textwithoutuppercase.txt;

• Print only the second column of the data when using tabular as a separator

  perl -ne '@F = split("\t", $_); print "$F[1]";' columnFileWithTabs.txt > justSecondColumn.txt

• One-Liner: Sort lines by their length

  perl -e 'print sort {length $a <=> length $b} <>' textFile

• One-Liner: Print second column, unless it contains a number

  perl">perl -lane 'print $F[1] unless $F[1] =~ m/[0-9]/' wordCounts.txt

Originally design to map the location of objects in a 10 km map IrishGrid includes:

• native support of the Irish Grid System (see http://www.osi.ie/)
• optimize for speed (there's as less as possible data to conversion)
• customized color functions

https://code.google.com/p/irishgrid/downloads/detail?name=irishgrid.pl

Address of the bookmark: https://code.google.com/p/irishgrid/

It is possible to create a vector by typing data directly into R using the combine function ‘c’

x

same as

x

creates the vector x with the numbers between 1 and 5.

You can see what is in an object at any time by typing its name;

x

will produce the output ‘[1] 1 2 3 4 5′

Note that names need to be quoted

daysofweek ← c(‘Monday’, ‘Tuesday’, ‘Wednesday’, ‘Thursday’, ‘Friday’);

Usually however you want to input from a file. We have touched on the ‘read.table’ function already.

mydata

Now mydata is a data frame with multiple vectors

each vector can be identified by the default syntax

#if any of these are typed it will print to screen

mydata$V1 mydata$V2 mydata$V3

By default the function assumes certain things from the file

• The file is a plain text file (there are function to read excel files: not covered here)
• columns are separated by any number of tabs or spaces
• there is the same number of data points in each column
• there is no header row (labels for the columns)
• there is no column with names for the rows** [I’ll explain].

If any of these are false, we need to tell that to the function

If it has a header column

mydata header=T also works

Note that there is a comma between different parts of the functions arguments

If there is one less column in the header row, then R assumes that the 1^st column of data after the header are the row names

Now the vectors (columns) are identified by their name

#if any of these are typed it will print to screen

mydata$A mydata$B mydata$C

# Summary about the whole data frame

summary(mydata)

# Summary information of column A

summary(mydata$A)

We can shortcut having to type the data frame each time by attaching it

attach(mydata)

# summary of column B as ‘mydata’ is attached

summary(B)

Two other important options for read.table

If is is separated only by tabs and has a header

mydata

Really useful if you have spaces in the contents of some columns, so R does not mess up reading the columns . However if the columns or of an uneven length it will tell you.

If you know that the file has uneven columns

mydata

This causes R to fill empty spaces in a columns with ‘NA’ .

The last two examples will still work with our file and give the same result as with only headers=T

Graphs

to get an idea of what R is capable of type

demo(graphics)

steps through the examples, and the code is printed to the screen

We will work with simpler examples that have immediate use to biologists.

Remember to get more information about the options to a function type ‘?function’

Histogram of A

hist(mydata$A)

If there was more data we could increase the number of vertical columns with the option, breaks=50 (or another relevant number).

boxplot(mydata)

We can get rid of the need to type the data frame each time by using the attach function

# if not already done so

attach(mydata)

boxplot(mydata$A, mydata$B, name=c(“Value A”, “Value B”) , ylab=“Count of Something”)

same as

boxplot(A, B, name=c(“Value A”, “Value B”) , ylab=“Count of Something”)

Scatter plot

# if not already done so

attach(mydata)

plot(A,B) # or plot(mydata$A, mydata$B)

SAVING an image

Windows users (Rgui) RIGHT click on image and select which you want.

These instructions work for everyone.

You need to create a new device of the type of file you need, then send the data to that device

to save as a png file (easy to load into the likes of powerpoint, also great for web applications.

png(‘filename’)

boxplot(A, B, name=c(“Value A”, “Value B”) , ylab=“Count of Something”)

or to save as a pdf

pdf(‘filename’)

boxplot(A, B, name=c(“Value A”, “Value B”) , ylab=“Count of Something”)

Note

• Nothing will appear on screen, the output is going to the file
• Also it may not be saved immediately but will once the device (or R) is turned quit.

To quit R type

q() # If you save your session, next time you start R, you will have your data preloaded.

Or if you want to remain in R

dev.off() #turns of the png (or pdf etc) device, thus forces the data to save

The OpenCPU JavaScript client library provides the most seamless integration of R and JavaScript available today.

OpenCPU uses standard R packaging to develop, ship and deploy web applications. Several open source example apps are available from Github.

Installing your own OpenCPU server is super easy and only takes a few minutes.

More at https://www.opencpu.org/