The next-generation sequencing included whole genome sequencing(WGS), transcriptome sequencing (whole cDNA sequencing, RNA-seq), digital gene expression sequencing (Tag-Seq), ChIP-Seq, and so on. And there are many sequencing platform to generate sequece, as well know Sanger/ABi(the frist generation), Solexa/illumina, SOLiD/ABi, 454/Roche. But thier sequence format is different, also they have different error type. High quality data is very important for further analysis or data mining. There are many pipeline for raw sequence quality analysis and control with few of process for reporting reads quality statistical details, trimming, filtering, and error correction. Please bookmarks them for the benefits of bioinformatics community.

https://code.google.com/p/biowiki/

https://code.google.com/p/ngs-pipeline/source/browse/#svn%2Ftrunk

NGSand Perl scripts https://code.google.com/hosting/search?q=NGS+perl&projectsearch=Search+projects

NGS and Python scripts https://code.google.com/hosting/search?q=NGS+Python&projectsearch=Search+projects

Address of the bookmark: https://code.google.com/hosting/search?q=bioinformatics&sa=Search

You see, for the past couple of years, I’ve been a bit frustrated because OS X does not come with a whole lot of Perl modules pre-installed, and for all I googled, I couldn’t find an “idiot’s” guide for moderately-savvy-but-not-expert users like myself to install modules and dependencies on demand.

The only instructions I could find point to Fink, which basically installs modules in a path that isn’t included in the Perl @INC variable, meaning you have to manually specify the full path to the modules in every script — which is not a lot of fun if you’re developing on OS X and deploying on Red Hat, for instance.

Moreover, Fink doesn’t seem to make every module available, and it’s not very easy to determine which Fink package you need to install if you need a particular module.

So, with a script that called on several apparently unavailable modules, and a deadline looming, I finally decided to suck it up and figure out how to use CPAN to install them:

1) Make sure you have the Apple Developer Tools (XCode) installed.

These are on one of your install discs, or available as a huge but free download from the Apple Developer Connection [free registration required] or the Mac App Store. I thought I had them, but apparently when we upgraded that computer to Tiger, they went missing.

If you don’t have this stuff installed, your installation will fail with errors about unavailable commands.

1.5) Install Command Line Tools (Recent XCode versions only)

(Thank you to Tom Marchioro for informing me about this step.)

Older versions of XCode installed the command line tools (which are required to properly install CPAN modules) by default, but apparently newer ones do not. To check whether you have the command line tools already installed, run the following from the Terminal:

$ which make

This command checks the system for the “make” tool. If it spits out something like /usr/bin/make you’re golden and can skip ahead to Step 2. If you just get a new prompt and no output, you’ll need to install the tools:

1. Launch XCode and bring up the Preferences panel.
2. Click on the Downloads tab
3. Click to install the Command Line Tools

If you like, you can run which make again to confirm that everything’s installed correctly.

2) Configure CPAN.

$ sudo perl -MCPAN -e shell

perl> o conf init

This will prompt you for some settings. You can accept the defaults for almost everything (just hit “return”). The two things you must fill in are the path to make (which should be /usr/bin/make or the value returned when you run which make from the command line) and your choice of CPAN mirrors (which you actually choose don’t really matter, but it won’t let you finish until you select at least one). If you use a proxy or a very restrictive firewall, you may have to configure those settings as well.

If you skip Step 2, you may get errors about make being unavailable.

3) Upgrade CPAN

$ sudo perl -MCPAN -e 'install Bundle::CPAN'

Don’t forget the sudo, or it’ll fail with permissions errors, probably when doing something relatively unimportant like installing man files.

This will spend a long time downloading, testing, and compiling various files and dependencies. Bear with it. It will prompt you a few times about dependencies. You probably want to enter “yes”. I agreed to everything it asked me, and everything turned out fine. YMMV of course. If everything installs properly, it’ll give you an “OK” at the end.

4) Install your modules. For each module….

$ sudo perl -MCPAN -e 'install Bundle::Name'

or

$ sudo perl -MCPAN -e 'install Module::Name'

This will install the module and its dependencies. Nice, eh? Again, don’t forget the sudo.

The first time you run this after upgrading CPAN, it may prompt you to configure again (see Step 2). If you accept its offer to try to configure itself automatically, it may just run through everything without a problem.

There are a couple of potential pitfalls with specific modules (such as theLWP::UserAgent / HEAD issue), but most have workarounds, and I haven’t run into anything that wasn’t easily recoverable.

And that’s it!

Did you find this useful? Is there anything I missed?

Perl script for creating a publication-ready vectorial genetic/linkage map in Scalable Vector Graphics (SVG) format. The resulting file can either be submitted for publication and edited with any vectorial drawing software like Inkscape and Abobe Illustrator(R).

The input file must be a text file with at least the marker name (ID), linkage group (LG) and the position (POS) separeted by tabulations. Additionally a logarithm of odds (LOD score) can be provided. Any extra parameter will be ignored.

map.tsv

ID<tab>LG<tab>POS<tab>LOD
13519  12     0       0.250840894
2718   12     1.0     0.250840893
11040  12     1.6     0.252843341
...

https://github.com/pseudogene/genetic-mapper

Address of the bookmark: https://github.com/pseudogene/genetic-mapper

Perl's second wave of adoption came from the growth of the world wide web. Dynamic web pages—the precursor to modern web applications—were easy to create with Perl and CGI. Thanks to Perl's ubiquity as a language for system administrators and its power to manipulate text, it was the default choice for web programming. Its presence everywhere made it popular and, in some ways, the duct tape of the Internet.

Web Application Development

The old days of CGI programs and the simple development style that represented seem clunky. Web pages have become web applications. Development has moved from generating static HTML to both client and server side programming, with rich client interfaces and powerful backends.

Perl is still well suited for developing modern web apps. The language grows more powerful and easier to use every year, the available libraries are wonderful and keep getting better, and the inventions and discoveries available in modern Perl are unsurpassed.

In particular, a modern Perl developer can do amazing things with modern Perl tools. If you still think of Perl web development as a cgi-bin directory full of messy scripts that spew warnings to STDERR, you're a decade out of date. Better yet, you can replace that mess piecemeal, thanks to the new tools and techniques of modern Perl. See, for example, the ever-growing list of technologies Built in Perl.

Modern Perl Web Frameworks

While the old wave of web development may have made the CGI.pm module central, modern Perl web programming follows a stricter separation of business logic, URL and request routing, and output. The days of slinging a string here, an array there, a Perl hash yonder, declaring every variable at the top of the program, and maybe making a subroutine are gone. The Perl world has seen the value of abstraction and ways to mechanize away boilerplate. Perl has dozens of frameworks and toolkits designed to make web development and deployment simpler.

Any of a dozen of these frameworks will help you do great things, but three in particular stand out. You can build web sites and web applications of tremendous value with all three. These are neither the only good possibilities (think of POE or Jifty or Continuity or...) nor the only mechanisms for web programming with Perl (see Mechanize or LWP or Mojo::UserAgent for more). Yet if you want three good options to choose between, start here.

Catalyst

The Catalyst framework is a flexible and powerful system for building small to large web apps. It uses the Moose object system to provide great APIs for extension and further development. It's the most mature of the modern top Perl web frameworks, yet it retains its flexibility and vibrancy. In particular, its plugin and extension ecosystem allows it to evolve to provide new and essential features.

Catalyst has embraced the Plack/PSGI standard for Perl web deployment and recent versions are exploring high-scalability, event-based request handling models.

Dancer

The Dancer framework is deliberately minimal in syntax and scope, but it also has a vibrant plugin ecosystem. Dancer particularly excels for smaller sites and applications, though good programmers can build larger things with it.

The first version of Dancer was easy to use. Dancer 2 continues that ease while improving the internals and robustness of applications.

Mojolicious

The Mojolicious (Mojo) framework has a real-time design based on high performance event handling. Its focus is solving new and interesting problems in simple and effective ways, and the project has produced a lot of new code that does old things in better ways.

In particular, Mojolicious goes to great lengths to support new web standards, such as CSS 3, web sockets, and HTTP 2.

Where Catalyst embraces the CPAN fully, Mojolicious by design provides most of what an average app might need in a single download. It's still fully compatible with the CPAN, but the intention is to provide good working defaults in a package that's easy to start with. Mojo's fans are quick to praise it as fun to develop.

A modern Perl web developer should be familiar with at least one of these frameworks.

Modern Perl Storage Mechanisms

Perl's venerable DBI module has been the focal point of database access since its invention. Its design allows it to provide the same interface to huge relational databases and flat files alike through its DBD extension mechanism. Yet the DBI by itself isn't the be-all, end-all of data storage and access in Perl.

DBIx::Class

DBIx::Class sits on top of DBI to provide an API to your database based on the concept of queries and results. This is often sufficient to remove all but the most complicated of SQL from your code, leaving you to manipulate your business models instead of the small details of how a relational database works. The power and maintainability you receive is well the small cost of the learning curve.

Even better, DBIC can manage (and even generate) your database schema for you.

Recent versions of DBIC have demonstrated that a well-written ORM can perform much better than even clever hand-written code. Because it builds on the Perl DBI, it scales everywhere from SQLite to PostgreSQL, MySQL, Oracle, and more.

Rose::DB

The lesser-known but no less powerful Rose::DB::Object builds on Rose::DB to provide an object-relational mapper for Perl. While its high level features most directly compare to those of DBIx::Class, it's often measurably faster.

NoSQL on the CPAN

Of course the CPAN has modules for almost any NoSQL database or job queue or persistence mechanism you could name, and several you have never heard of. Everything you need is a quick CPAN or cpanm away!

Modern Perl Deployment Strategies

In the early days of the web, deploying a Perl web application meant putting one or more .cgi or .pl files in a special directory and hoping that your system administrator had everything configured correctly. The execution model was often slow and cumbersome, and accessing shared resources such as databases was often tricky.

Modern Perl has better choices. While deployment strategies are the source of many arguments, the return on your investment from learning the modern way is impressive.

Plack/PSGI

The PSGI specification (as exemplified by Plack) describes a strategy for building Perl web apps independent of server and with the possibility to share custom processing behaviors.

In other words, it's a standard for writing Perl apps to take advantage of the huge ecosystem of Perl development available on the CPAN without tying yourself to a server like Apache, Apache 2, nginx, or anything else.

Any good modern Perl web framework (including those listed here) supports PSGI. Several deployment mechanisms exist to meet various business needs which also support PSGI. In particular, you can deploy the same application with a local testing server on your own machine as you can to your production server or servers without changing your application at all.

mod_perl

The older but still viable mod_perl Apache httpd module embeds Perl into the web server. This was the first widespread persistence mechanism for Perl web applications themselves and it's still popular to this day, though PSGI compliance is often the choice for new development. (PSGI handlers to use mod_perl as the backend are available.)

Modern Perl developers should familiarize themselves with PSGI and the wealth of available Plack middleware.

Perl Web Development

Of course no discussion of Perl web development would be complete without mentioning the strength of the CPAN. Almost any project will benefit from the wealth of freely available libraries built to solve real problems. These distributions run the gamut from full-blown web frameworks and content management systems to APIs for web services, development tools, testing systems, and interfaces to document formats and external resources.

For example, if you need to write a web service which accepts JSON data and produces Excel spreadsheets, you can glue together a few CPAN distributions and get the job done early. If you need to consume XML from a remote service and emit a PDF, you're in luck.

Perl's prowess as a general purpose programming language as well as its flexibility and power in managing text and gluing systems together make it a wonderful fit for web development. The community's adoption of modern Perl standards such as PSGI and Plack only enhance your power.

Web application development in Perl is still viable, and modern Perl tools and techniques and libraries make it more powerful and pleasant than ever.

More about the basic perl module installation steps check this http://bioinformaticsonline.com/blog/view/710/how-to-install-perl-modules-manually-using-cpan-command-and-other-quick-ways

installing Bio::SCF perl module is daunting task, specieally because of it dependencies. Here is the steps, you need to follow to sucessfully install Bio::SCF module

#sudo apt-get install libbio-scf-perl #trev for visualization of scf file

1. You will need the zlib library which can be found at http://www.zlib.net/.

install zlib library first:

jitendra@jitendra-UNLOCK-INSTALL[zlib-1.2.11] ./configure []
Checking for gcc...
Checking for shared library support...
Building shared library libz.so.1.2.11 with gcc.
Checking for size_t... Yes.
Checking for off64_t... Yes.
Checking for fseeko... Yes.
Checking for strerror... Yes.
Checking for unistd.h... Yes.
Checking for stdarg.h... Yes.
Checking whether to use vs[n]printf() or s[n]printf()... using vs[n]printf().
Checking for vsnprintf() in stdio.h... Yes.
Checking for return value of vsnprintf()... Yes.
Checking for attribute(visibility) support... Yes.
jitendra@jitendra-UNLOCK-INSTALL[zlib-1.2.11] make []
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -I. -c -o example.o test/example.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o adler32.o adler32.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o crc32.o crc32.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o deflate.o deflate.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o infback.o infback.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o inffast.o inffast.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o inflate.o inflate.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o inftrees.o inftrees.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o trees.o trees.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o zutil.o zutil.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o compress.o compress.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o uncompr.o uncompr.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o gzclose.o gzclose.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o gzlib.o gzlib.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o gzread.o gzread.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -c -o gzwrite.o gzwrite.c
ar rc libz.a adler32.o crc32.o deflate.o infback.o inffast.o inflate.o inftrees.o trees.o zutil.o compress.o uncompr.o gzclose.o gzlib.o gzread.o gzwrite.o
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o example example.o -L. libz.a
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -I. -c -o minigzip.o test/minigzip.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o minigzip minigzip.o -L. libz.a
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/adler32.o adler32.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/crc32.o crc32.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/deflate.o deflate.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/infback.o infback.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/inffast.o inffast.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/inflate.o inflate.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/inftrees.o inftrees.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/trees.o trees.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/zutil.o zutil.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/compress.o compress.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/uncompr.o uncompr.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/gzclose.o gzclose.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/gzlib.o gzlib.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/gzread.o gzread.c
gcc -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -DPIC -c -o objs/gzwrite.o gzwrite.c
gcc -shared -Wl,-soname,libz.so.1,--version-script,zlib.map -O3 -fPIC -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o libz.so.1.2.11 adler32.lo crc32.lo deflate.lo infback.lo inffast.lo inflate.lo inftrees.lo trees.lo zutil.lo compress.lo uncompr.lo gzclose.lo gzlib.lo gzread.lo gzwrite.lo -lc
rm -f libz.so libz.so.1
ln -s libz.so.1.2.11 libz.so
ln -s libz.so.1.2.11 libz.so.1
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o examplesh example.o -L. libz.so.1.2.11
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o minigzipsh minigzip.o -L. libz.so.1.2.11
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -I. -D_FILE_OFFSET_BITS=64 -c -o example64.o test/example.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o example64 example64.o -L. libz.a
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -I. -D_FILE_OFFSET_BITS=64 -c -o minigzip64.o test/minigzip.c
gcc -O3 -D_LARGEFILE64_SOURCE=1 -DHAVE_HIDDEN -o minigzip64 minigzip64.o -L. libz.a
jitendra@jitendra-UNLOCK-INSTALL[zlib-1.2.11] sudo make install []
[sudo] password for jitendra:
rm -f /usr/local/lib/libz.a
cp libz.a /usr/local/lib
chmod 644 /usr/local/lib/libz.a
cp libz.so.1.2.11 /usr/local/lib
chmod 755 /usr/local/lib/libz.so.1.2.11
rm -f /usr/local/share/man/man3/zlib.3
cp zlib.3 /usr/local/share/man/man3
chmod 644 /usr/local/share/man/man3/zlib.3
rm -f /usr/local/lib/pkgconfig/zlib.pc
cp zlib.pc /usr/local/lib/pkgconfig
chmod 644 /usr/local/lib/pkgconfig/zlib.pc
rm -f /usr/local/include/zlib.h /usr/local/include/zconf.h
cp zlib.h zconf.h /usr/local/include
chmod 644 /usr/local/include/zlib.h /usr/local/include/zconf.h
 

2. Now make io_lib-1.9

In order to install this perl extension you have to install io-lib version 1.9 or higher from the Staden library (staden.sourceforge.net). This can be downloaded from https://sourceforge.net/project/showfiles.php?group_id=100316&package_id=108243&release_id=340318 confirm that the package installed correctly look for a library named "libread".

jitendra@jitendra-UNLOCK-INSTALL[io_lib-1.9.0] export CFLAGS="-fPIC" && ./configure
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking for C compiler default output file name... a.out
checking whether the C compiler works... yes
checking whether we are cross compiling... no
checking for suffix of executables...
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ANSI C... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking for a BSD-compatible install... /usr/bin/install -c
checking for ranlib... ranlib
checking for main in -lz... yes
checking how to run the C preprocessor... gcc -E
checking for egrep... grep -E
checking for ANSI C header files... yes
checking for sys/wait.h that is POSIX.1 compatible... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking fcntl.h usability... yes
checking fcntl.h presence... yes
checking for fcntl.h... yes
checking limits.h usability... yes
checking limits.h presence... yes
checking for limits.h... yes
checking for unistd.h... (cached) yes
checking zlib.h usability... yes
checking zlib.h presence... yes
checking for zlib.h... yes
checking whether byte ordering is bigendian... no
checking for short... yes
checking size of short... 2
checking for int... yes
checking size of int... 4
checking for long... yes
checking size of long... 8
checking for inline... inline
checking for mode_t... yes
checking build system type... x86_64-unknown-linux-gnu
checking host system type... x86_64-unknown-linux-gnu
checking for cos in -lm... yes
checking for strdup... yes
configure: creating ./config.status
config.status: creating Makefile
config.status: creating read/Makefile
config.status: creating progs/Makefile
config.status: creating config.h
config.status: executing depfiles commands
jitendra@jitendra-UNLOCK-INSTALL[io_lib-1.9.0] make []
make all-recursive
make[1]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0'
Making all in read
make[2]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0/read'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT Read.o -MD -MP -MF ".deps/Read.Tpo" -c -o Read.o Read.c; \
then mv -f ".deps/Read.Tpo" ".deps/Read.Po"; else rm -f ".deps/Read.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT scf_extras.o -MD -MP -MF ".deps/scf_extras.Tpo" -c -o scf_extras.o scf_extras.c; \
then mv -f ".deps/scf_extras.Tpo" ".deps/scf_extras.Po"; else rm -f ".deps/scf_extras.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT translate.o -MD -MP -MF ".deps/translate.Tpo" -c -o translate.o translate.c; \
then mv -f ".deps/translate.Tpo" ".deps/translate.Po"; else rm -f ".deps/translate.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT compression.o -MD -MP -MF ".deps/compression.Tpo" -c -o compression.o `test -f '../ztr/compression.c' || echo './'`../ztr/compression.c; \
then mv -f ".deps/compression.Tpo" ".deps/compression.Po"; else rm -f ".deps/compression.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT ztr.o -MD -MP -MF ".deps/ztr.Tpo" -c -o ztr.o `test -f '../ztr/ztr.c' || echo './'`../ztr/ztr.c; \
then mv -f ".deps/ztr.Tpo" ".deps/ztr.Po"; else rm -f ".deps/ztr.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT ztr_translate.o -MD -MP -MF ".deps/ztr_translate.Tpo" -c -o ztr_translate.o `test -f '../ztr/ztr_translate.c' || echo './'`../ztr/ztr_translate.c; \
then mv -f ".deps/ztr_translate.Tpo" ".deps/ztr_translate.Po"; else rm -f ".deps/ztr_translate.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT fpoint.o -MD -MP -MF ".deps/fpoint.Tpo" -c -o fpoint.o `test -f '../abi/fpoint.c' || echo './'`../abi/fpoint.c; \
then mv -f ".deps/fpoint.Tpo" ".deps/fpoint.Po"; else rm -f ".deps/fpoint.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT seqIOABI.o -MD -MP -MF ".deps/seqIOABI.Tpo" -c -o seqIOABI.o `test -f '../abi/seqIOABI.c' || echo './'`../abi/seqIOABI.c; \
then mv -f ".deps/seqIOABI.Tpo" ".deps/seqIOABI.Po"; else rm -f ".deps/seqIOABI.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT seqIOALF.o -MD -MP -MF ".deps/seqIOALF.Tpo" -c -o seqIOALF.o `test -f '../alf/seqIOALF.c' || echo './'`../alf/seqIOALF.c; \
then mv -f ".deps/seqIOALF.Tpo" ".deps/seqIOALF.Po"; else rm -f ".deps/seqIOALF.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT ctfCompress.o -MD -MP -MF ".deps/ctfCompress.Tpo" -c -o ctfCompress.o `test -f '../ctf/ctfCompress.c' || echo './'`../ctf/ctfCompress.c; \
then mv -f ".deps/ctfCompress.Tpo" ".deps/ctfCompress.Po"; else rm -f ".deps/ctfCompress.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT seqIOCTF.o -MD -MP -MF ".deps/seqIOCTF.Tpo" -c -o seqIOCTF.o `test -f '../ctf/seqIOCTF.c' || echo './'`../ctf/seqIOCTF.c; \
then mv -f ".deps/seqIOCTF.Tpo" ".deps/seqIOCTF.Po"; else rm -f ".deps/seqIOCTF.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT expFileIO.o -MD -MP -MF ".deps/expFileIO.Tpo" -c -o expFileIO.o `test -f '../exp_file/expFileIO.c' || echo './'`../exp_file/expFileIO.c; \
then mv -f ".deps/expFileIO.Tpo" ".deps/expFileIO.Po"; else rm -f ".deps/expFileIO.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT seqIOPlain.o -MD -MP -MF ".deps/seqIOPlain.Tpo" -c -o seqIOPlain.o `test -f '../plain/seqIOPlain.c' || echo './'`../plain/seqIOPlain.c; \
then mv -f ".deps/seqIOPlain.Tpo" ".deps/seqIOPlain.Po"; else rm -f ".deps/seqIOPlain.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT misc_scf.o -MD -MP -MF ".deps/misc_scf.Tpo" -c -o misc_scf.o `test -f '../scf/misc_scf.c' || echo './'`../scf/misc_scf.c; \
then mv -f ".deps/misc_scf.Tpo" ".deps/misc_scf.Po"; else rm -f ".deps/misc_scf.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT read_scf.o -MD -MP -MF ".deps/read_scf.Tpo" -c -o read_scf.o `test -f '../scf/read_scf.c' || echo './'`../scf/read_scf.c; \
then mv -f ".deps/read_scf.Tpo" ".deps/read_scf.Po"; else rm -f ".deps/read_scf.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT write_scf.o -MD -MP -MF ".deps/write_scf.Tpo" -c -o write_scf.o `test -f '../scf/write_scf.c' || echo './'`../scf/write_scf.c; \
then mv -f ".deps/write_scf.Tpo" ".deps/write_scf.Po"; else rm -f ".deps/write_scf.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT array.o -MD -MP -MF ".deps/array.Tpo" -c -o array.o `test -f '../utils/array.c' || echo './'`../utils/array.c; \
then mv -f ".deps/array.Tpo" ".deps/array.Po"; else rm -f ".deps/array.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT compress.o -MD -MP -MF ".deps/compress.Tpo" -c -o compress.o `test -f '../utils/compress.c' || echo './'`../utils/compress.c; \
then mv -f ".deps/compress.Tpo" ".deps/compress.Po"; else rm -f ".deps/compress.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT error.o -MD -MP -MF ".deps/error.Tpo" -c -o error.o `test -f '../utils/error.c' || echo './'`../utils/error.c; \
then mv -f ".deps/error.Tpo" ".deps/error.Po"; else rm -f ".deps/error.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT files.o -MD -MP -MF ".deps/files.Tpo" -c -o files.o `test -f '../utils/files.c' || echo './'`../utils/files.c; \
then mv -f ".deps/files.Tpo" ".deps/files.Po"; else rm -f ".deps/files.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT find.o -MD -MP -MF ".deps/find.Tpo" -c -o find.o `test -f '../utils/find.c' || echo './'`../utils/find.c; \
then mv -f ".deps/find.Tpo" ".deps/find.Po"; else rm -f ".deps/find.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT mach-io.o -MD -MP -MF ".deps/mach-io.Tpo" -c -o mach-io.o `test -f '../utils/mach-io.c' || echo './'`../utils/mach-io.c; \
then mv -f ".deps/mach-io.Tpo" ".deps/mach-io.Po"; else rm -f ".deps/mach-io.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT open_trace_file.o -MD -MP -MF ".deps/open_trace_file.Tpo" -c -o open_trace_file.o `test -f '../utils/open_trace_file.c' || echo './'`../utils/open_trace_file.c; \
then mv -f ".deps/open_trace_file.Tpo" ".deps/open_trace_file.Po"; else rm -f ".deps/open_trace_file.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT read_alloc.o -MD -MP -MF ".deps/read_alloc.Tpo" -c -o read_alloc.o `test -f '../utils/read_alloc.c' || echo './'`../utils/read_alloc.c; \
then mv -f ".deps/read_alloc.Tpo" ".deps/read_alloc.Po"; else rm -f ".deps/read_alloc.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT strings.o -MD -MP -MF ".deps/strings.Tpo" -c -o strings.o `test -f '../utils/strings.c' || echo './'`../utils/strings.c; \
then mv -f ".deps/strings.Tpo" ".deps/strings.Po"; else rm -f ".deps/strings.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT traceType.o -MD -MP -MF ".deps/traceType.Tpo" -c -o traceType.o `test -f '../utils/traceType.c' || echo './'`../utils/traceType.c; \
then mv -f ".deps/traceType.Tpo" ".deps/traceType.Po"; else rm -f ".deps/traceType.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT xalloc.o -MD -MP -MF ".deps/xalloc.Tpo" -c -o xalloc.o `test -f '../utils/xalloc.c' || echo './'`../utils/xalloc.c; \
then mv -f ".deps/xalloc.Tpo" ".deps/xalloc.Po"; else rm -f ".deps/xalloc.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT vlen.o -MD -MP -MF ".deps/vlen.Tpo" -c -o vlen.o `test -f '../utils/vlen.c' || echo './'`../utils/vlen.c; \
then mv -f ".deps/vlen.Tpo" ".deps/vlen.Po"; else rm -f ".deps/vlen.Tpo"; exit 1; fi
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT hash_table.o -MD -MP -MF ".deps/hash_table.Tpo" -c -o hash_table.o `test -f '../utils/hash_table.c' || echo './'`../utils/hash_table.c; \
then mv -f ".deps/hash_table.Tpo" ".deps/hash_table.Po"; else rm -f ".deps/hash_table.Tpo"; exit 1; fi
../utils/hash_table.c: In function ‘HashFileOpen’:
../utils/hash_table.c:920:21: warning: field precision specifier ‘.*’ expects argument of type ‘int’, but argument 3 has type ‘long int’ [-Wformat=]
sprintf(aname, "%.*s%s", cp-fname+1, fname, hf->archive);
^
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../include -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT mFILE.o -MD -MP -MF ".deps/mFILE.Tpo" -c -o mFILE.o `test -f '../utils/mFILE.c' || echo './'`../utils/mFILE.c; \
then mv -f ".deps/mFILE.Tpo" ".deps/mFILE.Po"; else rm -f ".deps/mFILE.Tpo"; exit 1; fi
rm -f libread.a
ar cru libread.a Read.o scf_extras.o translate.o compression.o ztr.o ztr_translate.o fpoint.o seqIOABI.o seqIOALF.o ctfCompress.o seqIOCTF.o expFileIO.o seqIOPlain.o misc_scf.o read_scf.o write_scf.o array.o compress.o error.o files.o find.o mach-io.o open_trace_file.o read_alloc.o strings.o traceType.o xalloc.o vlen.o hash_table.o mFILE.o
ar: `u' modifier ignored since `D' is the default (see `U')
ranlib libread.a
make[2]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0/read'
Making all in progs
make[2]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0/progs'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT convert_trace.o -MD -MP -MF ".deps/convert_trace.Tpo" -c -o convert_trace.o convert_trace.c; \
then mv -f ".deps/convert_trace.Tpo" ".deps/convert_trace.Po"; else rm -f ".deps/convert_trace.Tpo"; exit 1; fi
gcc -fPIC -o convert_trace convert_trace.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT makeSCF.o -MD -MP -MF ".deps/makeSCF.Tpo" -c -o makeSCF.o makeSCF.c; \
then mv -f ".deps/makeSCF.Tpo" ".deps/makeSCF.Po"; else rm -f ".deps/makeSCF.Tpo"; exit 1; fi
gcc -fPIC -o makeSCF makeSCF.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT extract_seq.o -MD -MP -MF ".deps/extract_seq.Tpo" -c -o extract_seq.o extract_seq.c; \
then mv -f ".deps/extract_seq.Tpo" ".deps/extract_seq.Po"; else rm -f ".deps/extract_seq.Tpo"; exit 1; fi
gcc -fPIC -o extract_seq extract_seq.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT index_tar.o -MD -MP -MF ".deps/index_tar.Tpo" -c -o index_tar.o index_tar.c; \
then mv -f ".deps/index_tar.Tpo" ".deps/index_tar.Po"; else rm -f ".deps/index_tar.Tpo"; exit 1; fi
gcc -fPIC -o index_tar index_tar.o
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT scf_dump.o -MD -MP -MF ".deps/scf_dump.Tpo" -c -o scf_dump.o scf_dump.c; \
then mv -f ".deps/scf_dump.Tpo" ".deps/scf_dump.Po"; else rm -f ".deps/scf_dump.Tpo"; exit 1; fi
gcc -fPIC -o scf_dump scf_dump.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT scf_info.o -MD -MP -MF ".deps/scf_info.Tpo" -c -o scf_info.o scf_info.c; \
then mv -f ".deps/scf_info.Tpo" ".deps/scf_info.Po"; else rm -f ".deps/scf_info.Tpo"; exit 1; fi
gcc -fPIC -o scf_info scf_info.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT scf_update.o -MD -MP -MF ".deps/scf_update.Tpo" -c -o scf_update.o scf_update.c; \
then mv -f ".deps/scf_update.Tpo" ".deps/scf_update.Po"; else rm -f ".deps/scf_update.Tpo"; exit 1; fi
gcc -fPIC -o scf_update scf_update.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT get_comment.o -MD -MP -MF ".deps/get_comment.Tpo" -c -o get_comment.o get_comment.c; \
then mv -f ".deps/get_comment.Tpo" ".deps/get_comment.Po"; else rm -f ".deps/get_comment.Tpo"; exit 1; fi
gcc -fPIC -o get_comment get_comment.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT hash_tar.o -MD -MP -MF ".deps/hash_tar.Tpo" -c -o hash_tar.o hash_tar.c; \
then mv -f ".deps/hash_tar.Tpo" ".deps/hash_tar.Po"; else rm -f ".deps/hash_tar.Tpo"; exit 1; fi
gcc -fPIC -o hash_tar hash_tar.o ../read/libread.a -lz -lm
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT hash_extract.o -MD -MP -MF ".deps/hash_extract.Tpo" -c -o hash_extract.o hash_extract.c; \
then mv -f ".deps/hash_extract.Tpo" ".deps/hash_extract.Po"; else rm -f ".deps/hash_extract.Tpo"; exit 1; fi
gcc -fPIC -o hash_extract hash_extract.o ../read/libread.a -lz -lm
if gcc -DHAVE_CONFIG_H -I. -I. -I.. -I.. -I../read -I../alf -I../abi -I../ctf -I../ztr -I../plain -I../scf -I../exp_file -I../utils -I/usr/local/include -fPIC -MT trace_dump.o -MD -MP -MF ".deps/trace_dump.Tpo" -c -o trace_dump.o trace_dump.c; \
then mv -f ".deps/trace_dump.Tpo" ".deps/trace_dump.Po"; else rm -f ".deps/trace_dump.Tpo"; exit 1; fi
gcc -fPIC -o trace_dump trace_dump.o ../read/libread.a -lz -lm
../read/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
make[2]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0/progs'
make[2]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0'
make[2]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0'
make[1]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0'

jitendra@jitendra-UNLOCK-INSTALL[io_lib-1.9.0] sudo make install []
[sudo] password for jitendra:
Making install in read
make[1]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0/read'
make[2]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0/read'
test -z "/usr/local/lib" || mkdir -p -- "/usr/local/lib"
/usr/bin/install -c -m 644 'libread.a' '/usr/local/lib/libread.a'
ranlib '/usr/local/lib/libread.a'
make[2]: Nothing to be done for 'install-data-am'.
make[2]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0/read'
make[1]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0/read'
Making install in progs
make[1]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0/progs'
make[2]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0/progs'
test -z "/usr/local/bin" || mkdir -p -- "/usr/local/bin"
/usr/bin/install -c 'convert_trace' '/usr/local/bin/convert_trace'
/usr/bin/install -c 'makeSCF' '/usr/local/bin/makeSCF'
/usr/bin/install -c 'extract_seq' '/usr/local/bin/extract_seq'
/usr/bin/install -c 'index_tar' '/usr/local/bin/index_tar'
/usr/bin/install -c 'scf_dump' '/usr/local/bin/scf_dump'
/usr/bin/install -c 'scf_info' '/usr/local/bin/scf_info'
/usr/bin/install -c 'scf_update' '/usr/local/bin/scf_update'
/usr/bin/install -c 'get_comment' '/usr/local/bin/get_comment'
/usr/bin/install -c 'hash_tar' '/usr/local/bin/hash_tar'
/usr/bin/install -c 'hash_extract' '/usr/local/bin/hash_extract'
/usr/bin/install -c 'trace_dump' '/usr/local/bin/trace_dump'
make[2]: Nothing to be done for 'install-data-am'.
make[2]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0/progs'
make[1]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0/progs'
make[1]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0'
make[2]: Entering directory '/home/jitendra/Downloads/io_lib-1.9.0'
make[2]: Nothing to be done for 'install-exec-am'.
test -z "/usr/local/man/man3" || mkdir -p -- "/usr/local/man/man3"
/usr/bin/install -c -m 644 './man/man3/exp2read.3' '/usr/local/man/man3/exp2read.3'
/usr/bin/install -c -m 644 './man/man3/ExperimentFile.3' '/usr/local/man/man3/ExperimentFile.3'
/usr/bin/install -c -m 644 './man/man3/fread_reading.3' '/usr/local/man/man3/fread_reading.3'
/usr/bin/install -c -m 644 './man/man3/fread_scf.3' '/usr/local/man/man3/fread_scf.3'
/usr/bin/install -c -m 644 './man/man3/fwrite_reading.3' '/usr/local/man/man3/fwrite_reading.3'
/usr/bin/install -c -m 644 './man/man3/fwrite_scf.3' '/usr/local/man/man3/fwrite_scf.3'
/usr/bin/install -c -m 644 './man/man3/read2exp.3' '/usr/local/man/man3/read2exp.3'
/usr/bin/install -c -m 644 './man/man3/read2scf.3' '/usr/local/man/man3/read2scf.3'
/usr/bin/install -c -m 644 './man/man3/read_allocate.3' '/usr/local/man/man3/read_allocate.3'
/usr/bin/install -c -m 644 './man/man3/read_deallocate.3' '/usr/local/man/man3/read_deallocate.3'
/usr/bin/install -c -m 644 './man/man3/read_reading.3' '/usr/local/man/man3/read_reading.3'
/usr/bin/install -c -m 644 './man/man3/read_scf.3' '/usr/local/man/man3/read_scf.3'
/usr/bin/install -c -m 644 './man/man3/read_scf_header.3' '/usr/local/man/man3/read_scf_header.3'
/usr/bin/install -c -m 644 './man/man3/scf2read.3' '/usr/local/man/man3/scf2read.3'
/usr/bin/install -c -m 644 './man/man3/write_reading.3' '/usr/local/man/man3/write_reading.3'
/usr/bin/install -c -m 644 './man/man3/write_scf.3' '/usr/local/man/man3/write_scf.3'
/usr/bin/install -c -m 644 './man/man3/write_scf_header.3' '/usr/local/man/man3/write_scf_header.3'
test -z "/usr/local/man/man4" || mkdir -p -- "/usr/local/man/man4"
/usr/bin/install -c -m 644 './man/man4/Read.4' '/usr/local/man/man4/Read.4'
test -z "/usr/local/include/io_lib" || mkdir -p -- "/usr/local/include/io_lib"
/usr/bin/install -c -m 644 'read/Read.h' '/usr/local/include/io_lib/Read.h'
/usr/bin/install -c -m 644 'read/scf_extras.h' '/usr/local/include/io_lib/scf_extras.h'
/usr/bin/install -c -m 644 'read/translate.h' '/usr/local/include/io_lib/translate.h'
/usr/bin/install -c -m 644 'abi/abi.h' '/usr/local/include/io_lib/abi.h'
/usr/bin/install -c -m 644 'abi/fpoint.h' '/usr/local/include/io_lib/fpoint.h'
/usr/bin/install -c -m 644 'abi/seqIOABI.h' '/usr/local/include/io_lib/seqIOABI.h'
/usr/bin/install -c -m 644 'alf/alf.h' '/usr/local/include/io_lib/alf.h'
/usr/bin/install -c -m 644 'ctf/seqIOCTF.h' '/usr/local/include/io_lib/seqIOCTF.h'
/usr/bin/install -c -m 644 'exp_file/expFileIO.h' '/usr/local/include/io_lib/expFileIO.h'
/usr/bin/install -c -m 644 'plain/plain.h' '/usr/local/include/io_lib/plain.h'
/usr/bin/install -c -m 644 'scf/scf.h' '/usr/local/include/io_lib/scf.h'
/usr/bin/install -c -m 644 'utils/array.h' '/usr/local/include/io_lib/array.h'
/usr/bin/install -c -m 644 'utils/compress.h' '/usr/local/include/io_lib/compress.h'
/usr/bin/install -c -m 644 'utils/error.h' '/usr/local/include/io_lib/error.h'
/usr/bin/install -c -m 644 'utils/mach-io.h' '/usr/local/include/io_lib/mach-io.h'
/usr/bin/install -c -m 644 'utils/misc.h' '/usr/local/include/io_lib/misc.h'
/usr/bin/install -c -m 644 'utils/open_trace_file.h' '/usr/local/include/io_lib/open_trace_file.h'
/usr/bin/install -c -m 644 'utils/tar_format.h' '/usr/local/include/io_lib/tar_format.h'
/usr/bin/install -c -m 644 'utils/traceType.h' '/usr/local/include/io_lib/traceType.h'
/usr/bin/install -c -m 644 'utils/xalloc.h' '/usr/local/include/io_lib/xalloc.h'
/usr/bin/install -c -m 644 'utils/mFILE.h' '/usr/local/include/io_lib/mFILE.h'
/usr/bin/install -c -m 644 'utils/stdio_hack.h' '/usr/local/include/io_lib/stdio_hack.h'
/usr/bin/install -c -m 644 'utils/vlen.h' '/usr/local/include/io_lib/vlen.h'
/usr/bin/install -c -m 644 'utils/hash_table.h' '/usr/local/include/io_lib/hash_table.h'
/usr/bin/install -c -m 644 'utils/os.h' '/usr/local/include/io_lib/os.h'
/usr/bin/install -c -m 644 'ztr/compression.h' '/usr/local/include/io_lib/compression.h'
/usr/bin/install -c -m 644 'ztr/ztr.h' '/usr/local/include/io_lib/ztr.h'
make[2]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0'
make[1]: Leaving directory '/home/jitendra/Downloads/io_lib-1.9.0'

3. Now install Bio::SCF

Now follows these steps:

tar zxf Bio::SCF.tar
cd Bio::SCF
perl Makefile.PL
make
make test
make install

jitendra@jitendra-UNLOCK-INSTALL[Bio-SCF-1.01] perl Makefile.PL []
Checking if your kit is complete...
Looks good
Generating a Unix-style Makefile
Writing Makefile for Bio::SCF
Writing MYMETA.yml and MYMETA.json
jitendra@jitendra-UNLOCK-INSTALL[Bio-SCF-1.01] make []
cp SCF.pm blib/lib/Bio/SCF.pm
cp SCF/Arrays.pm blib/lib/Bio/SCF/Arrays.pm
Running Mkbootstrap for Bio::SCF ()
chmod 644 "SCF.bs"
"/usr/bin/perl" "/usr/share/perl/5.22/ExtUtils/xsubpp" -typemap "/usr/share/perl/5.22/ExtUtils/typemap" SCF.xs > SCF.xsc && mv SCF.xsc SCF.c
Please specify prototyping behavior for SCF.xs (see perlxs manual)
x86_64-linux-gnu-gcc -c -D_REENTRANT -D_GNU_SOURCE -DDEBIAN -fwrapv -fno-strict-aliasing -pipe -I/usr/local/include -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64 -O2 -g -DVERSION=\"1.01\" -DXS_VERSION=\"1.01\" -fPIC "-I/usr/lib/x86_64-linux-gnu/perl/5.22/CORE" -DLITTLE_ENDIAN SCF.c
In file included from /usr/lib/x86_64-linux-gnu/perl/5.22/CORE/perl.h:5546:0,
from SCF.xs:5:
SCF.xs: In function ‘XS_Bio__SCF_get_scf_pointer’:
SCF.xs:57:20: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast]
ret_val = newSViv((int)scf_data);
^
/usr/lib/x86_64-linux-gnu/perl/5.22/CORE/embed.h:402:40: note: in definition of macro ‘newSViv’
#define newSViv(a) Perl_newSViv(aTHX_ a)
^
SCF.xs: In function ‘XS_Bio__SCF_get_scf_fpointer’:
SCF.xs:80:20: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast]
ret_val = newSViv((int)scf_data);
^
/usr/lib/x86_64-linux-gnu/perl/5.22/CORE/embed.h:402:40: note: in definition of macro ‘newSViv’
#define newSViv(a) Perl_newSViv(aTHX_ a)
^
SCF.xs: In function ‘XS_Bio__SCF_scf_free’:
SCF.xs:89:17: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
scf_deallocate((Scf *)scf_pointer);
^
SCF.xs: In function ‘XS_Bio__SCF_get_comments’:
SCF.xs:95:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_set_comments’:
SCF.xs:108:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_scf_write’:
SCF.xs:121:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_scf_fwrite’:
SCF.xs:137:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_get_from_header’:
SCF.xs:159:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_get_at’:
SCF.xs:186:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_set_base_at’:
SCF.xs:242:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
SCF.xs: In function ‘XS_Bio__SCF_set_at’:
SCF.xs:255:18: warning: cast to pointer from integer of different size [-Wint-to-pointer-cast]
Scf *scf_data = (Scf *)scf_pointer;
^
rm -f blib/arch/auto/Bio/SCF/SCF.so
x86_64-linux-gnu-gcc -shared -L/usr/local/lib -fstack-protector-strong SCF.o -o blib/arch/auto/Bio/SCF/SCF.so \
-lread -lz \

/usr/local/lib/libread.a(open_trace_file.o): In function `find_file_url':
open_trace_file.c:(.text+0xaf4): warning: the use of `tempnam' is dangerous, better use `mkstemp'
chmod 755 blib/arch/auto/Bio/SCF/SCF.so
"/usr/bin/perl" -MExtUtils::Command::MM -e 'cp_nonempty' -- SCF.bs blib/arch/auto/Bio/SCF/SCF.bs 644
Manifying 1 pod document

Many times in bioinformatics we need to deal with huge datasets which  are more than 100GB size. The traditional way to analysis a file is using the while loop

while (FILE){

Do something;

}

This is very slow(since we are using only one processor) and if we have 500 million lines in the dataset it takes more than a day to iterate through the whole dataset. So how do we make best use of all our processors and get the work done quickly?

Here is a very simple and efficient technique with perl which i have been using. I am  more inclined towards using perl fork than perl threads.

One of the oldest way to fork is

my $fork = fork();
if($fork){   
push (@childs,$fork); 
}
elseif($fork==0){
your code here;
exit(0);
}
else{die “Couldnt fork : $!”;}

## wait for the child process to finish
foreach(@childs){
my $tmp=waitid($_,0);
}

what a fork does is it creates a child process and takes the variables and code with it to analyze it separately (detached from the parent process) and thus a separate process is created( which usually runs on a separate processor). Thats it!! One big disadvantage of forking is its very difficult to share variables among the different processes. I will show you how to do it easily but still it has its own drawbacks.

Okie, now if you really do not want to use fork in your code, that’s okie too..There are many useful modules which do it for you very efficiently. One really useful module is Parallel::ForkManager. You can use Parallel::ForkManager to manage the number of forks you want to generate (number of processors you want to use).

Simple usage:
use Parallel::ForkManager;
my $max_processors=8;
my $fork= new Parallel::ForkManager($max_processors);
foreach (@dna) {
$fork->start and next; # do the fork
you code here;
$fork->finish; # do the exit in the child process
}
$pm->wait_all_children;

so you will be generating 8 forks which do the same thing for your each element of array. when one child finishes, Parallel::ForkManager generates a new one and thus you will be using all your processors to analyze the data. Now, if you have generated 8 child processes and want to write the data to one file. You need to lock the file to do this, because you will have problems with the buffering. You can lock the file using flock command.

open (my $QUAL, “myfile.txt”);
flock $QUAL, LOCK_EX or die “cant lock file $!”;
print $QUAL “$output”;
flock $QUAL, LOCK_UN or die “$!”;
close $QUAL;

I would not suggest using flock when dealing with multiple processes because it will decrease the processing efficiency( each child process must wait for the lock to be released by the other child process). Instead, I would suggest each fork writing to a separate file and after the processing just concatenating them.

Putting it all together, If you have 100GB data you can do this

step 1 : split the dataset equally according to number of processors you have. this may take a few hours(about 2-3 hrs for 100GB file)
You can use unix “split” command for this
for example:
my $number_split=int($number_of_entries_in_your_dataset/$max_processors);
my $split_Files=`split -l $number_split “your_file.fasta” “file_name”`;

step2: open you directory comtaining you split files and start Parallel::ForkManager.
For example:
opendir(DIRECTORY, $split_files_directory) or die $!; ### open the directory
my $fork= new Parallel::ForkManager($max_processors);
while (my $file = readdir(DIRECTORY)) { ### read the directory
if($file=~/^\./){next;}
print $file,”\n”;
########## Start fork ##########
my $pid= $super_fork->start and next;
Whatever you want to do with the split file ;
analyze my piece of $file;
######### end fork ###############
$super_fork->finish;
}
$super_fork->wait_all_children;

So basically each processor will be active with its piece of data (split file) and thus you have created 8 processes at one time which run without interfering with the other process. I again will not suggest writing output from each child process to one file(for reasons above). Write output from each fork to a separate file and finally concatenate them. Thats it, you have just increased your program speed by 8 times!! Isnt it easy?

Note:
You may worry about concatenation of the output each child generates, since it does take some time(remember 100GB). I think now you can use a mysql database LOAD DATA LOCAL INFILE command to load all the files into a single table(Should take about 3hrs for 100Gb dataset) and then export the whole table into one file. This should be faster than just concatenating them using “cat” command.(correct me if I am wrong)

Or much simpler way is to use pipes

cat output_dir/* | my_pipe or my_pipe <(file1) final_file;

Thats it guys!! Enjoy programming and please do comment. I am not a computer scientist so forgive me for any mistakes and if any please report them. Thank you.

Special Symbols – File handlers

$@ Perl error string

$! Error number from C, ‘errno’

$^E Extended OS error info, such as ‘CDROM tray not closed’

$? Exit status from last process

$AGRV – name of current file

@ARGV – command line arguments

$ARGV – special file handle for command line filenames

$. – current line number

$/ - input line delimiter

$\ - output line delimiter

$% - current page number

$&/${^MATCH} – last successful matching string

$`/${^PREMATCH} – the string preceding the last matching string

$’/${^POSTMATCH} – the string following the last matching string

$1, $2, … - matching groups in the parentheses in pattern

More at https://www.tutorialspoint.com/perl/perl_special_variables.htm

To find repeats in a genome from 2 to 9 length using a Perl script, you can use the RepeatMasker tool with the "--length" option[0]. Here's a step-by-step guide:

To resolve this, download and have in SSPACED-Longreads folder.

Cheers :)