To remove all line ends (\n) from a Unix text file:
sed ':a;N;$!ba;s/\n//g' filename.txt > newfilename_oneline.txt
To get average for a column of numbers (here the second column...
...p 1 : split the dataset equally according to number of processors you have. this may take a few hours(about 2-3 hrs for 100GB file)You can use unix “split” command f...