https://bioinformaticsonline.com/snippets/view/35338/remove-duplicate-lines-with-perl? https://bioinformaticsonline.com/snippets/view/35338/remove-duplicate-lines-with-perl Wed, 24 Jan 2018 15:12:18 -0600 https://bioinformaticsonline.com/snippets/view/35338/remove-duplicate-lines-with-perl #! perl -sw use strict; my %lines; #open DATA, $ARGV[0] or die "Couldn't open $ARGV[0]: $!\n"; while (<DATA>) { print if not $lines{$_}++; } __DATA__ apple apple plum vinegar apple banana banana banana apple]]> Jit