PARAMETERS:
 - kmer size =    20 		(-k)
 - n hashes =     4 		(-N)
 - min hashsize = 1e+08 	(-x)
 - paired =	      True 		(-p)

Estimated memory usage is 4e+08 bytes (n_hashes x min_hashsize)
--------
making hashtable
... kept 122640 of 200000 , or 61 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 153866 of 400000 , or 38 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 183178 of 600000 , or 30 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 206362 of 800000 , or 25 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 224348 of 1000000 , or 22 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 243296 of 1200000 , or 20 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 261944 of 1400000 , or 18 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 279514 of 1600000 , or 17 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 296676 of 1800000 , or 16 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 312938 of 2000000 , or 15 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 329636 of 2200000 , or 14 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 346262 of 2400000 , or 14 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 362450 of 2600000 , or 13 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 378398 of 2800000 , or 13 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 394822 of 3000000 , or 13 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 411192 of 3200000 , or 12 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 430380 of 3400000 , or 12 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 449126 of 3600000 , or 12 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 465978 of 3800000 , or 12 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 482104 of 4000000 , or 12 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 499494 of 4200000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 517768 of 4400000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 535452 of 4600000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 552182 of 4800000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 568702 of 5000000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 586324 of 5200000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 604940 of 5400000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 622590 of 5600000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 639166 of 5800000 , or 11 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 655608 of 6000000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 672550 of 6200000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 690116 of 6400000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 708924 of 6600000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 726922 of 6800000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 744220 of 7000000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 761086 of 7200000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 778078 of 7400000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 795282 of 7600000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 812338 of 7800000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 829394 of 8000000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 844658 of 8200000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 860352 of 8400000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 882658 of 8600000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 903778 of 8800000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 918768 of 9000000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 934356 of 9200000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 950550 of 9400000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 966826 of 9600000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 981804 of 9800000 , or 10 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 996900 of 10000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1012070 of 10200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1027590 of 10400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1042580 of 10600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1057444 of 10800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1072642 of 11000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1087892 of 11200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1105498 of 11400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1123498 of 11600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1139684 of 11800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1155024 of 12000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1171670 of 12200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1189418 of 12400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1207082 of 12600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1223880 of 12800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1240028 of 13000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1255958 of 13200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1272906 of 13400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1290114 of 13600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1306818 of 13800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1323154 of 14000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1339778 of 14200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1356578 of 14400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1374984 of 14600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1393644 of 14800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1410934 of 15000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1428214 of 15200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1445010 of 15400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1462386 of 15600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1480014 of 15800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1497302 of 16000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1514774 of 16200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1529070 of 16400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1544904 of 16600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1568072 of 16800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1587784 of 17000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1601968 of 17200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1616606 of 17400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1631508 of 17600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1646502 of 17800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1660834 of 18000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1675818 of 18200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1690478 of 18400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1705488 of 18600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1719800 of 18800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1734596 of 19000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1749306 of 19200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1764134 of 19400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1781676 of 19600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1799046 of 19800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1814564 of 20000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1829572 of 20200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1845242 of 20400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1861964 of 20600000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1879108 of 20800000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1894840 of 21000000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1910492 of 21200000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1926514 of 21400000 , or 9 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1943918 of 21600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1960874 of 21800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1976990 of 22000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 1992802 of 22200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2008718 of 22400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2025594 of 22600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2043976 of 22800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2062570 of 23000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2079804 of 23200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2096774 of 23400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2113524 of 23600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2130950 of 23800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2148688 of 24000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2166750 of 24200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2184896 of 24400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2198926 of 24600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2217684 of 24800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2241260 of 25000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2258660 of 25200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2272862 of 25400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2288390 of 25600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2304260 of 25800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2318938 of 26000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2333398 of 26200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2347712 of 26400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2362252 of 26600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2377276 of 26800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2391824 of 27000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2406590 of 27200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2421638 of 27400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2436558 of 27600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2454536 of 27800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2474546 of 28000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2489918 of 28200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2505064 of 28400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2520536 of 28600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2537212 of 28800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2554420 of 29000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2569998 of 29200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2585840 of 29400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2602310 of 29600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2619564 of 29800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2636272 of 30000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2652274 of 30200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2668396 of 30400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2685010 of 30600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2702544 of 30800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2721166 of 31000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2739018 of 31200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2756064 of 31400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2773022 of 31600000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2790108 of 31800000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2807308 of 32000000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2824840 of 32200000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
... kept 2843362 of 32400000 , or 8 %
... in file /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
DONE with /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat ; kept 2857640 of 32549000 or 8 %
output in dataset_1227.dat.keep
Saving hashfile through /mnt/galaxy/galaxy-dist/database/files/001/dataset_1227.dat
...saving to diginorm_out.kh
fp rate estimated to be 0.188
starting threads
starting writer
loading...
... filtering 0
... filtering 100000
... filtering 200000
... filtering 300000
... filtering 400000
... filtering 500000
processed 500000 / wrote 359493 / removed 140507
processed 42106751 bp / wrote 24065021 bp / removed 18041730 bp
discarded 42.8%
... filtering 600000
... filtering 700000
... filtering 800000
... filtering 900000
... filtering 1000000
processed 1000000 / wrote 658860 / removed 341140
processed 83488612 bp / wrote 40187770 bp / removed 43300842 bp
discarded 51.9%
... filtering 1100000
... filtering 1200000
... filtering 1300000
... filtering 1400000
... filtering 1500000
processed 1500000 / wrote 952416 / removed 547584
processed 125076412 bp / wrote 55588922 bp / removed 69487490 bp
discarded 55.6%
... filtering 1600000
... filtering 1700000
... filtering 1800000
... filtering 1900000
... filtering 2000000
processed 2000000 / wrote 1243808 / removed 756192
processed 166527708 bp / wrote 70843481 bp / removed 95684227 bp
discarded 57.5%
... filtering 2100000
... filtering 2200000
... filtering 2300000
... filtering 2400000
... filtering 2500000
processed 2500000 / wrote 1532984 / removed 967016
processed 207960617 bp / wrote 85929235 bp / removed 122031382 bp
discarded 58.7%
... filtering 2600000
... filtering 2700000
... filtering 2800000
done loading in sequences
DONE writing.
processed 2856840 / wrote 1737680 / removed 1119160
processed 237621131 bp / wrote 96399152 bp / removed 141221979 bp
discarded 59.4%
file with ht: diginorm_out.kh
loading hashtable
K: 20
filtering dataset_1227.dat.keep
output in dataset_1227.dat.keep.abundfilt
splitting pe/se sequences from dataset_1227.dat.keep.abundfilt to dataset_1227.dat.keep.abundfilt.{pe,se}
... 100000
... 200000
... 300000
... 400000
... 500000
... 600000
... 700000
... 800000
... 900000
... 1000000
... 1100000
... 1200000
... 1300000
... 1400000
... 1500000
... 1600000
... 1700000
DONE; read 1737996 sequences, 633418 pairs and 471160 singletons

PARAMETERS:
 - kmer size =    20 		(-k)
 - n hashes =     4 		(-N)
 - min hashsize = 1e+08 	(-x)
 - paired =	      True 		(-p)

Estimated memory usage is 4e+08 bytes (n_hashes x min_hashsize)
--------
making hashtable
... kept 87740 of 200000 , or 43 %
... in file dataset_1227.dat.keep.abundfilt.pe
... kept 234328 of 400000 , or 58 %
... in file dataset_1227.dat.keep.abundfilt.pe
... kept 381608 of 600000 , or 63 %
... in file dataset_1227.dat.keep.abundfilt.pe
... kept 526846 of 800000 , or 65 %
... in file dataset_1227.dat.keep.abundfilt.pe
... kept 670238 of 1000000 , or 67 %
... in file dataset_1227.dat.keep.abundfilt.pe
... kept 811102 of 1200000 , or 67 %
... in file dataset_1227.dat.keep.abundfilt.pe
DONE with dataset_1227.dat.keep.abundfilt.pe ; kept 858062 of 1266836 or 67 %
output in dataset_1227.dat.keep.abundfilt.pe.keep
Saving hashfile through dataset_1227.dat.keep.abundfilt.pe
...saving to diginorm_out.kh
fp rate estimated to be 0.000

PARAMETERS:
 - kmer size =    20 		(-k)
 - n hashes =     4 		(-N)
 - min hashsize = 1e+08 	(-x)
 - paired =	      False 		(-p)

Estimated memory usage is 4e+08 bytes (n_hashes x min_hashsize)
--------
making hashtable
... kept 86003 of 100000 , or 86 %
... in file dataset_1227.dat.keep.abundfilt.se
... kept 151425 of 200000 , or 75 %
... in file dataset_1227.dat.keep.abundfilt.se
... kept 212458 of 300000 , or 70 %
... in file dataset_1227.dat.keep.abundfilt.se
... kept 271945 of 400000 , or 67 %
... in file dataset_1227.dat.keep.abundfilt.se
DONE with dataset_1227.dat.keep.abundfilt.se ; kept 314389 of 471160 or 66 %
output in dataset_1227.dat.keep.abundfilt.se.keep
Saving hashfile through dataset_1227.dat.keep.abundfilt.se
...saving to diginorm_out.kh
fp rate estimated to be 0.000