View Single Post
  #9 (permalink)  
Old 02-12-2010, 02:05 AM
Alex
Guest
 
Posts: n/a
Default Re: Best Way to Process Large Text Files

On Feb 10, 9:07*pm, Arne Vajhøj <a...@vajhoej.dk> wrote:
> Huge files may still take time to read from the disk though.

A lot of time. I tried my skills in Netflix $1,000,000 contest... on
my computer it took 15 minutes to read their entire data (for example
to do some calculation). I had compressed it to the zip archive and
then reading it and uncompress with the same calculation took only 3
minutes.

Reply With Quote