Hello,

I am tasked with writing an application to process some large text
files, i.e. > 1 GB. The input will be csv and the output will be in the
format of an IIS web server log.

I've done this sort of thing before. In the past, I've just
brute-forced it, with a BufferedReader and BufferedWriter handling the
input/output line by line.

I have a little time to complete this project and I'd like to build
something more efficient, that won't peg the CPU for an hour.

My thought was to have a read thread and a write thread and create a
buffer into which some amount of input would be written; and then, when
a threshold was reached, the data would be written out.

Is this a good idea? Are there better ways to manage this?

And finally, I need pointers as to how I would create such a buffer.
The threaded read/write part I can do.

Thanks for any help.

mp

--
Michael Powe michael@trollope.org Naugatuck CT USA
Re graphics: A picture is worth 10K words -- but only those to describe
the picture. Hardly any sets of 10K words can be adequately described
with pictures.