Search in CSV files

Thread view:

marcosm - 12 Jan 2006 11:58 GMT

Hi there.

I need some help with CSV files. I have an application where the data
to be manipulated is in CSV files. While this files have a small number
of entries there is no problem in searching sequentially. But this
files tend to get bigger slowing down the app performance. Can someone
give me any pointers on how to improve this? Database is not an option.
Any links to CSV manipulating libraries would be welcome too.

Its a web application, running on Tomcat 4.1.31.

Thanks

Reply to this Message

Thomas Weidenfeller - 12 Jan 2006 12:38 GMT

> Hi there.

Don't multipost. You got an answer in another group. Have fun finding it.

/Thomas

Signature

The comp.lang.java.gui FAQ:
ftp://ftp.cs.uu.nl/pub/NEWS.ANSWERS/computer-lang/java/gui/faq
http://www.uni-giessen.de/faq/archiv/computer-lang.java.gui.faq/

Reply to this Message

Hiran Chaudhuri - 12 Jan 2006 16:24 GMT

> Hi there.
>
[quoted text clipped - 4 lines]
> give me any pointers on how to improve this? Database is not an option.
> Any links to CSV manipulating libraries would be welcome too.

You should consider using indexes on your CSV files to speed up performance.
I cannot tell whether there are libraries out there that do the job on CVS
files. Otherwise, such data handling libraries are called 'database'.

Hiran Chaudhuri

Reply to this Message

Roedy Green - 12 Jan 2006 21:01 GMT

>I need some help with CSV files. I have an application where the data
>to be manipulated is in CSV files. While this files have a small number
>of entries there is no problem in searching sequentially. But this
>files tend to get bigger slowing down the app performance. Can someone
>give me any pointers on how to improve this? Database is not an option.
>Any links to CSV manipulating libraries would be welcome too.

see http://mindprod.com/jgloss/csv.html

CSV is a sequential format. It is not designed for lookup or update.
You must read the file into RAM into some sort of data structure, do
your fancy stuff, then write it out again.

Signature

Canadian Mind Products, Roedy Green.
http://mindprod.com Java custom programming, consulting and coaching.

Reply to this Message

opalpa@gmail.com - 12 Jan 2006 22:23 GMT

http://ostermiller.org/utils/CSV.html

It even works on Microsoft made CSV, which is not standard CSV.

As an aside, it seems Microsoft's MO is to introduce minor
incompatibilites to assure integration difficulties. Whether it is
changing / to \ in file paths (which makes the code harder to write as
\ has extra meaning), or adding incompatibilities to kerberos, or
modifing CSV, Microsoft, it appears, purposely makes integration
difficult. Just a few examples in this paragraph.

http://www.geocities.com/opalpaweb/

Reply to this Message

Search in CSV files

Free Magazines