Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
HomeAnnouncementsWhite Papers
Discussion GroupsFirst AidDatabasesJavaBeansGUIJava 3DVirtual MachineCORBASecurityToolsGeneral
Java DirectoryOpen Source ProjectsSample Book ChaptersUser GroupsWeb Resources
Related Topics
Databases.NETMore Topics ...

Java Forum / Databases / August 2006

Tip: Looking for answers? Try searching our database.

Text File vs Database reading performance

Thread view: 
antoine - 10 Aug 2006 05:06 GMT
Hello,

I have developped an application that is doing some "backtesting" on
market data.
I have a serie of text files that contain data, one meaningful data per
line.
my app opens the file, reads a line, process it, reads the next one,
process it, and so on.

each file is around 50,000 lines long, and I have more than 200 files
(and growing).

the whole processing is taking quite some time, and I'm trying to find
ways to make it faster.

I chose the "file" way a while ago when I was lazy and the "speed"
problem had not appeared yet. however, I know I/O is one important
thing to look at if I want to improve performances.

especially, I'm thinking wouldn't that be faster to go through a
Database ? enter all my data in a DB once, and access the DB with JDBC.

has any of you any comment to make on ways to make things faster, and
on the Database performance especially ? or is my file solution good
enough ?

thanks for your insight...

-Antoine
Robert Klemme - 10 Aug 2006 11:12 GMT
Please don't double post.  See c.l.j.p for answer.

    robert


Free Magazines

Get these publications absolutely FREE for up to 12 months. There are no hidden fees and no obligation. Simply choose a title, complete the application form and submit it. Read more ...

Oracle MagazineNetwork ComputingComputer WorldBio-IT WorldeWeekInformation WeekInfosecurity
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2008 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.