What is the best way to work with a large amount of data?

Assume you have a big text file to work that you need to store and work with, what would be the best way to do that?

I will be adding / removing a lot of elements so I really want to stay away from array resizing overhead.

I don't want to step on any toes here, but would binary trees / linked lists in C++ be a better solution?

[348 byte] By [AncientPCa] at [2007-11-26 19:52:50]
# 1
Java has those data structures aplenty: http://java.sun.com/docs/books/tutorial/collections/index.html
DrLaszloJamfa at 2007-7-9 22:44:02 > top of Java-index,Java Essentials,Java Programming...
# 2
> Assume you have a big text file to work that you need> to store and work with, what would be the best way to> do that?Parse it into a database. Then use SQL to manipulate.
jschella at 2007-7-9 22:44:02 > top of Java-index,Java Essentials,Java Programming...
# 3
How big is the text file? #bytes, #lines = ?
DrLaszloJamfa at 2007-7-9 22:44:02 > top of Java-index,Java Essentials,Java Programming...
# 4
And there are specialized programs designed especially to efficiently process large text files - search the net.
ChuckBinga at 2007-7-9 22:44:02 > top of Java-index,Java Essentials,Java Programming...
# 5
Ancient still hasn't spilled the beans. He could be talking about only hundreds of lines.
DrLaszloJamfa at 2007-7-9 22:44:02 > top of Java-index,Java Essentials,Java Programming...