U++ forum: Welcome to the forum

How to read file into Memory [message #12113]

Thu, 11 October 2007 14:05

spidertp
Messages: 16
Registered: October 2007
Location: Poland

Promising Member

Hello everybody,
I need to work with big files (> 100MB) and I like to load part of them to memory in a thread, process data in main app and read next part if needed.

I have 2 tables.
At first I load both of them with 10MB of binary data (so it gives me 20MB in memory). First I proccess data from table1 and when index goes to table2, I'm starting a thread to load new data to table1 and so on. Basically, in main app I want to process data without interrupts due to harddisk access.

The problem is that I have a lot of exceptions because of defining tables with new operator and deleting them.

I'm reading contents of file with code:

object * table1 = new object[10*1024*1024]; // 10MB
FileIn in(filename);
in.Get(table1, sizeof(table1));

After processing I make:

delete table1;

And... here I have a lot of problems with heap.

Can I load a file to memory in a different method than new/delete to some UPP container?

Please help.
Best regards
Tomek

Report message to a moderator