U++ framework: U++ Core » compressed serialization

Home » U++ Library support » U++ Core » compressed serialization

Show: Today's Messages :: Polls :: Message Navigator
E-mail to friend

compressed serialization [message #23028]

Wed, 09 September 2009 02:56

nixnixnix
Messages: 415
Registered: February 2007
Location: Kelowna, British Columbia

Senior Member

Is it possible to combine Z compression (or any other kind of compression) with the built in serialization functions such as LoadFromFile and StoreToFile? If so, is there an example of this please?

If its not possible to do that, is it possible to write and read compressed serialized files without writing the uncompressed version to disk and with uncompressed file sizes in the hundreds of megabytes or more?

Nick

Report message to a moderator

Re: compressed serialization [message #23029 is a reply to message #23028]

Wed, 09 September 2009 05:59

Novo
Messages: 1432
Registered: December 2006

Ultimate Contributor

IMO, that is not possible.
LoadFromFile/StoreToFile just open a FileStream and call Load/Store using this stream. In order to use compressed serialized files you need to have compression/decompression algorithms, which behave as streams, and bind compression streams with regular streams in a filter-like way. IMO that is not possible right now.

Regards,
Novo

Report message to a moderator

Re: compressed serialization [message #23030 is a reply to message #23029]

Wed, 09 September 2009 08:41

Mindtraveller
Messages: 917
Registered: August 2007
Location: Russia, Moscow rgn.

Experienced Contributor

Maybe it is possible to unzip file into memory, then load from it as Stream?

Report message to a moderator

Re: compressed serialization [message #23037 is a reply to message #23030]

Wed, 09 September 2009 21:14

Novo
Messages: 1432
Registered: December 2006

Ultimate Contributor

Mindtraveller wrote on Wed, 09 September 2009 02:41

Maybe it is possible to unzip file into memory, then load from it as Stream?

That is definitely possible Wink

You just need to unzip one stream into another. Who cares about memory these days ...

Regards,
Novo

Report message to a moderator

Re: compressed serialization [message #23038 is a reply to message #23037]

Thu, 10 September 2009 03:01

Mindtraveller
Messages: 917
Registered: August 2007
Location: Russia, Moscow rgn.

Experienced Contributor

You may create some proxy class like MyClassZippedSerializer which will compress/decompress your inner MyClass serialized data then save it to file. Using this technique you may even partially read/write your serialized data to make memory consumption close to theoretical minimum.

Report message to a moderator

Previous Topic:	ConvertInt > templatable Convert<T>
Next Topic:	Error when I trying to Add in VectorMap container a "C" struct

Goto Forum:

-=] Back to Top [=-

[ Syndicate this forum (XML) ] [

] [

]

Current Time: Sat Jun 27 05:36:01 GMT+2 2026

Total time taken to generate the page: 0.00523 seconds