dataset occupying too much memory

[anand]

hi,

i am fetching data from database using dataadaptor
and filling up a dataset. i checked memory usage of
the app, and it consumes 50 Mb of RAM for the given
amount of data. that is, i checked the memory occupied
by the app before and after fetching data.

i saved the same amount of data in plain comma separated
text file, which occupied 4Mb! i saved the same data in
XML format on HDD and that file occupied 20Mb.

Now, it seems that maintaining data in dataset invoke
heavy memory usage. Is there any way that i can decrease
this memory usage ? please do not advise on maintaining
a refcursor and fetching data part by part. i mean my
requirment is different. i need to fetch all the data
at one go.

i guess many people might have faced this problem,
which seems to be due to the overhead of maintaining
data by dataset in memory.

anand
--

 

[Cor Ligthert]

Hi Anand,

Is this for a pda application, otherwise I do not see why the dataset should
be that hugh, that will be in my opinion a very slow application. The
thinking is now; get only that what you need in as small pieces as possible.

Cor

 

[Bernie Yaeger]

Hi Anand,

Of course, you got exactly the suggestion you didn't need.

I too, often, need to get all the data in one go. I close out the
connection as quickly as possible, but I don't have any really good answers
yet - if I come up with something, I'll keep you in mind.

Bernie Yaeger