Possible memory leak when using logging

ckacoroski · Post by **ckacoroski** » Tue Jun 26, 2007 8:07 pm

Hi,

I am copying in 20000 students from an external table into internal objects. When I tried this with logging turned on (log to file, level=full), it ate up over 3.8GB of the 4GB of ram and then crashed after about 2500 records. However, if I turned logging off and level=minimum, the memory use never went above 450MB. Not sure if anything can be done about it, but thought you should know about it.

ski

aware_support · Post by **aware_support** » Wed Jun 27, 2007 1:23 am

Thanks for the info, we'll check it out.

ckacoroski · Post by **ckacoroski** » Wed Jun 27, 2007 3:42 pm

Some more information. I had logging set to go to a file and the file was limited to 1MB somewhere so it was being opened, filled, closed, and then reopened multiple times a minute. I wonder if that could be the cause of the problem?

ckacoroski · Post by **ckacoroski** » Wed Jun 27, 2007 5:27 pm

Tried using the viewer instead of a file and same thing happened. Using top I could just see the memory getting used until it was all gone (did about 2000 records). Definitely some sort of a memory leak in the logging when used with my application. If I kill AwareIM, it still shows about 2.5GB of ram being used. I have to reboot the server to free it up.

tford · Post by **tford** » Wed Jun 27, 2007 6:36 pm

ski,

I assume you are doing the processing IN BATCHES OF ... ?

Tom