rasort() dying

[Carter Bullard]

Hey Andrew,
   Rasort reads all the records into memory, sorts
them based on your sort criteria, and then writes
the resulting data stream out to a new file.

   You're just running out of RAM and swap space.
You should keep your file sizes to less than
(RAM + Swap) so that the machine can process them.

Carter


> -----Original Message-----
> From: owner-argus-info at lists.andrew.cmu.edu 
> [mailto:owner-argus-info at lists.andrew.cmu.edu] On Behalf Of 
> Andrew Pollock
> Sent: Thursday, October 24, 2002 12:39 AM
> To: argus-info at lists.andrew.cmu.edu
> Subject: rasort() dying
> 
> 
> Hi,
> 
> Sometimes when using rasort() to sort a fair bit of data, it 
> exits with 
> "Terminated" and a dmesg shows "Out of Memory: Killed process n 
> (rasort).", where "n" is the PID of rasort(). I presume that 
> the Linux 
> kernel has some sort of memory exhaustion protection?
> 
> Is this a limitation of rasort with large datasets, or does it have a 
> memory leak? My ulimit settings have pretty much everything set to 
> unlimited.
> 
> Andrew
>