[ARGUS] Running out of memory when doing a rasort

eric eric-list-argus at catastrophe.net
Fri Apr 30 02:32:23 EDT 2004


Ah yes, more fun problems.

During a large spike in traffic, we noticed that rasort dies off
around 500MB being loaded into memory.

$ ls -l argus.2004.04.30.01.10.00.tmp
-rw-r-----  1 me flows  329519468 Apr 30 01:10 argus.2004.04.30.01.10.00.tmp

Turns up with...

rasort[99756]: RaCopyArgusRecord(0xbfbfe990) ArgusCalloc(1, 148) error Cannot
allocate memory

Watching top(1) shows this happens around 500MB being loaded into
memory. 

Some things about the host: it's a FreeBSD 4.9-RELEASE with the
following specs...

CPU: Intel(R) Pentium(R) 4 CPU 2.40GHz (2399.34-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf27  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,
CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
real memory  = 1341980672 (1310528K bytes)
avail memory = 1300062208 (1269592K bytes)

Also, swap has about 512MB, but the host doesn't swap out.

Some limits set in /etc/login.conf are....

root:\
        :cputime=unlimited:\
        :datasize=unlimited:\
        :stacksize=unlimited:\
        :memorylocked=unlimited:\
        :memoryuse=unlimited:\
        :filesize=unlimited:\
        :coredumpsize=unlimited:\
        :openfiles=unlimited:\
        :maxproc=unlimited:\
        :sbsize=unlimited:\
        :vmemoryuse=unlimited:\
        :priority=0:\

...though apparently some hard limits are set (including stack size at 
65536 bytes and segment size at 524288 kbytes).

Just curious if folks have seen anything such as this; now, I return
to trying to figure out whats causing a 314MB file to be written :)

- Eric




More information about the argus mailing list