racluster

[Carter Bullard]

The real question is what are you trying to do?
Are you reading a bunch of files?

racluster() is not designed to read an infinite stream of data,
as it will grow and grow and grow and then die as it consumes
all the memory it can find.

The idea is to use something like rasplit() or rastream() to convert
the infinite stream into files, and cluster the files up, as that bounds
the racluster() process to work only with a "frame" of data.

What are you trying to do?

Carter


On Feb 7, 2008, at 5:10 PM, Torbjorn.Wictorin at its.uu.se wrote:

> hi,
>
> I still (clients .69) have problems with racluster. It runs well for  
> a while (whilst eating memory), then it goes into a loop with 100%  
> cpu.
>
> attached gdb:
> #0  0xffffe405 in __kernel_vsyscall ()
> #1  0xf7e63a76 in gettimeofday () from /lib/tls/i686/cmov/libc.so.6
> #2  0x08094b1b in ArgusReadStream (parser=0xf7d9e008, queue=0x8204128)
>    at ./argus_client.c:2107
> #3  0x0804d170 in main (argc=7, argv=0xffa207d4) at ./argus_main.c:351
>
> And it seems to be around here most of the time.
>
> Maybe it loops when the feeding process (radium) is swapped out  
> because that racluster eats the memory? Dont know. To me it looks  
> like it spends
> its time in gettimeofday.
>
> 4GB memory, "4" processors (dual-core opteron), around 2-4 Gbit/s  
> data.
>
> Maybe I have way to little memory?
>
> Torbjörn W