Bug in racluster: "Too many open files"

[Rafael Barbosa]

Hi Carter,

I am trying to run racluster in directory with around 2000 files. Each file
is a 5 min "split" generated with rasplit, the way you suggested to work
with large amounts of data.

The following command works:
$> racluster -R split -M ind > /dev/null

However, if I add a racluster configuration file, I get the following error:
$> racluster -f ~/config/racluster.conf -R split -M ind > /dev/null
racluster[60174]: 14:33:49.335532 open 'split/argus.2010.10.22.00.25.00':
Too many open files
racluster[60174]: 14:33:49.335800 /home/barbosarr/config/racluster.conf:
Too many open files

When looking at the 'lsof' output, it seems that racluster.conf is opened
multiple times. I assume it is opened once for each file in the 'split'
folder and never closed.

An excerpt of the 'lsof' output:
racluster 60174         barbosarr    3r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr    4r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr    5r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr    6r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr    7r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr    8r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr    9r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   10r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   11r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   12r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   13r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   14r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   15r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   16r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   17r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   18r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   19r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   20r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   21r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   22r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   23r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf
racluster 60174         barbosarr   24r      REG               8,17
96 704907370 /mnt/data/home/barbosarr/config/racluster.conf

The content of racluster.conf:
#Filter:every record, no record status output, record time out 5min
filter="" status=0 idle=300

I am running Racluster Version 3.0.7.3.

Regards,
Rafael Barbosa
http://www.ewi.utwente.nl/~barbosarr/
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist1.pair.net/pipermail/argus/attachments/20130215/6aa9ae53/attachment.html>