interesting 'rasplit' behavior

MN mnewton at stanford.edu
Wed Oct 25 15:01:58 EDT 2006


Thanks!

Th reason for the lots of output files was that I was trying to
find the records that were causing the other problems.

We also have lots of flows...

- mike

On Wed, Oct 25, 2006 at 12:32:29AM -0400, Carter Bullard wrote:
> Hey Mike,
> Yes I found the problem.  I've 'fixed' it so that it adds only a single
> additional suffix at a time, when the suffix has gotten to either
>  za, zaa, zaaa, etc... depending on the suffix length (-a option).
> 
> It seems to work with a suffix length of 2, 3, or 4 (didn't test 5 as  
> the
> number of files needed to get the suffix to roll-over was a bit big,
> what, something like 456977 files?).   Should work now!!!!
> 
> Carter
> 
> 
> On Oct 23, 2006, at 7:16 PM, MN wrote:
> 
> >
> >Hi -
> >
> >Running rasplit (with the implied default "-M count 10000") on
> >a large file:
> >
> ># ls -al /d/slurp2/test.bz2
> >-r--r--r--  1 xfer xfer 990913849 Sep 17 18:00 /d/slurp2/test.bz2
> ># /usr/local/src/argus-clients-3.0.0.rc.33/bin/rasplit -r /d/slurp2/ 
> >test.bz2
> >
> >
> >produces an output ordering that does not match the man page:
> >
> >	When  rasplit  is using the default count mode or the
> >	size mode, the suffix is a group of letters 'aa', order
> >	by  file  name  produces  the  original  input  file.
> >	If rasplit will need to create more output files than
> >	are allowed by the default suffix strategy, more letters
> >	will be added, in order to accomodate the needed files.
> >
> >As it seems to do a wrap rather than an add:
> >
> ># ls -ltar
> >
> >(summarized, in order of file creation; note hte xzzzz -> xzaaa
> >transition:)
> >
> >	xaa
> >	xab
> >	...	(what you would expect here)
> >	xay
> >	xaz
> >	xba
> >	...
> >	xbz
> >	xca.xcz	(what you would expect here)
> >	... 	(what you would expect here)
> >	xya
> >	...	(what you would expect here)
> >	xyz
> >	xzzaa
> >	xzzab
> >	...	(what you would expect here)
> >	xzzaz
> >	xzzba
> >	...	(what you would expect here)
> >	xzzbz
> >	... ...	(what you would expect here)
> >	xzzza
> >	...	(what you would expect here)
> >	xzzzz
> >	xzaaa	(!!!!????) <------
> >	xzaab
> >	...
> >	xzamn	(last file)
> >
> >Which seems to violate both of the sentences from the man page.
> >
> >
> >Thanks,
> >- mike
> >
> >
> >ps: I've also sent Carter an example of a
> >
> >	ArgusAlert: ra[12980]: ArgusReadConnection: not Argus-2.0 data  
> >stream.
> >
> >generating record, but can't share the record with the list.
> >
> >
> 
> 
> 
> 



More information about the argus mailing list