interesting 'rasplit' behavior
MN
mnewton at stanford.edu
Wed Oct 25 15:01:58 EDT 2006
Thanks!
Th reason for the lots of output files was that I was trying to
find the records that were causing the other problems.
We also have lots of flows...
- mike
On Wed, Oct 25, 2006 at 12:32:29AM -0400, Carter Bullard wrote:
> Hey Mike,
> Yes I found the problem. I've 'fixed' it so that it adds only a single
> additional suffix at a time, when the suffix has gotten to either
> za, zaa, zaaa, etc... depending on the suffix length (-a option).
>
> It seems to work with a suffix length of 2, 3, or 4 (didn't test 5 as
> the
> number of files needed to get the suffix to roll-over was a bit big,
> what, something like 456977 files?). Should work now!!!!
>
> Carter
>
>
> On Oct 23, 2006, at 7:16 PM, MN wrote:
>
> >
> >Hi -
> >
> >Running rasplit (with the implied default "-M count 10000") on
> >a large file:
> >
> ># ls -al /d/slurp2/test.bz2
> >-r--r--r-- 1 xfer xfer 990913849 Sep 17 18:00 /d/slurp2/test.bz2
> ># /usr/local/src/argus-clients-3.0.0.rc.33/bin/rasplit -r /d/slurp2/
> >test.bz2
> >
> >
> >produces an output ordering that does not match the man page:
> >
> > When rasplit is using the default count mode or the
> > size mode, the suffix is a group of letters 'aa', order
> > by file name produces the original input file.
> > If rasplit will need to create more output files than
> > are allowed by the default suffix strategy, more letters
> > will be added, in order to accomodate the needed files.
> >
> >As it seems to do a wrap rather than an add:
> >
> ># ls -ltar
> >
> >(summarized, in order of file creation; note hte xzzzz -> xzaaa
> >transition:)
> >
> > xaa
> > xab
> > ... (what you would expect here)
> > xay
> > xaz
> > xba
> > ...
> > xbz
> > xca.xcz (what you would expect here)
> > ... (what you would expect here)
> > xya
> > ... (what you would expect here)
> > xyz
> > xzzaa
> > xzzab
> > ... (what you would expect here)
> > xzzaz
> > xzzba
> > ... (what you would expect here)
> > xzzbz
> > ... ... (what you would expect here)
> > xzzza
> > ... (what you would expect here)
> > xzzzz
> > xzaaa (!!!!????) <------
> > xzaab
> > ...
> > xzamn (last file)
> >
> >Which seems to violate both of the sentences from the man page.
> >
> >
> >Thanks,
> >- mike
> >
> >
> >ps: I've also sent Carter an example of a
> >
> > ArgusAlert: ra[12980]: ArgusReadConnection: not Argus-2.0 data
> >stream.
> >
> >generating record, but can't share the record with the list.
> >
> >
>
>
>
>
More information about the argus
mailing list