Label issues with last week's release

[Craig Merchant]

Welcome back!  I hope you got in some quality R&R.

Radium has been running like a champ.

As for the label issue...  I see two behaviors in our data.  For some flow records, the label field's value is "0".  For others, labels get repeated multiple times or labels appear that don't apply to that host...

I can't explain the "0" label, but I *think* I figured out the second issue:  hosts are picking up the labels of other hosts on their class C subnet.

I uploaded my label file and ralabel.conf to you a while back.  If you want some of my data, let me know and I'll FTP it to you.

Thanks!

Craig

From: Carter Bullard [mailto:carter at qosient.com]
Sent: Tuesday, September 03, 2013 5:13 AM
To: Craig Merchant
Cc: Argus (argus-info at lists.andrew.cmu.edu)
Subject: Re: [ARGUS] Label issues with last week's release

Hey Craig,
So I'm back and its time to fix this label problem, as others are starting to report it.
It may take me a little while to figure out where we are on this bug.  If you have any
new observations, sending to the list would be great...

Radium is stable for you ( > 4 days ?).

Please send a separate email around your rastream() issue.  Better to have separate threads for each problem.

Carter

On Aug 26, 2013, at 9:52 PM, Craig Merchant <cmerchant at responsys.com<mailto:cmerchant at responsys.com>> wrote:


Carter,

>From previous emails sent to the list I was under the impression that you had discovered some differences between how ralabel handles labels vs how radium does.  Did those differences get resolved in the latest release?  I'm still seeing some issues with duplicate labels...

For example...  For IP 10.10.10.10, my label file (in order) looks like:

10.10.10.0/24 internal,DC2,I5-Apache-UI
10.10.10.10  apacheui,ri5

Yet my Argus events look like:

"1377565200.000,e *,tcp,63.166.75.3,0,->,10.10.10.10,9051,1599,685729,SRPA_SPA,56,300.000,478334,207395,2.857,2.467,0.443,US,ZZ,daddr=internal#DC2#I5-Apache-UI#apacheui#ri5#apacheui#ri5#apacheui#ri5#apacheui#ri5"

Not sure why the host-specific label is repeated 4 times, but that's consistent with other events I'm seeing.

In other (good) news, it would seem like the radium crashing issue has been fixed in the latest release.  I know we are a corner case as far as radium stability goes, but it's been running for four days without stopping and that's a positive change.

We may be experiencing some issues with rastream though...  I sent you our rastream search and the shell scripts it calls at the end of each time interval.  It's been working fine for a few days, but it seems to have lost track of the files it's processing, so no new events are coming in and old files aren't being deleted.  I'll dive deeper into that that this week and see if I can narrow down the problem.

Thanksa again for all the fixes!

C

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist1.pair.net/pipermail/argus/attachments/20130903/0bf2de77/attachment.html>