Argus-info Digest, Vol 85, Issue 11

[Carter Bullard]

Hey CS Lee,
Currently, the timeout is driven by the arrival rate of the man records, so to fine tune it,
you change the rate of MAR status record generation at the argus data source.  If you'r
 connecting to radium() change it on radium().  The man records are critical to the
transport connection, so you can't filter them out across the link.  The tools all know
this, so they all make sure to always send man records. 

I am very interested in this failure mode.  Is it always the rastream() that complains?
If so I'll add some more info to the message.  How is the load on this collection machine?
Any idea of the record arrival rate ? 1K, 10K, 100K records per second?

Carter



On Sep 9, 2012, at 10:51 PM, CS Lee <geek00l at gmail.com> wrote:

> hi Carter,
> 
> I checked the syslog and seeing the same message couple of times
> 
>  rastream[19087]: 11:34:44.127549 ArgusReadStream 192.168.10.10: idle stream: closing 
> 
> However since it will reconnect to radium, I just left it running. You mentioned that if the client doesn't receive the 3 management records in certain period it will close the connection, is there a way to fine tune it, how about with - no man in filter.
> 
> Cheers!
> 
> On Mon, Sep 10, 2012 at 12:00 AM, <argus-info-request at lists.andrew.cmu.edu> wrote:
> Send Argus-info mailing list submissions to
>         argus-info at lists.andrew.cmu.edu
> 
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://lists.andrew.cmu.edu/mailman/listinfo/argus-info
> or, via email, send a message with subject or body 'help' to
>         argus-info-request at lists.andrew.cmu.edu
> 
> You can reach the person managing the list at
>         argus-info-owner at lists.andrew.cmu.edu
> 
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Argus-info digest..."
> 
> 
> Today's Topics:
> 
>    1. Re:  rastream (Carter Bullard)
> 
> 
> ----------------------------------------------------------------------
> 
> Message: 1
> Date: Sat, 8 Sep 2012 12:56:11 -0400
> From: Carter Bullard <carter at qosient.com>
> Subject: Re: [ARGUS] rastream
> To: CS Lee <geek00l at gmail.com>
> Cc: Argus <argus-info at lists.andrew.cmu.edu>
> Message-ID: <7CCD382E-4803-41BB-9C11-969EC5BCE0F8 at qosient.com>
> Content-Type: text/plain; charset="iso-8859-1"
> 
> To get rastream to reconnect, use the RA_RELIABLE_CONNECT=yes
> variable in its own rarc file.
> 
>    rastream -F rarc.file -d -n -M time 5m -S 192.168.10.10:562 -w /nsmon/lib/argus_data/%Y%m%d/nsmon.%Y.%m.%d.%H.%M.%S.arg3 -B 10s -f /nsmon/etc/rastream.sh
> 
> or something like that.
> 
> Carter
> 
> On Sep 8, 2012, at 9:39 AM, CS Lee <geek00l at gmail.com> wrote:
> 
> > hi Carter,
> >
> > Currently there are rasqlinsert and rastream connecting to the radium. Rastream is generating file, and perform the tasks I assign in the rastream.sh without problem, only thing is the termination is random.
> >
> > Now I'm waiting for rastream to hit the same problem again but it hasn't happened yet, it keeps running, by the way I'm running it with -d now, one question is does rastream will try to reconnect when running in the daemon mode?
> >
> > Cheers!
> >
> > On Sat, Sep 8, 2012 at 8:58 PM, Carter Bullard <carter at qosient.com> wrote:
> > All ra* clients, when they do not receive 3 management records in a row, close the connection,
> > assuming that the source of the argus data has gone away.
> > How long is a while?  rastream() does have its scheduling tasks to deal with, but other than that,
> > its really is the same as rasplit().  Are there any other messages in the system log around this
> > time?  Do the output files that rastream() is generating, look as expected?
> > Is rastream() the only program connecting to that specific radium()?
> >
> > Carter
> >
> >
> >
> > On Sep 8, 2012, at 1:15 AM, CS Lee <geek00l at gmail.com> wrote:
> >
> >> hi Carter,
> >>
> >> I'm testing argus-clients-3.0.7.1, when I use rastream to connect to the radium, after a while the connection will be terminated which has similar behaviour to rasqlinsert last time -
> >>
> >> rastream -n -M time 5m -S 192.168.10.10:562 -w /nsmon/lib/argus_data/%Y%m%d/nsmon.%Y.%m.%d.%H.%M.%S.arg3 -B 10s -f /nsmon/etc/rastream.sh
> >> rastream[19087]: 11:34:44.127549 ArgusReadStream 192.168.10.10: idle stream: closing
> >>
> >> I can connect to same radium daemon in the server without this issue using rasplit, rasqlinsert and it has been running for days, this problem only happens to rastream.
> >>
> >> Cheers!
> >>
> >> --
> >> Best Regards,
> >>
> >> CS Lee<geek00L[at]gmail.com>
> >>
> >> http://geek00l.blogspot.com
> >> http://defcraft.net
> >
> >
> >
> >
> > --
> > Best Regards,
> >
> > CS Lee<geek00L[at]gmail.com>
> >
> > http://geek00l.blogspot.com
> > http://defcraft.net
> 
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: https://lists.andrew.cmu.edu/mailman/private/argus-info/attachments/20120908/2fbb0e3a/attachment-0001.html
> -------------- next part --------------
> A non-text attachment was scrubbed...
> Name: smime.p7s
> Type: application/pkcs7-signature
> Size: 2589 bytes
> Desc: not available
> Url : https://lists.andrew.cmu.edu/mailman/private/argus-info/attachments/20120908/2fbb0e3a/attachment-0001.bin
> 
> ------------------------------
> 
> _______________________________________________
> Argus-info mailing list
> Argus-info at lists.andrew.cmu.edu
> https://lists.andrew.cmu.edu/mailman/listinfo/argus-info
> 
> 
> End of Argus-info Digest, Vol 85, Issue 11
> ******************************************
> 
> 
> 
> -- 
> Best Regards,
> 
> CS Lee<geek00L[at]gmail.com>
> 
> http://geek00l.blogspot.com
> http://defcraft.net

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist1.pair.net/pipermail/argus/attachments/20120910/9bdecac7/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 2589 bytes
Desc: not available
URL: <https://pairlist1.pair.net/pipermail/argus/attachments/20120910/9bdecac7/attachment.bin>