argus and 95th percentile
Carter Bullard
carter at qosient.com
Thu Mar 26 13:31:52 EDT 2009
Hey Rodney,
The new dist should have fixed Andrew's ncurses.3 compile issue.
Send any changes to the list, so I can get them into the ./lib/
argus.spec
if needed.
Carter
On Mar 25, 2009, at 9:47 PM, Rodney McKee wrote:
> Carter,
>
> Looks the goods.
> I've just been seeing the same issue as Alexander reported when
> building the client package. Just have not had a chance to look at
> it further.
>
> I've also been looking at the spec file for the server package and
> cleaned it up so I can generate my rpm's. Just need to test it on
> our RHEL 5 build server then I can send it through to you if you like.
>
> ----- "Carter Bullard" <carter at qosient.com> wrote:
> > Hey Rodney,
> I found a bug in the code for rabins() when testing out this new
> version
> of the clients that affects the examples that I sent earlier. Please
> grab
> the latest code before trying out these new features!!!!
>
> >
> ftp://qosient.com/dev/argus-3.0/argus-clients-3.0.2.beta.4.tar.gz
>
> >
> I added 95th percentile reporting to rahisto(), which is our
> frequency distribution
> tool. This tool calculates mean, stddev, max, min, and the median
> (50th
> percentile), and so it was very easy to add 95th percentile to the
> report.
>
> >
> You feed rahisto() the output of your 5 minute rabins() aggregations,
> and it will give you a little stats report of the specific variable,
> and
> a frequency distribution of where the data falls. If you don't know
> what
> the range is, run it with just a small number of bins, and rahisto()
> will start
> to show you where the data lies in its range.
>
> >
> Using the examples I used before:
>
> >
> rabins -M rmon hard time 5m -m smac -r hourly.file -w /tmp/
> data.out
>
> >
> Now, run rahisto() instead of rasort(), this way to generate your
> OutBound data
> for the specific ether address ('sload') :
>
> >
> rahisto -r /tmp/data.out -H sload 10 - ether src host
> 0:a0:c5:e1:7a:fa
> N = 31 mean = 80407.974516 stddev = 67795.873860 max =
> 174059.203125 min = 172.133331
> median = 82742.617188 95% = 173895.046875
> Class Interval Freq Rel.Freq Cum.Freq
> 1 0.000000e+00-1.740600e+04 12 38.7097% 38.7097%
> 2 1.740600e+04-3.481200e+04 0 0.0000% 38.7097%
> 3 3.481200e+04-5.221800e+04 3 9.6774% 48.3871%
> 4 5.221800e+04-6.962400e+04 1 3.2258% 51.6129%
> 5 6.962400e+04-8.703000e+04 1 3.2258% 54.8387%
> 6 8.703000e+04-1.044360e+05 0 0.0000% 54.8387%
> 7 1.044360e+05-1.218420e+05 1 3.2258% 58.0645%
> 8 1.218420e+05-1.392480e+05 3 9.6774% 67.7419%
> 9 1.392480e+05-1.566540e+05 4 12.9032% 80.6452%
> 10 1.566540e+05-1.740600e+05 6 19.3548% 100.0000%
>
> >
> And, run rahisto() this way to generate your InBound data for the
> specific ether address ('dload') :
>
> >
> rahisto -r /tmp/data.out -H dload 10 - ether src host
> 0:a0:c5:e1:7a:fa
> N = 31 mean = 2520065.831098 stddev = 2286667.779977 max =
> 5742157.000000 min = 335.946655
> median = 2935971.500000 95% = 5711441.500000
> Class Interval Freq Rel.Freq Cum.Freq
> 1 0.000000e+00-5.742160e+05 13 41.9355% 41.9355%
> 2 5.742160e+05-1.148432e+06 1 3.2258% 45.1613%
> 3 1.148432e+06-1.722648e+06 1 3.2258% 48.3871%
> 4 1.722648e+06-2.296864e+06 1 3.2258% 51.6129%
> 5 2.296864e+06-2.871080e+06 0 0.0000% 51.6129%
> 6 2.871080e+06-3.445296e+06 2 6.4516% 58.0645%
> 7 3.445296e+06-4.019512e+06 1 3.2258% 61.2903%
> 8 4.019512e+06-4.593728e+06 3 9.6774% 70.9677%
> 9 4.593728e+06-5.167944e+06 3 9.6774% 80.6452%
> 10 5.167944e+06-5.742160e+06 6 19.3548% 100.0000%
>
> >
>
> >
> The numbers are slightly different from the last time, because of
> the bug in rabins().
>
> >
> So you see, the data I'm using is multi-modally distributed, and
> while very low in samples,
> it does suggest an SLA for two tiers, one above 1M bps and one
> below 1M bps.
> You can calculate a 95th percentile for the two regions, by
> adjusting the range on the
> histogram option field like this (just do dload for this example):
>
> >
> Traffic Below 1M bps
> rahisto -r /tmp/rabins.5m.out -H dload 10:0-1M - ip and ether src
> host 0:a0:c5:e1:7a:fa
> N = 14 mean = 220514.849217 stddev = 168862.596105 max =
> 612549.625000 min = 335.946655
> median = 157696.734375 95% = 612549.625000
> Class Interval Freq Rel.Freq Cum.Freq
> 1 0.000000e+00-1.000000e+05 2 14.2857% 14.2857%
> 2 1.000000e+05-2.000000e+05 7 50.0000% 64.2857%
> 3 2.000000e+05-3.000000e+05 1 7.1429% 71.4286%
> 4 3.000000e+05-4.000000e+05 2 14.2857% 85.7143%
> 5 4.000000e+05-5.000000e+05 1 7.1429% 92.8571%
> 6 5.000000e+05-6.000000e+05 0 0.0000% 92.8571%
> 7 6.000000e+05-7.000000e+05 1 7.1429% 100.0000%
> 8 7.000000e+05-8.000000e+05 0 0.0000% 100.0000%
> 9 8.000000e+05-9.000000e+05 0 0.0000% 100.0000%
> 10 9.000000e+05-1.000000e+06 0 0.0000% 100.0000%
>
> >
> Traffic Above 1M bps
> rahisto -r /tmp/rabins.5m.out -H dload 10:1-6M - ip and ether src
> host 0:a0:c5:e1:7a:fa
> N = 17 mean = 4413813.698529 stddev = 1253167.017151 max =
> 5742157.000000 min = 1717778.125000
> median = 4992350.500000 95% = 5742157.000000
> Class Interval Freq Rel.Freq Cum.Freq
> 1 1.000000e+06-1.500000e+06 0 0.0000% 0.0000%
> 2 1.500000e+06-2.000000e+06 2 11.7647% 11.7647%
> 3 2.000000e+06-2.500000e+06 0 0.0000% 11.7647%
> 4 2.500000e+06-3.000000e+06 1 5.8824% 17.6471%
> 5 3.000000e+06-3.500000e+06 1 5.8824% 23.5294%
> 6 3.500000e+06-4.000000e+06 1 5.8824% 29.4118%
> 7 4.000000e+06-4.500000e+06 1 5.8824% 35.2941%
> 8 4.500000e+06-5.000000e+06 4 23.5294% 58.8235%
> 9 5.000000e+06-5.500000e+06 3 17.6471% 76.4706%
> 10 5.500000e+06-6.000000e+06 4 23.5294% 100.0000%
>
> >
> Hope this is helpful,
>
> >
> Carter
>
> >
> On Mar 23, 2009, at 3:16 PM, Rodney McKee wrote:
>
> > Carter,
> >
> > The value I'm after is based on 5 minute samples of user uploads
> (inbound traffic) that are sorted highest to lowest then the value
> at the 95th percent point is then used for our volume calculation.
> Is their a way to pull the 5 minutes samples like "ragraph -M 5m"
> using the text "ra" tools?
> > I just see the rrdgraph is able to do it but not sure yet how to
> use it.
> >
> > More info on the billing scheme here:
> > http://en.wikipedia.org/wiki/Burstable_billing
> >
> >
>
> --
>
>
>
> Rodney McKee
> Linux systems administrator
> Aconex
> The easy way to save time and money on your project
>
> 696 Bourke Street, Melbourne
> Tel: +61 3 9240 0200 Fax: +61 3 9240 0299
> Email: rmckee at aconex.com www.aconex.com
>
>
> This email and any attachments are intended solely for the
> addressee. The contents may be privileged, confidential and/or
> subject to copyright or other applicable law.
> No confidentiality or privilege is lost by an erroneous
> transmission. If you have received this e-mail in error, please let
> us know by reply e-mail and delete or destroy
> this mail and all copies. If you are not the intended recipient of
> this message you must not disseminate, copy or take any action in
> reliance on it. The sender takes no
> responsibility for the effect of this message upon the recipient's
> computer system.
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
Carter Bullard
CEO/President
QoSient, LLC
150 E 57th Street Suite 12D
New York, New York 10022
+1 212 588-9133 Phone
+1 212 588-9134 Fax
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://pairlist1.pair.net/pipermail/argus/attachments/20090326/c6d51a08/attachment.html>
More information about the argus
mailing list