rasqlinsert memory consumption

[Javier Almillategui]

Hi John, Carter,

we are seeing on average around five million distinct remote IP daily, and to give you an idea of the traffic load is about seven million connections on average per day.

best,

Javier

On Sep 29, 2010, at 2:17 PM, John Gerth wrote:

> I think Carter's question is concerned with how many distinct remote IP is class B talking to each day.
> 
> -- 
> John Gerth      gerth at cs.stanford.edu  Gates 378   (650) 725-3273  fax 723-0033
> 
> On 9/29/2010 11:14 AM, Javier Almillategui wrote:
>> we are seeing traffic from a B class address space (eg: 172.16.0.0/16).
>> 
>> best,
>> 
>> Javier
>> 
>> On Sep 29, 2010, at 1:31 PM, Carter Bullard wrote:
>> 
>>> Hey Javier,
>>> So going through the complete set of memory uses for rasqlinsert(), there are a number of
>>> caches that we manage that could be impacting your memory use.  Of particular interest are
>>> the IP address printing routines, that cache the actual string that you use to construct the
>>> SQL statement.  We cache them, thinking that most addresses are recurring.  I can add
>>> some logic to limit the memory use of this module, and age the entries if needed.
>>> 
>>> Do you have an idea of how many IP addresses you see in in a day?  Many sites are seeing
>>> around 1M , but if the IP addresses are an issue, then I'd think you would be seeing
>>> over 200M or so? 
>>> 
>>> Carter
>