rasql with gzipped files

carter at qosient.com carter at qosient.com
Wed Apr 21 08:30:02 EDT 2010


Yes, this is an issue.  Several ways of solving this but, hard to say they are all elegant.  If we think of uncompressed files as local cached files, then the solution could deal with remote files as well.

We can specify an ARGUS_SCRATCHPATH, and uncompress the file(s) as:

  ARGUS_SCRATCHPATH/hostname/SQL_FILENAME

 We can look here first and if not here do our fetching/decompression there.

Just need to reclaim the disk space at sometime.

Carter


------Original Message------
From: Terry Burton
Sender: argus-info-bounces+carter=qosient.com at lists.andrew.cmu.edu
To: Argus
Subject: [ARGUS] rasql with gzipped files
Sent: Apr 21, 2010 6:19 AM

Hi Carter,

I've hit a problem that when rasql reads gzipped files, it first
attempts to unzip the files into their own directory. In several
setups this results in permissions issues since the user running rasql
would require write access to the primitive flow data directories
which may not be desirable. It would be nice to be able to specify an
alternative location for the scratch space.


Thanks for your great work!

Terry



Sent from my Verizon Wireless BlackBerry


More information about the argus mailing list