In this example I had a big log file (many million lines), that I wanted to split into smaller logfiles (each one million lines) for processing on Elastic MapReduce. -rw-r–r– 1 kostas staff 543067012012 Oct 11 13:45 huge_logfile This is…
Completely off topic. Just a thought, is this what China will look like in a few years? A country of old people, governed by the children of the one-child policy era… Wonder how that will affect the current financial situation…
Previous effort In a previous post I tried generating OpenStreetMap tiles using GeoServer. It ended when I couldn’t find a good style (SLD) to apply the OSM layer. The (new) idea, that also failed miserably In this post I tried…
There is a good little tool called s3funnel on GitHub for this. I used easy_install to install on my Mac. easy_install s3funnel
E.g. to select rows with a timestamp on minutes 0, 5, 10, …, 55 select * from t where mod(to_number(to_char(date_time_col, ‘mi’)),5)=0
For m=10 and n=100 add the following where clause WHERE mod(rownum, 100)
One way to check whether a library is installed is to use ld, e.g. check that zlib is installed: ld -lzlib If library is installed you’ll get something like this: ld: warning: -arch not specified ld: could not find entry…
The trick is to use vmstat and look at the number for “wait on acknowledge”. vmstat -S m 1 100 Look under “cpu” and the “wa” column. If this number is high, it is bad. It should be zero. Some…
Warning: This is a description of how to create a OpenStreetMap WMS with GeoServer. It works fine up to the point where the layers published as an unstyled WMS. This is where I’ve not been able to produce a good…
Say you have a static JSON file sitting on a web server, e.g. mystaticfiles.com on Amazon S3 or a CDN. For the sake of argument, let’s imagine that it’s a configuration file. The contents of the file looks like this:…