In this post I’ll compare the running time of reading uncompressed and compressed files from disc. I’ll run a test using two files, data.txt (858M) and data.txt.gz (83M), that have the same content. About cat and zcat The well-known command…
Simple CSV file import You have a CSV file called “data.csv”. It has a header line, and is delimited using “;”. You want to import it into Postgres and a table called “your_table”: Create the database table. Set column-types so…
Assuming a shapefile called myshapefile.shp, a table mytable in schema xyz, in a PostGIS enabled database called mydb on localhost. The table is owned by user dbuser who has password “secret”. Using shp2pgsql shp2pgsql myshapefile -I xyz.mytable > statements.sql psql…
Download sourcecode Choose the appropriate sourcecode version by going to wget # or use curl
Nagios looks at 1) return codes and 2) output to stdout. This is the hello world of Nagios plugins, written in Python: check_helloworld.py: #!/usr/bin/env python # optparse is Python 2.3 – 2.6, deprecated in 2.7 # For 2.7+ use …
This howto shows how to get Nagios up and running on an Amazon EC2 Instance using Apache web server to serve the Nagios UI. You could argue that a more light-weight web server would be better, but I’d argue that…
Google Fusion Tables is a service for storing tabular data online. It has an API that allows you to make an SQL-like request for data from an online table, like the following: sql=SELECT * FROM 1906375 (clicking the link will…
Introduction to CORS CORS (Cross Origin Resource Sharing) is a mechanism specifies by W3C (draft), for allowing browsers to make cross origin requests for resources on other domains under certain conditions. It’s related to JSONP because it solves a similar…
I keep forgetting how to do this. How to group on a date column (date_col in the example) in Oracle: SELECT count(*) FROM table GROUP ON TO_CHAR(date_col, ‘DD-MON-YYYY HH:MI:SS’) For other format strings than ‘DD-MON-YYYY HH:MI:SS’ see this page.
There is a good little tool called s3funnel on GitHub for this. I used easy_install to install on my Mac. easy_install s3funnel