Posts in: September, 2014


Deploying scrapy on EC2

Welcome to part 3 of my guide to using AWS for scraping.

If you haven’t already make sure you check the first two parts, here and here. We’re going to continue using the same EC2 instance you created in part two.

Some assumptions before we begin

I’m going to assume a

Read More


Installing scrapy and scrapyd on AWS EC2

See the updated version for installing scrapy 1.0 and above here.

This post will cover the basics of getting started with Amazon AWS, creating an account, creating an EC2 instance, installing scrapy and scrapyd and finally making sure you do it all for free!

Getting Started

Keeping It Free!

Before you go any

Read More


Russian in 4 months

I thought I’d start blogging about my endeavours to learn Russian to keep track of my progress and to list any resources or tips I find along the way. I’ve set myself a deadline, realistic or not, of being able to hold a simple conversation by the end of this

Read More

Spark 1.1.0 released

Spark continues it’s rapid release cycle with the first minor update to the 1.x release branch. This release brings operational and performance improvements in Spark core along with significant extensions to Spark’s newest libraries: MLlib and Spark SQL. It also builds out Spark’s Python support and adds new components to the

Read More

Whatsapp DB SQL

On the iPhone Whatsapp data is stored in a simple sqlite database that can be accessed from a backup and can be queried very easily, here’s a simple query to return messages with the time converted.


Read More