[0] http://go-colly.org/
By "not Colly" I just wanted to remark that in Go is relatively easy to write a crawler from scratch.
[0] http://go-colly.org/