kickstarter datasets – Web Scraping Service https://webrobots.io We do web scraping service better! Mon, 04 Mar 2019 14:14:46 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.8 New Kickstarter Dataset https://webrobots.io/new-kickstarter-dataset/ https://webrobots.io/new-kickstarter-dataset/#comments Thu, 31 Dec 2015 08:16:20 +0000 https://webrobots.io/?p=5289

Recently we updated our Kickstarter robot to crawl project subcategories. This allows us to collect a richer dataset, for example on 2015-12-17 run robot collected data about 144,263 projects with a running time only 2 hours! We also started presenting it in the JSON streaming format which is just a line delimited JSON. Previously we used to stuff all projects into JSON array and the downside of it was that user would have to read the entire large JSON file into memory before any kind of processing starts. with JSON streaming it is possible to read one line at a time.

Data is posted in the usual place.

]]> https://webrobots.io/new-kickstarter-dataset/feed/ 2 Fresh Kickstarter Datasets https://webrobots.io/fresh-kickstarter-datasets/ https://webrobots.io/fresh-kickstarter-datasets/#respond Thu, 22 Oct 2015 13:57:35 +0000 http://webrobots.io/?p=5270

We have been swamped with work and have not updated our Kickstarter dataset page in while. To correct this today we posted new datasets retrieved in June, August and October. They are listed in the usual place: http://webrobots.io/kickstarter-datasets/

Enjoy!

Kickstarter dataset screenshot

]]> https://webrobots.io/fresh-kickstarter-datasets/feed/ 0