Data sets tagged with "crawl"

From: http://github.com/petewarden/crunchcrawl This module lets you index and download the company information held in Crunchbase. Included is also the full scrape of the data.Before using, double-check http://www.crunchbase.com/robots.txt and the API conditions to ensure you’re obeying the terms-of-service It contains various scripts to index and pull down the latest ...