Scrapes every available dataset from Socrata and stores them as newline-delimited JSON in this repository, to track changes over time through Git scraping.
socrata/data.delaware.gov.jsonlcontains the latest datasets for a specific domain. This is updated twice a day.
socrata/data.delaware.gov.stats.jsonlcontains information on page views and download numbers. This is updated once a week to avoid every single fetch including updated counts for many different datasets.
python scrape_socrata.py socrata/ to scrape the data from Socrata and save it in the
--stats to include page view and download statistics in separate files.
--verbose for verbose output.
Run this command to build a SQLite database from the
.jsonl files in
python build_socrata_db.py socrata.db socrata