Tanzania News API

News API consisting various sources from Tanzania.

Fork the project

Clone the project

git clone https://github.com/<username>/news-api.git

cd news-api

Setup to run locally

Create virtual environment

py -m venv .venv

Activate virtual environment

  • Windows

  • Bash

source .venv/bin/activate

Install required packages

Make sure you are in the right directory.

  • cd scraper

pip install -r requirements.txt

Setup a MongoDB and provide a connection string

# .env


Scrawl a particular website

ITV and Dar24 are sites with spiders available for now.

To scrape

scrapy crawl <spider-name>

Spider names

  • ITV – itv
  • Dar24 – dar24


View Github