/ Web Crawling & Web Scraping

SpiderX allows you to stream movies by scraping links available on the internet

SpiderX allows you to stream movies by scraping links available on the internet

SpiderX Native

SpiderX allows you to watch movies by scraping data from the internet. This is android/ios client repo built with React native and Expo.

How it works

  1. The user searches will be first sent to firestore, if the search is not found in the firestore then the scraper (python scrapy framework) will be called to initiate the scraping process.
  2. Once the scraper scrapes the data, the data scraped will be sent to firestore.
  3. Using firestore real-time updates, the vue interface will be updated in real-time.

Features

  1. Get trending movies
  2. Get tob imdb movies
  3. List movies by genres
  4. Trailers for those movies
  5. Get info about the movie

Running Locally

This app is built with expo, so you need to install the expo cli package globally in your system.

npm i -g expo-cli

You also need to setup a firebase project and the url to your python scraper (I am using heroku for hosting the scraper)

Create a .env file at the root of the project that looks like this:

# the url to your python scraper
SPIDERX_HEROKU=<YOUR_URL_HERE>

# firebase web configuration (you need to first create a firebase project)
APIKEY=<APIKEY_HERE>
AUTHDOMAIN=<AUTHDOMAIN_HERE>
DATABASEURL=<DATABASEURL_HERE>
PROJECTID=<PROJECTID_HERE>
STORAGEBUCKET=<STORAGEBUCKET_HERE>
MESSAGESENDERID=<MESSAGESENDERID_HERE>
APPID=<APPID_HERE>
MEASUREMENTID=<MEASUREMENTID_HERE>

Then clone this repo, install the dependencies and run expo start

git clone https://github.com/manikandanraji/spiderx-native
cd spiderx-native
npm i
expo start

Watch the Demo

UI

Authentication

auth

Home, Search, Imdb

home_search_imdb

Favorites, Search Result, Movie Info

favorites_search_result_movie_details

GitHub

Comments