Automatically detect changes made to the official Telegram sites
This project is developed to automatically detect changes made to the official Telegram sites.
Simple Information Gathering Toolkit For Python
SIGIT - Simple Information Gathering Toolkit
Scraping Thailand COVID-19 data from the DDC's tableau dashboard
Scraping Thailand COVID-19 data from the DDC's tableau dashboard.
A Web Scraper built with beautiful soup that fetches udemy course information
A Web Scraper built with beautiful soup, that fetches udemy course information.
All in one Search Engine Scraper for used by API or Python Module
All in one Search Engine Scrapper for used by API or Python Module. It's Free & Lightweight!
A basic API to scrape Craigslist with python
A basic API to scrape Craigslist.
Anime Streams Scrapper for Telegram Publicly Available for everyone to use
Anime Streams Scrapper for Telegram Publicly Available for everyone to use
Scrapes an instagram user's photos and videos in python
instagram-scraper is a command-line application written in Python that scrapes and downloads an instagram user's photos and videos. Use responsibly.
Scraping and analysis of leetcode-compensations page
Scraping and analysis of leetcode-compensations page.
Using Selenium to Webscrape Data of Top Tech YouTubers
Using Selenium to Webscrape Youtube Tech Channels.
Console application for downloading images from Reddit in Python
Console application for downloading images from Reddit in Python
Crypto currencies scraping in python
A python script is running in a container, and scrape informations (using CoinGecko API) about crypto currencies.
Tool for Data Extraction and Web Requests
Tool for Data Extraction and Web Requests.
Python Crawler written Python 3
Python Crawler written Python 3. (Supports major Python releases Python3.6, Python3.7 and Python 3.8)
A large scale web crawler to take an overview about security of Moroccan sites
A large scale web crawler (considered also as vulnerability scanner tool) to take an overview about security of Moroccan sites
Collects all accepted codes submitted within the given timeframe of any contest
Collects all accepted (partial and full scored) codes submitted within the given timeframe of any contest.
A Python Scraper for Downloading Instagram Profile's Posts,stories and ProfilePic
A Python Instagram Scraper for Downloading Profile's Posts, stories, ProfilePic and See the Details of Particular Instagram Profile.
A web scrapers that feed the Los Angeles Times' California coronavirus tracker
The open-source web scrapers that feed the Los Angeles Times' California coronavirus tracker.
A scraping bot for windows to download all ACCEPTED submissions of any user on Codeforces
This is a python based web scraping bot for windows to download all ACCEPTED submissions of any user on Codeforces
A fast and expressive Craigslist API wrapper
A fast and expressive Craigslist API wrapper.
Current Antarctic large iceberg positions derived from ASCAT and OSCAT-2
Antarctic large iceberg positions derived from ASCAT and OSCAT-2. All data collected here are from the NASA SCP website
A python tool for scraping and organizing data from NewsBank API searches
This simple tool automates the process of copying, pasting, and organizing data from NewsBank API searches.
An in-progress web scraping project built with Python
A web scraping project that retrieves TV and movie data from two sources, then transforms and stores data in a MySQL database.
A tool to easily scrape youtube data using the Google API
To easily scrape any data from the youtube homepage, a youtube channel/user, search results, playlists, and a single video itself.
A social networking service scraper in Python
snscrape is a scraper for social networking services (SNS).
CNN implemented from scratch using Python and Numpy
CNN implemented from scratch using Python and Numpy.
Scrape all the media from an OnlyFans account with python
Scrape all the media from an OnlyFans account - Updated regularly.
A web crawler that extract everything of an URL
httpmapper is a web crawler made in Python.
Fault tolerant, stealthy, distributed web crawling with Pyppeteer
Distributed, Fault-Tolerant Web Crawling.
A command-line program to download media on OnlyFans
A command-line program to download media, like posts, and more from creators on OnlyFans.
A california coronavirus scrapers are written using Python
An experiment in open-sourcing the web scrapers that feed the Los Angeles Times' California coronavirus tracker.
A comprehensive Reddit scraping command-line tool written in Python
Universal Reddit Scraper - A comprehensive Reddit scraping command-line tool written in Python.
SpiderX allows you to stream movies by scraping links available on the internet
SpiderX allows you to watch movies by scraping data from the internet. This is android/ios client repo built with React native and Expo.
Python script to download subtitles for your movies
SBOX is a python script to download subtitles for your movies from SubDB database using their API.
Crawl and Visualize ICLR 2020 OpenReview Data
Script that crawls meta data from ICLR OpenReview webpage. Tutorials on installing and using Selenium and ChromeDriver on Ubuntu.
A easy to use web scraping library
gazpacho is a web scraping library. It replaces requests and BeautifulSoup for most projects. gazpacho is small, simple, fast, and consistent. You should use it!
A minimalistic Instagram scraper written in Python
scrapes medias, likes, followers, tags and all metadata. Inspired by instagram-php-scraper
A Python web scraping framework for intelligent use cases
The web is full of data. Transistor is a web scraping framework for collecting, storing, and using targeted data from structured web pages.
Crawl data from ICLR 2019 OpenReview webpage
Crawl and Visualize ICLR 2019 OpenReview Data.
A self-hosted tool which manages your YouTube subscriptions
A self-hosted tool which manages your YouTube subscriptions, and downloads files automatically.
High Performance Python Data driven programming framework for Web Crawler
High Performance Python Data driven programming framework for Web Crawler,ETL,Data pipeline work.
Draws relationships between crypto wallets using recursive crawling
Give it a blockchain based crypto wallet address and it will crawl 3 levels deep in transaction data to plot a graph out of the information.
A Terminal based program to follow live cricket score by scraping crickbuzz.com
Script requires Python3.5 Audio on wicket fallright now only works in Linux
Web crawling framework based on asyncio
Web crawling framework for everyone. Written with asyncio, uvloop and aiohttp.
A very alpha code to scrape javascript intensive web pages
CHeSF is the Chrome Headless Scraping Framework, a very very alpha code to scrape javascript intensive web pages
A single–page webapp all content served via JavaScript
SoundCloud is a single–page webapp (all content served via JavaScript).
A tiny web crawler in Python
A web crawler written in python.
An intelligent proxy pool for humanities only supports Python 3.6
An intelligent proxy pool for humanities, only supports Python 3.6.
A lightning fast web crawler which extracts URLs & endpoints from a target
Photon is a lightning fast web crawler which extracts URLs, files, intel & endpoints from a target.
pcap2curl - extract HTTP requests and turn them into cURL commands for replay
Read a packet capture, extract HTTP requests and turn them into cURL commands for replay.