Proxy Parser
About
Synchronous library, for convenient and fast parsing of proxies from different sources.
Uses Scrapy as a parser.
At the moment the library does not support automatic proxy check, this option will be added in the asynchronous version of the library.
Installation
Installing the latest version of the library:
pip install proxy-parse
Example
from proxy_parse import ProxyParser
proxy_parser = ProxyParser()
proxies_list = proxy_parser.parse()
If you need, you can add some parameters to the ProxyParser class:
- path_to_file – optional str parameter, the proxies will be saved to a file at the path
- proxy_limit – optional int parameter, the ProxyParser.parse function will return as many proxies as you need
- scrapy_spiders – optional scrapy.Spider list parameter, you can add your own spiders, which will work together with the others
- scrapy_settings – optional dict parameter, you can replace the library rules with your own
Contribution
Any changes from you will be good for the life of the library
