advanced-scrapy-proxies is a Python library for dealing with proxies in your Scrapy project. Starting from Aivarsk’s scrapy proxy (no more updated since 2018) i’m adding more features to manage lists of proxies generated dinamically. Installation Use the package manager pip to install advanced-scrapy-proxies. pip install advanced-scrapy-proxies Usage settings.py DOWNLOADER_MIDDLEWARES = { ‘scrapy.downloadermiddlewares.retry.RetryMiddleware’: 90, ‘advanced-scrapy-proxies.RandomProxy’: 100,…
