-
Docker
or
-
Python: >=3.6
-
Redis
-
Environment: Virtual Env
docker-compose up
Here are steps to run ProxyPool.
You need to install Redis locally or get a Redis server firstly.
Next set Redis environment:
export REDIS_HOST='localhost'
export REDIS_PORT=6379
export REDIS_PASSWORD='foobar'
Also you can just set the Redis Connection String:
export REDIS_CONNECTION_STRING='redis://[password]@host:port'
You can choose one method of above to set Redis environment.
https://github.com/Python3WebSpider/ProxyPool
cd ProxyPool
pip3 install -r requirements.txt
You can run all of the processors including Getter、Tester、 Server:
python3 run.py
or run with args to run specific processor:
python3 run.py --processor getter
python3 run.py --processor tester
python3 run.py --processor server
After running the ProxyPool, you can visit http://localhost:5555/random to access random proxy.