verge_web_scrapper

This project Automates the process of reading contents from the website and storing it in a local CSV file and a SQLite Database.

website
theverge.com

Contents being fetched

column 1	column 2	column 3	column 4	column 5
id	Article URL	Headline	Author	Date

To run the automation script, just execute the following commands in the local machine:

• git clone <repo-url>

• cd theverge_web_scrapper

• pipenv install

• pipenv run python verge_scraper.py

Note: Use Python3.9 to avoid dependency conflicts