scrapy 爬取网易国内新闻头条

简单用scrapy爬取网易国内新闻的头条标题和内容

运行spider里面的wangyinews.py

scrapy crawl wangyinews

下载的文件类型在pipelines里面设置

保存为wangyinews.json

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
__pycache__		__pycache__
spiders		spiders
.gitattributes		.gitattributes
README.md		README.md
__init__.py		__init__.py
biaotou.py		biaotou.py
items.py		items.py
middlewares.py		middlewares.py
pipelines.py		pipelines.py
settings.py		settings.py

Provide feedback