Skip to content

Commit

Permalink
Update: authors
Browse files Browse the repository at this point in the history
  • Loading branch information
SiddharthaAnand committed Oct 28, 2017
1 parent ed7487e commit d91eea8
Showing 1 changed file with 9 additions and 2 deletions.
11 changes: 9 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,9 +21,15 @@ This will clone this repository to your local system.
# How to run the code
Make sure you are in the directory of dblp-spider. Run the following command:
```
>>> scrapy crawl dblpspider [-o] [filename]
```

This will start the spider, send requests asynchronously and receive data and store the output (denoted by '-o' in the filename given by you.

For example:
```
>>> scrapy crawl dblpspider -o dblp_data.jl
```
This will start the spider, send requests asynchronously and receive data and store it in dblp_data.jl.

# Sample json data
This is the sample data that you might get after the crawl is over.
Expand All @@ -35,8 +41,9 @@ This is the sample data that you might get after the crawl is over.
...
```


# Authors
* [Khusbu Mishra](https://github.com/Khusbu)
* [Siddhartha Anand](https://github.com/SiddharthaAnand)

# Future enhancements
* Add a no-sql db to insert data
Expand Down

0 comments on commit d91eea8

Please sign in to comment.