New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature request: detect crawler #156

Closed

thelinuxlich opened this issue Dec 2, 2015 · 5 comments

Labels

Feature Request

thelinuxlich commented Dec 2, 2015

No description provided.

ChristianRich commented Dec 3, 2015

+1

faisalman added the Feature Request label

fresheneesz commented Dec 22, 2015

+1

2 similar comments

leozdgao commented Dec 24, 2015

+1

kucherenkovova commented Nov 23, 2016

+1

kucherenkovova mentioned this issue

Feature request: isBrowser #203

Closed

Owner

faisalman commented Jun 22, 2017

Move the discussion to #227

faisalman closed this as completed

faisalman added a commit that referenced this issue


          [extension] Add Axios, jsdom, Scrapy. Also fixes #627 #156 #217 #227

6e26e38

Axios: `axios/VERSION`
https://www.zenrows.com/blog/axios-user-agent#what-is-axios-user-agent

JSDOM: `Mozilla/5.0 (${process.platform || "unknown OS"}) AppleWebKit/537.36 (KHTML, like Gecko) jsdom/${jsdomVersion}`
https://github.com/jsdom/jsdom

Scrapy: `Scrapy/VERSION (+https://scrapy.org)`
https://docs.scrapy.org/en/master/topics/settings.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment