Skip to content

Issues: fooock/robots.txt

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Use HTTP headers to control host rule expiration
#5 opened Jun 30, 2019 by fooock updated Jul 24, 2019
Limit container resources
#22 opened Jul 19, 2019 by fooock updated Jul 19, 2019
Auth based in JWT
#20 opened Jul 15, 2019 by fooock updated Jul 15, 2019
Rate limit for the checker API
#19 opened Jul 11, 2019 by fooock updated Jul 11, 2019
Strategy to crawl robots from ftp scheme
#13 opened Jul 5, 2019 by fooock updated Jul 5, 2019
Check disallow typos?
#8 opened Jul 2, 2019 by fooock updated Jul 2, 2019
Implement robots.txt download priority system enhancement New feature or request
#4 opened Jun 30, 2019 by fooock updated Jun 30, 2019
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.