Skip to content

Commit

Permalink
Update index.md
Browse files Browse the repository at this point in the history
  • Loading branch information
dirkeinecke committed Jul 19, 2018
1 parent da5275e commit 5356651
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion robots-txt/index.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,13 @@
---
title: robots.txt
---

## robots.txt

- [Alle Inhalte für alle User-Agents erlauben](alle-inhalte-fuer-alle-user-agents-erlauben)
- [Alle Inhalte für alle User-Agents verbieten](alle-inhalte-fuer-alle-user-agents-verbieten)

## Weiterführende Informationen
### Weiterführende Informationen

- [The Web Robots Pages](http://www.robotstxt.org/){:target="blank"}
- [Wikipedia: Robots Exclusion Standard](http://de.wikipedia.org/wiki/Robots_Exclusion_Standard){:target="blank"}

0 comments on commit 5356651

Please sign in to comment.