nicojensen.de/robots.txt
Nico Jensen abdd659322 * Add: New Post: Update!
* Add: Changelog to README.md.
* Add: Social Media Links at Footer.
* Add: data.settings to manage settings.
* Fix: Linklog link did not work at blog overview.
* Fix: Pagination View - older was displayed on the left when no newer was there.
* Change: Header and Footer Navigation links work now with data yml files.
* Change: New Sort and some Content modification at Contact Page.
* Change: set sitemap false on 404 & 500 page.
* Change: new text on 404 & 500 page.
* Change: robots.txt now allow searchengines with settings.
* Change: some new meta tags
* Change: link style
* Change: remove Header Navigation
2021-06-15 03:31:51 +02:00

21 lines
No EOL
311 B
Text

---
layout: null
---
User-agent: *
{% if site.data.settings.allow-searchengine %}Disallow:
{% else %}Disallow: /
{% endif %}
User-agent: Uptimebot
Disallow: /
User-agent: *
Disallow:
User-agent: ia_archiver
Disallow: /
User-agent: Googlebot-Image
Disallow: /
Sitemap: https://www.nicojensen.de/sitemap.xml