nicojensen.de/robots.txt

---
layout: null
---
User-agent: *
{% if site.data.settings.allow-searchengine %}Disallow: 
{% else %}Disallow: /
{% endif %}

User-agent: Uptimebot
Disallow: /

User-agent: *
Disallow:

User-agent: ia_archiver
Disallow: /

User-agent: Googlebot-Image
Disallow: /

Sitemap: https://www.nicojensen.de/sitemap.xml
* Add: New Post: Update! * Add: Changelog to README.md. * Add: Social Media Links at Footer. * Add: data.settings to manage settings. * Fix: Linklog link did not work at blog overview. * Fix: Pagination View - older was displayed on the left when no newer was there. * Change: Header and Footer Navigation links work now with data yml files. * Change: New Sort and some Content modification at Contact Page. * Change: set sitemap false on 404 & 500 page. * Change: new text on 404 & 500 page. * Change: robots.txt now allow searchengines with settings. * Change: some new meta tags * Change: link style * Change: remove Header Navigation 2021-06-15 03:31:51 +02:00			`---`
			`layout: null`
			`---`
			`User-agent: *`
			`{% if site.data.settings.allow-searchengine %}Disallow:`
			`{% else %}Disallow: /`
			`{% endif %}`

robots and humans add robots and humans .txt 2019-03-25 13:57:13 +01:00			`User-agent: Uptimebot`
			`Disallow: /`

			`User-agent: *`
			`Disallow:`

			`User-agent: ia_archiver`
			`Disallow: /`

			`User-agent: Googlebot-Image`
			`Disallow: /`

			`Sitemap: https://www.nicojensen.de/sitemap.xml`