]> www.infradead.org Git - mtd-www.git/commit
projects / mtd-www.git / commit
summary | shortlog | log | commit | commitdiff | tree
(parent: 7f7e31b) | patch
robots.txt: block the archive subdir
authorRalph Siemsen <ralphs@netwinder.org>
Sat, 27 Nov 2021 02:27:49 +0000 (21:27 -0500)
committerDavid Oberhollenzer <david.oberhollenzer@sigma-star.at>
Mon, 29 Nov 2021 07:19:55 +0000 (08:19 +0100)
commitb64ac3ada938f8c288c0a7b6be43979fc448812f
treecda4aabff747672312c4df52146044ca44ca26e5tree
parent7f7e31bba80c77393ea4e944422105cbf46af558commit | diff
robots.txt: block the archive subdir

Add a robots.txt file (http://www.robotstxt.org/robotstxt.html) to block
web crawlers from indexing the old website archive.

Signed-off-by: Ralph Siemsen <ralphs@netwinder.org>
Signed-off-by: David Oberhollenzer <david.oberhollenzer@sigma-star.at>
robots.txt [new file with mode: 0644] blob
Unnamed repository; edit this file 'description' to name the repository.