Miguel Cabrerizo 3ca7147808 fix: introduce measures to avoid bots crawling and indexing activities (#5728) ... * fix: 404 for robots.txt and meta robots tags * fix: add unit tests for robots txt and tag * fix: add meta tag robots none for login pages * fix: weird format issue in header.go * fix: add x-robots-tag=none to grpcwebserver * fix linting --------- Co-authored-by: Silvan <silvan.reusser@gmail.com> Co-authored-by: Livio Spring <livio.a@gmail.com>		2023-05-05 10:25:02 +02:00
..
robots_txt_test.go	fix: introduce measures to avoid bots crawling and indexing activities (#5728)	2023-05-05 10:25:02 +02:00
robots_txt.go	fix: introduce measures to avoid bots crawling and indexing activities (#5728)	2023-05-05 10:25:02 +02:00