Miguel Cabrerizo 3ca7147808
fix: introduce measures to avoid bots crawling and indexing activities (#5728)
* fix: 404 for robots.txt and meta robots tags

* fix: add unit tests for robots txt and tag

* fix: add meta tag robots none for login pages

* fix: weird format issue in header.go

* fix: add x-robots-tag=none to grpcwebserver

* fix linting

---------

Co-authored-by: Silvan <silvan.reusser@gmail.com>
Co-authored-by: Livio Spring <livio.a@gmail.com>
2023-05-05 10:25:02 +02:00
..
2023-04-28 14:56:51 +00:00
2023-04-28 14:56:51 +00:00
2023-04-28 14:56:51 +00:00
2022-04-26 23:01:45 +00:00
2023-02-15 02:52:11 +01:00
2023-04-28 14:56:51 +00:00
2022-04-26 23:01:45 +00:00
2023-05-03 15:10:27 +02:00
2022-04-26 23:01:45 +00:00
2021-03-09 10:30:11 +01:00
2022-11-30 17:01:17 +01:00