Miguel Cabrerizo 3ca7147808
fix: introduce measures to avoid bots crawling and indexing activities (#5728)
* fix: 404 for robots.txt and meta robots tags

* fix: add unit tests for robots txt and tag

* fix: add meta tag robots none for login pages

* fix: weird format issue in header.go

* fix: add x-robots-tag=none to grpcwebserver

* fix linting

---------

Co-authored-by: Silvan <silvan.reusser@gmail.com>
Co-authored-by: Livio Spring <livio.a@gmail.com>
2023-05-05 10:25:02 +02:00
..
2023-01-25 13:08:01 +00:00
2023-04-28 14:39:53 +03:00
2023-04-25 09:02:29 +02:00
2022-04-26 23:01:45 +00:00
2023-04-26 19:55:13 +03:00
2023-03-24 15:18:56 +00:00
2023-04-26 19:55:13 +03:00
2023-05-02 19:24:24 +03:00
2020-03-27 13:57:16 +01:00
2023-04-26 19:55:13 +03:00
2022-04-26 23:01:45 +00:00