This commit is contained in:
2025-10-02 00:46:56 +02:00
commit 7cc9e689a4
66 changed files with 2924 additions and 0 deletions

5
robots.txt Normal file
View File

@@ -0,0 +1,5 @@
User-agent: *
Disallow:
Crawl-Delay: 5
Request-rate: 18/1m 2100-0529
Request-rate: 6/1m 0530-2059