User-agent: Mediapartners-Google Disallow: User-agent: GPTBot Disallow: / User-Agent: * Disallow: /internal/* Host: https://selflib.me Sitemap: https://selflib.me/sitemap_index.xml Request-rate: 1/1 Crawl-Delay: 1 Clean-param: null&mature&epik&_sm_byp&targetUri&tran&mbstx&t_k