Ко всем сервисам
Tools/robots.txt Builder
robots.txt Builder
Build a clean, valid robots.txt without writing a single line by hand. Add user-agent groups, allow/disallow rules, multiple sitemaps and crawl-delay values through a visual editor. The output is ready to upload to the root of your site.
Setup
Editor
Add rule by path
Rule groups
User-agent:
Sitemap
Extra
1 |1 |0 |3 lines
No conflicts
robots.txt3 lines
1User-agent: *2Disallow:3