Лидеры

Плюс мне в карму)

Как вариант User-agent: * Disallow: /*route=account/ Disallow: /*route=affiliate/ Disallow: /*route=checkout/ Disallow: /*route=common/ Disallow: /*route=product/compare Disallow: /*route=product/search Disallow: /*route=product/product*&manufacturer_id= Disallow: /catalog/controller Disallow: /catalog/language Disallow: /catalog/model Disallow: /download Disallow: /system Disallow: /search Disallow: */storage/ Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?order= Disallow: /*&order= Disallow: /*?limit= Disallow: /*&limit= Disallow: /*?filter= Disallow: /*&filter= Disallow: /*?filter_name= Disallow: /*&filter_name= Disallow: /*?filter_sub_category= Disallow: /*&filter_sub_category= Disallow: /*?filter_description= Disallow: /*&filter_description= Disallow: /*?tracking= Disallow: /*&tracking= Disallow: /*&tag=* Disallow: /*?tag=* Allow: *.css Allow: *.js Allow: *.jpg Allow: *.jpeg Allow: *.gif Allow: *.png Allow: *.svg Allow: *.webp Allow: *.ttf Allow: *.woff Allow: *.woff2 User-agent: Yandex Disallow: /*route=account/ Disallow: /*route=affiliate/ Disallow: /*route=checkout/ Disallow: /*route=common/ Disallow: /*route=product/compare Disallow: /*route=product/search Disallow: /*route=product/product*&manufacturer_id= Disallow: /catalog/controller Disallow: /catalog/language Disallow: /catalog/model Disallow: /download Disallow: /system Disallow: /search Disallow: */storage/ Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?order= Disallow: /*&order= Disallow: /*?limit= Disallow: /*&limit= Disallow: /*?filter= Disallow: /*&filter= Disallow: /*?filter_name= Disallow: /*&filter_name= Disallow: /*?filter_sub_category= Disallow: /*&filter_sub_category= Disallow: /*?filter_description= Disallow: /*&filter_description= Disallow: /*?tracking= Disallow: /*&tracking= Disallow: /*&tag=* Disallow: /*?tag=* Allow: *.css Allow: *.js Allow: *.jpg Allow: *.jpeg Allow: *.gif Allow: *.png Allow: *.svg Allow: *.webp Allow: *.ttf Allow: *.woff Allow: *.woff2 Sitemap: https:ваша ссылка на сайтмап С запретом индексации всем ботам кроме Яндекс и Гугл # Общие правила для всех разрешенных ботов User-agent: Googlebot User-agent: Googlebot-Image User-agent: Yandex User-agent: YandexBot User-agent: YandexImages Disallow: /*route=account/ Disallow: /*route=affiliate/ Disallow: /*route=checkout/ Disallow: /*route=common/ Disallow: /*route=product/compare Disallow: /*route=product/search Disallow: /*route=product/product*&manufacturer_id= Disallow: /catalog/controller Disallow: /catalog/language Disallow: /catalog/model Disallow: /download Disallow: /system Disallow: /search Disallow: */storage/ Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?order= Disallow: /*&order= Disallow: /*?limit= Disallow: /*&limit= Disallow: /*?filter= Disallow: /*&filter= Disallow: /*?filter_name= Disallow: /*&filter_name= Disallow: /*?filter_sub_category= Disallow: /*&filter_sub_category= Disallow: /*?filter_description= Disallow: /*&filter_description= Disallow: /*?tracking= Disallow: /*&tracking= Disallow: /*&tag=* Disallow: /*?tag=* # Разрешаем доступ к статическим файлам Allow: *.css Allow: *.js Allow: *.jpg Allow: *.jpeg Allow: *.gif Allow: *.png Allow: *.svg Allow: *.webp Allow: *.ttf Allow: *.woff Allow: *.woff2 # Закрываем доступ всем остальным ботам User-agent: * Disallow: / # Путь к карте сайта Sitemap: https://site.com/sitemap.xml

такой же, как и в оригинальном движке robots.txt - такая штука, которую каждый под себя правит, в зависимости от потребностей не нравится оригинал - используйте что-то типа такого User-agent: * Disallow: /*route=account/ Disallow: /*route=affiliate/ Disallow: /*route=checkout/ Disallow: /*route=product/compare Disallow: /*route=product/search Disallow: /*route=product/product*&manufacturer_id= Disallow: /admin Disallow: /catalog/controller Disallow: /catalog/language Disallow: /catalog/model Disallow: /download Disallow: /system Disallow: /search Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?order= Disallow: /*&order= Disallow: /*?limit= Disallow: /*&limit= Disallow: /*?filter= Disallow: /*&filter= Disallow: /*?filter_name= Disallow: /*&filter_name= Disallow: /*?filter_sub_category= Disallow: /*&filter_sub_category= Disallow: /*?filter_description= Disallow: /*&filter_description= Disallow: /*?tracking= Disallow: /*&tracking= Disallow: /*&tag=* Disallow: /*?tag=* Allow: *.css Allow: *.js Allow: *.jpg Allow: *.jpeg Allow: *.gif Allow: *.png Allow: *.svg Allow: *.webp Allow: *.ttf Allow: *.woff Allow: *.woff2