README

A Magento 2 module

This module allows you to easily control when web crawlers are allowed to index your catalog pages by modifying the robots meta tag.

Features

• Select one or more filterable attributes where indexing is allowed
• Control on which layout handles this is applied (defualts to catalog_category_view)
• Test mode - display current robots meta value and see currently applied filters

Brief description of logic

1. check if functionality is enabled
2. check if we are currently on a page where this logic is applied
3. check if the module is configured - if there are no allowed attributes to index the default behavior is not changed
4. if there is a sorting parameter applied, we set robots to NOINDEX,FOLLOW
5. check if there are more than 1 filters applied and set NOINDEX,NOFOLLOW in that case
6. iterate through applied filters and set
   1. NOINDEX,NOFOLLOW if the attribute is not indexable and more than 1 option is selected
   2. NOINDEX,FOLLOW if the attribute is not indexable and exactly 1 option is selected
   3. NOINDEX,FOLLOW if the attribute is indexable and more than 1 option is selected

Installation

Warning: You can only install this module with Composer 2.x. If you don't use Composer 2.x yet, read below.

composer require optiweb/module-robots
bin/magento module:enable Optiweb_Robots
bin/magento setup:upgrade
bin/magento setup:di:compile

If you don't use Composer 2.x yet, you can install this module in app/code.

1. Create directories: mkdir -p app/code/Optiweb/Robots && cd app/code/Optiweb/Robots
2. Clone the repository git clone https://git.optiweb.serv.si/ow-public/magento-2-robots-fix-module.git .
3. Enable module: bin/magento module:enable Optiweb_Robots
4. Compile code bin/magento setup:upgrade && bin/magento setup:di:compile

Configure module in Stores → Configuration → Catalog → Catalog Robots Settings

Changelog

• 1.0.0 - initial release
• 1.0.1 - readme updates, composer constraints updates

Known issues

There are currently no known issues

Compatibility

Developed on Magento 2.4.3 and tested on Magento 2.3. should work with all Magento 2 versions.

License

MIT - see LICENSE.txt