taurus-media/module-robots
Add filterable attributes to robots.txt in Magento 2
时间：2026-01-16 14:15
bopoda/robots-txt-parser
PHP Class for parsing robots.txt files according to Google, Yandex specifications.
时间：2026-01-04 18:45
vipnytt/robotstxtparser
Robots.txt parsing library, with full support for every directive and specification.
时间：2026-01-04 18:23
verschuur/laravel-robotstxt
Set the robots.txt content dynamically based on the Laravel app environment.
时间：2026-01-04 18:11
vipnytt/useragentparser
User-Agent parser for robot rule sets
时间：2026-01-04 18:07
eliashaeussler/typo3-sitemap-locator
Sitemap Locator - Looks up XML sitemaps as part of a configured site. Supports various sitemap providers, e.g. by configured page type or robots.txt, and allows to implement custom providers.
时间：2026-01-04 17:16
webignition/robots-txt-file
Models a robots.txt file
时间：2026-01-04 15:36
spatie/robots-txt
Determine if a page may be crawled from robots.txt and robots meta tags
时间：2026-01-04 10:12
anomaly/robots-extension
A simple robots.txt generator.
时间：2026-01-04 06:40
tomverran/robots-txt-checker
Given a robots.txt file, user agent and URL path will tell you whether you're allowed to access a page
时间：2026-01-04 06:07
t1gor/robots-txt-parser
PHP class to parse robots.txt rules according to Google, Yandex, W3C and The Web Robots Pages specifications.
时间：2026-01-04 04:33
marcortola/behat-seo-contexts
Behat extension for testing some On-Page SEO factors: meta title/description, canonical, hreflang, meta robots, robots.txt, redirects, sitemap validation, HTML validation, performance...
时间：2026-01-04 02:56
fkrzski/robots-txt
A modern, fluent PHP package for managing robots.txt rules with type safety and great developer experience
时间：2024-12-16 20:41
execut/yii2-robots-txt
Module for generate robots.txt file by url rules
时间：2016-07-13 13:23
vipnytt/sitemapparser
XML Sitemap parser class compliant with the Sitemaps.org protocol.
时间：2016-04-03 19:25