duzun/hquery
An extremely fast web scraper that parses megabytes of HTML in a blink of an eye. No dependencies. PHP5+
时间：2026-01-04 17:10
anassrojea/laracrawler
Laravel sitemap generator and crawler package for SEO optimization. Supports multilingual sites, image/video indexing, link validation, priority scoring, and advanced crawling automation.
时间：2025-09-23 23:36
jvmtech/warmupcache
Wormup Neos CMS full static cache or fusion caches by crawling selected urls or websites.
时间：2024-04-25 12:45
crwlr/crawler-ext-browser
Extension for the crwlr/crawler package containing steps utilizing a headless browser.
时间：2024-02-06 22:20
dexiio/dexi-api-client
Dexi API Client for PHP 5.3+
时间：2016-11-22 17:55
cyber-duck/silverstripe-seo
A SilverStripe module to optimise the Meta, crawling, indexing, and sharing of your website content
时间：2016-08-26 11:19
fourlabs/robots-bundle
Symfony2 bundle to control X-Robots-Tag HTTP header via annotations
时间：2015-08-27 16:52
stil/curl-easy
cURL wrapper for PHP. Supports parallel and non-blocking requests. For high speed crawling, see stil/curl-robot.
时间：未知
crwlr/robots-txt
Robots Exclusion Standard/Protocol Parser for Web Crawling/Scraping
时间：未知