搜索关键词:crawler,共找到 350 个结果
排序方式:
当前按 更新时间 降序 排列

ioodev/elephscraper

ElephScraper is a lightweight and PHP-native web scraping toolkit built using Guzzle and Symfony DomCrawler. It provides a clean and powerful interface to extract HTML content, metadata, and structured data from any website.

版本:未知版本 下载:0 Stars:3 点击:10

时间:2026-06-24 12:22

dkm/typo3-robots-guard

Centrally manages robots.txt, the robots head meta tag and XML sitemap inclusion for any TYPO3 site (single-site or multisite), with environment-aware safety logic that guards production against accidental crawl-blocking while keeping staging/dev fully disallowed.

版本:未知版本 下载:3 Stars:0 点击:13

时间:2026-06-23 12:17

jooservices/xflickr-crawler

Standalone Laravel package for queued Flickr crawling with rate limiting and MySQL persistence.

版本:未知版本 下载:0 Stars:0 点击:10

时间:2026-06-22 12:55

zyan/u2p

网页图片抓取 SDK:输入网页链接,返回图片链接数组。内置微信公众号文章等专项抓取,支持 ajax 与源码两种图片加载方式。

版本:未知版本 下载:0 Stars:0 点击:12

时间:2026-06-18 16:15

zyan/v2d

一个标准的短视频 APP 视频/图文抓取 SDK,支持抖音、小红书、快手等平台。

版本:未知版本 下载:0 Stars:0 点击:11

时间:2026-06-18 11:34

monteduro/laravel-datafast-aicrawl

Server-side AI crawler & bot traffic tracking for Laravel, reporting to DataFast. Unofficial PHP port of @datafast/ai-crawl.

版本:未知版本 下载:0 Stars:0 点击:16

时间:2026-06-18 07:40

flowd/phirewall-preset-bots

Bot and AI-crawler control presets for the Phirewall PHP firewall - block AI scrapers and rate-limit aggressive SEO crawlers

版本:未知版本 下载:0 Stars:0 点击:17

时间:2026-06-17 20:34

udir-moodle/tool_crawler

Link crawler robot — Composer/Packagist mirror of the Moodle plugin tool_crawler, auto-updated from the Moodle plugins directory.

版本:未知版本 下载:0 Stars:0 点击:24

时间:2026-06-16 16:57

anvildev/craft-beacon

SEO and GEO for Craft 5 — meta, schema, redirects, llms.txt, AI crawler controls. API-first, with PHPBench-enforced performance budgets.

版本:未知版本 下载:0 Stars:0 点击:16

时间:2026-06-12 11:30

m2collective/laravel-crawler-detect

版本:未知版本 下载:13 Stars:0 点击:7

时间:2026-06-03 17:22

mkopcic/laravel-bot-protection

Laravel middleware za blokiranje AI crawlera i tražilica. Auto-registracija, konfigurabilan, podržava Laravel 10/11/12/13.

版本:未知版本 下载:14 Stars:1 点击:5

时间:2026-05-21 09:22

gtstudio/module-llmo

LLMO (Large Language Model Optimization) for Magento 2. ACP-style product feed, schema validation, AI crawler controls, AI-ready content fields, attribution and conversion tracking, campaign abstraction for AI ads, and an LLMO visibility dashboard.

版本:未知版本 下载:2 Stars:0 点击:14

时间:2026-05-15 13:55

changhorizon/crawler

Effortless recursive web crawling for comprehensive site indexing

版本:v0.2.2 下载:0 Stars:0 点击:21

时间:2026-05-11 21:38

anakin/sdk

Official PHP SDK for the Anakin web-scraping API. Scrape, crawl, search, and run Wire actions with internal job polling.

版本:未知版本 下载:0 Stars:0 点击:28

时间:2026-04-28 18:37

angeo/module-robots-txt-aeo

Magento 2 module for AI Engine Optimization (AEO). Injects AI crawler rules (OAI-SearchBot, GPTBot, ChatGPT-User, PerplexityBot, Perplexity-User, Google-Extended, ClaudeBot, anthropic-ai, Claude-User, Applebot, cohere-ai, Amazonbot, Meta-ExternalAgent) into robots.txt — without overwriting your exis

版本:未知版本 下载:7 Stars:4 点击:27

时间:2026-04-25 20:58

承接程序开发

PHP开发

VUE

Vue开发

前端开发

小程序开发

公众号开发

系统定制

数据库设计

云部署

网站建设

安全加固