包简介

Uni parser for sites

README 文档

README

Universal html parser which can parse every kind of html page

Installation

To install this plugin use composer:

$ composer require kosuha606/html-uni-parser

Usage

There is four available types of parsing html.

Example:

$results = HtmlUniParser::create([
    'pageUrl' => 'http://example.com',
    'xpathOnCard' => [
        'h1' => '//h1',
        'description' => 'HTML//p'
    ]
])->parseCard();

Examples

For more examples see the examples/ direcotry

Description of configurable properties

Property	Description
catalogUrl	The url address for parsing by catalog strategy `parseCatalog()`
searchUrl	The url what used to search on goal site. `parseSearch()`
pageUrl	The url what used to parse one page. `parseCard()`
urlGenerator	Callback function what can be used to generate links to parse `parseGenerator()`
encoding	The encoding of goal site
siteBaseUrl	Base url for process links after parse
resultLimit	Here you can limit the results count
sleepAfterRequest	Number of seconds to sleep after each request
goIntoCard	Wheather need to go into card when parse catalog links
xpathItem	Xpath query what can be used for parse items in list
xpathLink	Xpath query what can be used for parse link inside parsed item
xpathOnCard	Array of xpath queries, every key will be key in result array
typeMech	Type of parsing mechanizm, for example: `wget`, `curl`, `phantomjs`, `filegetcontents`
forceOuterHtml	Force parser to use outer html for xpaths

Available methods

Method	Description
parseCatalog	To parse catalog links and parse every link this function reutrn results as array of parsed links
parseSearch	This method takes an argument of query string for search page and after building search link it behave like parseCatalog
parseCard	To parse one page of site
parseGenerator	To parse links what was generated by urlGenerator callback

Run tests

To run tests you can use this command:

./vendor/bin/phpunit

kosuha606/html-uni-parser 适用场景与选型建议

kosuha606/html-uni-parser 是一款基于 PHP 开发的 Composer 扩展包，目前已累计 50 次下载、GitHub Stars 达 0，最近一次更新时间为 2019 年 06 月 23 日，在 PHP 生态内属于活跃度较高的组件。

我们在过去多个企业项目中使用过 kosuha606/html-uni-parser 或与其功能相近的方案，如果你在选型或落地过程中遇到问题，例如 版本兼容、二次改造、私有化封装、与内部系统对接、生产 BUG 排查，欢迎联系我们协助评估。

围绕 kosuha606/html-uni-parser 我们能提供哪些服务？

定制开发 / 二次开发

基于 kosuha606/html-uni-parser 在你已有业务上做功能扩展、字段裁剪、UI 适配、与内部账号 / 权限 / 日志系统的深度对接。

BUG 修复 & 性能优化

线上偶发问题、内存泄漏、慢查询、并发异常等排查修复；针对高流量场景做缓存、队列、索引层面的调优。

项目外包 & 长期维护

承接完整的项目从需求 → 设计 → 开发 → 上线 → 长期运维；也可按月提供技术保姆服务。

yvsm@zunyunkeji.com QQ：316430983 微信：yvsm316 西安尊云信息科技 · 专注 PHP / Go / 分布式系统研发

kosuha606/html-uni-parser

包简介