token27/nexus-ai-tokenizer
Provider-agnostic LLM token counter for PHP 8.3+. Supports Tiktoken BPE (OpenAI, Claude approx.), HuggingFace JSON vocabularies (DeepSeek, LLaMA, Mistral), SentencePiece (Gemini), and extensible custom strategies.
时间：2026-05-20 06:29
legacyphpdoctor/yethee_tiktoken-php-7-4
PHP version of tiktoken
时间：2026-02-15 23:52
mehrab-wj/tiktoken-php
a clone of python tiktoken but for PHP! fast BPE tokeniser for use with OpenAI's models.
时间：2026-01-04 17:45
codewithkyrian/tokenizers
Fast, pure-PHP tokenizer library compatible with Hugging Face tokenizers for encoding and decoding text
时间：2025-12-10 19:28
purewater2011/tiktoken-php7
PHP 7.4+ compatible version of tiktoken - OpenAI's tiktoken tokenizer ported to PHP
时间：2025-09-10 08:06
guttedgarden/tiktoken
PHP 7.4 version of tiktoken
时间：2023-10-13 12:43
danny50610/bpe-tokeniser
PHP port for openai/tiktoken (most)
时间：2023-08-19 13:46
textualization/ropherta-tokenizer
GPT3Tokenizer (BPE) with Roberta-base vocabulary.
时间：2023-08-08 13:24
crazzy501/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-07-17 12:33
cxrxexo/tiktoken
PHP version of tiktoken. PHP 7.4+ required.
时间：2023-06-24 03:23
crazzy501/gpt-3-encoder-php
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php
时间：2023-06-06 11:09