cxrxexo/tiktoken
PHP version of tiktoken. PHP 7.4+ required.
时间：2023-06-24 03:23
crazzy501/gpt-3-encoder-php
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php
时间：2023-06-06 11:09
nocika/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-04-20 15:46
everstu/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-04-12 03:07
gioni06/gpt3-tokenizer
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
时间：2023-01-17 08:19
interitty/tokenizer
Use regular expressions to split a given string into tokens.
时间：2022-08-26 14:09
attla/data-token
Turn everything into a token: randomized or predictable.
时间：2022-07-13 02:08
golding/dns-zone-tokenizer
tokenize dns zone files and that's all, folks.
时间：2022-05-19 11:11
turanjanin/serbian-language-tools
Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.
时间：2021-05-24 14:02
mistralys/jtokenizer
Modernized, composer compatible version of Tim Whitlock's JTokenizer PHP Javascript parser and tokenizer library.
时间：2021-03-12 07:20
infinityloop-dev/graphpinator-tokenizer
Tokenizer subproject for GraPHPinator: GraphQL server implementation for PHP.
时间：2020-11-20 17:12
scheldejonas/phpunit-php-token-stream
Wrapper around PHP's tokenizer extension.
时间：2020-11-12 13:30
fi1a/tokenizer
Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).
时间：2020-09-09 16:17
tacoberu/bnf
Framework for building BNF like parsers.
时间：2020-06-21 17:54
wpscholar/php-tokenizer
An experiment with using the PHP tokenizer functions.
时间：2020-03-17 14:35