这是indexloc提供的服务，不要输入任何密码

Platformsfold toggle (up/down arrow)

SDKsfold toggle (up/down arrow)

Licensefold toggle (up/down arrow)

Advancedfold toggle (up/down arrow)

Results 2 packages
Sort by

tiktoken_tokenizer_gpt4o_o1copy "tiktoken_tokenizer_gpt4o_o1: ^1.2.1" to clipboard
tiktoken_tokenizer_gpt4o_o1: ^1.2.1 copied to clipboard

2
likes
140
points
124
downloads
OpenAI's Tiktoken tokenizer for models: GPT-4, GPT-4o, GPT-4o-mini, o1, o1-mini, and o1-preview.#tokenizer#openai#gpt#gpt-4o#tiktoken

v 1.2.1 (3 months ago)verified publisherglasberg.devBSD-2-ClauseDart 3 compatible

tiny_segmenter_dartcopy "tiny_segmenter_dart: ^1.0.1" to clipboard
tiny_segmenter_dart: ^1.0.1 copied to clipboard

1
likes
125
points
74
downloads
A compact Japanese text tokenizer for Dart. TinySegmenter is a Japanese word segmentation library based on the original JavaScript implementation by Taku Kudo.#japanese#text-processing#tokenizer#nlp#segmentation

v 1.0.1 (55 days ago)verified publisheriori.devunknownDart 3 compatible

Check our help page for details on search expressions and result ranking.