knap channel
A byte level BPE tokenizer written in pure Mojo, with no Python interpreter at run time.
A binary package from the modular-community channel โ latest version 1.0.0. Maintained by olaflaitinen. Repository / details: olaflaitinen/knap.
โญ 4 ยท last commit 15d ago ยท 0 commits last month ยท 75 last year
Install โ pick one
with the shelf extension
pixi shelf add knap
or plain pixi (channel in your channel list)
pixi add knap
Dependencies are resolved by conda โ no registry pinning; your
pixi.lock records the solved version. Note: channel packages
carry their own mojo-compiler requirement, which may conflict
with a workspace pinned to a different Mojo era โ the solver reports it if
so.