🚀 Release v0.3.1
This is a patch release to fix a bug with sequence-packing and a memory optimization in the softmax.
Please read about the major features in v0.3 on the release notes.
What's Changed
- cp:
fix: Enforce minimum packed sequence bin count and multiple of bin count (748)
intor0.3.1
by @chtruong814 in #759 - cp:
feat: avoid softmax deepcopy in logprobs (tpoisonooo) (761)
intor0.3.1
by @chtruong814 in #763 - chore: 0.3.0 -> 0.3.1 by @terrykong in #825
Full Changelog: v0.3.0...v0.3.1