Skip to content

3.1.0

Choose a tag to compare

@umarbutler umarbutler released this 16 Feb 10:14
· 14 commits to main since this release

Added

  • Introduced a new cache_maxsize argument to chunkerify() and chunk() that specifies the maximum number of text-token count pairs that can be stored in a token counter's cache. The argument defaults to None, in which case the cache is unbounded.