Skip to content

chore(deps): bump text-splitter from 0.29.3 to 0.32.0 - #35

Merged
dynamder merged 1 commit into
devfrom
dependabot/cargo/text-splitter-0.32.0
Sep 27, 2026
Merged

dynamder merged 1 commit into
devfrom
dependabot/cargo/text-splitter-0.32.0

Conversation

@dependabot

@dependabot dependabot Bot commented on behalf of github Sep 19, 2026 •

Copy link
Copy Markdown

Bumps text-splitter from 0.29.3 to 0.32.0.

Release notes

Sourced from text-splitter's releases.

v0.32.0

What's New

Python

  • Build abi3t wheels for free-threaded Python. benbrandt/text-splitter#1180
  • Release the GIL while loading Rust-backed tokenizers and running Rust-only chunking calls for TextSplitter, MarkdownSplitter, and CodeSplitter. Callback-backed splitters continue to hold the GIL while calling into Python. benbrandt/text-splitter#1183

Full Changelog: benbrandt/text-splitter@v0.31.0...v0.32.0

v0.31.0

Breaking Changes

  • Updated tokenizers to v0.23 and tiktoken-rs to v0.12. Some Hugging Face tokenizers include truncation settings, and tokenizers v0.23 may return the truncated size for those tokenizers instead of exposing overflow encodings. Disable truncation with tokenizer.with_truncation(None) before constructing a splitter if chunk sizes should reflect the full input text.

Full Changelog: benbrandt/text-splitter@v0.30.1...v0.31.0

v0.30.1

What's Changed

Full Changelog: benbrandt/text-splitter@v0.30.0...v0.30.1

v0.30.0

What's New

  • updated tiktoken-rs to v0.11

Rust

  • MSRV updated to 1.86.0

Full Changelog: benbrandt/text-splitter@v0.29.3...v0.30.0

Changelog

Sourced from text-splitter's changelog.

v0.32.0

What's New

  • Improve performance for documents that have very distant semantic boundaries.

Python

  • Build abi3t wheels for free-threaded Python.
  • Release the GIL while loading Rust-backed tokenizers and running Rust-only chunking calls for TextSplitter, MarkdownSplitter, and CodeSplitter. Callback-backed splitters continue to hold the GIL while calling into Python.

v0.31.0

Breaking Changes

  • Updated tokenizers to v0.23 and tiktoken-rs to v0.12. Some Hugging Face tokenizers include truncation settings, and tokenizers v0.23 may return the truncated size for those tokenizers instead of exposing overflow encodings. Disable truncation with tokenizer.with_truncation(None) before constructing a splitter if chunk sizes should reflect the full input text.

v0.30.1

Python

  • Fix missing Python release documentation

v0.30.0

What's New

  • updated tiktoken-rs to v0.11

Rust

  • MSRV updated to 1.86.0

v0.29.1

Python

  • Fix missing pyproject.toml

v0.29.0

What's New

  • Updated tiktoken-rs to v0.9
  • Updated tree-sitter to v0.26

... (truncated)

Commits
  • 8f2b263 update changelog
  • da32637 Avoid sizing whole distant split sections
  • accd67a Prep Release v0.32.0
  • 035e9c2 Release GIL during Python chunking calls
  • 4ee4619 Build abi3t and free-threaded Python wheels
  • 07a4e4d chore(deps): bump pyo3 from 0.28.3 to 0.29.0
  • 86a43dc chore(deps): bump the minor group across 1 directory with 6 updates
  • 0a03d80 chore(deps): bump taiki-e/install-action from 2.81.9 to 2.81.10
  • 822f059 chore(deps): bump the minor group with 4 updates
  • 4ee2c1a chore(deps): bump taiki-e/install-action from 2.81.8 to 2.81.9
  • Additional commits viewable in compare view

@dependabot dependabot Bot added dependencies Pull requests that update a dependency file rust Pull requests that update rust code labels Sep 19, 2026
@dynamder
dynamder changed the base branch from main to dev September 27, 2026 03:15
@dynamder

Copy link
Copy Markdown
Owner

@dependabot rebase

Bumps [text-splitter](https://github.com/benbrandt/text-splitter) from 0.29.3 to 0.32.0.
- [Release notes](https://github.com/benbrandt/text-splitter/releases)
- [Changelog](https://github.com/benbrandt/text-splitter/blob/main/CHANGELOG.md)
- [Commits](benbrandt/text-splitter@v0.29.3...v0.32.0)

---
updated-dependencies:
- dependency-name: text-splitter
  dependency-version: 0.32.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
@dependabot
dependabot Bot force-pushed the dependabot/cargo/text-splitter-0.32.0 branch from aa7ba3d to 3dd6498 Compare September 27, 2026 04:02
@dynamder
dynamder merged commit e1fb605 into dev Sep 27, 2026
8 checks passed
@dependabot
dependabot Bot deleted the dependabot/cargo/text-splitter-0.32.0 branch September 27, 2026 04:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file rust Pull requests that update rust code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant