Bump text-splitter from 0.13.1 to 0.13.3

[dependabot]

Bumps text-splitter from 0.13.1 to 0.13.3.

Release notes

Sourced from text-splitter's releases.

v0.13.3

What's Changed

• Fixes broken PyPI publish because of a bad dev dependency specification

Full Changelog: benbrandt/text-splitter@v0.13.2...v0.13.3

v0.13.2 - CodeSplitter

What's Changed

New CodeSplitter for splitting code in any languages that tree-sitter grammars are available for. It should provide decent chunks, but please provide feedback if you notice any strange behavior.

Rust Usage

cargo add text-splitter --features code
cargo add tree-sitter-<language>

use text_splitter::CodeSplitter;
// Default implementation uses character count for chunk size.
// Can also use all of the same tokenizer implementations as `TextSplitter`.
let splitter = CodeSplitter::new(tree_sitter_rust::language(), 1000).expect("Invalid tree-sitter language");
let chunks = splitter.chunks("your code file");

Python Usage

from semantic_text_splitter import CodeSplitter
import tree_sitter_python
Default implementation uses character count for chunk size.
Can also use all of the same tokenizer implementations as TextSplitter.
splitter = CodeSplitter(tree_sitter_python.language(), capacity=1000)
chunks = splitter.chunks("your code file");

Full Changelog: benbrandt/text-splitter@v0.13.1...v0.13.2

Changelog

Sourced from text-splitter's changelog.

v0.13.3

Fixes broken PyPI publish because of a bad dev dependency specification.

v0.13.2

What's New

New CodeSplitter for splitting code in any languages that tree-sitter grammars are available for. It should provide decent chunks, but please provide feedback if you notice any strange behavior.

Rust Usage

cargo add text-splitter --features code
cargo add tree-sitter-<language>

use text_splitter::CodeSplitter;
// Default implementation uses character count for chunk size.
// Can also use all of the same tokenizer implementations as `TextSplitter`.
let splitter = CodeSplitter::new(tree_sitter_rust::language(), 1000).expect("Invalid tree-sitter language");
let chunks = splitter.chunks("your code file");

Python Usage

from semantic_text_splitter import CodeSplitter
import tree_sitter_python
Default implementation uses character count for chunk size.
Can also use all of the same tokenizer implementations as TextSplitter.
splitter = CodeSplitter(tree_sitter_python.language(), capacity=1000)
chunks = splitter.chunks("your code file");

Commits

• a3900eb v0.13.3 - Fix tree-sitter-python specification
• 04317e9 fix deps in CI
• 1b466ad Update documentation
• 9c589f5 Prep CodeSplitter Python bindings and release
• 27dfb79 Bump electron-to-chromium in /docs in the minor group
• 690812a Bump tokio from 1.37.0 to 1.38.0 in the minor group
• 0c0886f Bump the minor group in /docs with 2 updates
• fa29193 Bump the minor group with 4 updates
• 51a29d5 Bump the minor group in /docs with 4 updates
• c6a87d0 Bump the minor group in /docs with 2 updates
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)