-
Notifications
You must be signed in to change notification settings - Fork 2.5k
feat(text_splitters): Add SemanticChunker splitter #7855
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
1 Skipped Deployment
|
Thanks for this! Will give it a look tomorrow. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry for the delay! Could you also please add some unit tests?
libs/langchain-community/src/experimental/text_splitters/semantic_chunker.ts
Outdated
Show resolved
Hide resolved
libs/langchain-community/src/experimental/text_splitters/semantic_chunker.ts
Outdated
Show resolved
Hide resolved
libs/langchain-community/src/experimental/text_splitters/semantic_chunker.ts
Outdated
Show resolved
Hide resolved
Thanks for the comments. All addressed. I'll work on unit tests next |
Anxiously awaiting the merge of this 😅 hit me up if you want me to take a crack at the unit tests! |
@jacoblee93 unit tests have been added. |
This PR adds the
SemanticChunker
Text Splitter from python to Javascript: https://github.com/langchain-ai/langchain-experimental/blob/main/libs/experimental/langchain_experimental/text_splitter.pyTwitter / X: CoDanny