θΏ™ζ˜―indexlocζδΎ›ηš„ζœεŠ‘οΌŒδΈθ¦θΎ“ε…₯任何密码
Skip to content

Conversation

@timothycarambat
Copy link
Member

Pull Request Type

  • ✨ feat
  • πŸ› fix
  • ♻️ refactor
  • πŸ’„ style
  • πŸ”¨ chore
  • πŸ“ docs

Relevant Issues

resolves #490

What is in this change?

Enable the modification of the Chunk length and overlap as performance can change depending on documents and use-case.

This is the set up for more configurations in the future. This is the first iterations of the process.

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

show max limit in UI and prevent overlap >= chunk size
@timothycarambat timothycarambat merged commit ce98ff4 into master Apr 6, 2024
@timothycarambat timothycarambat deleted the 490-text-chunking-config-v1 branch April 6, 2024 23:38
cabwds pushed a commit to cabwds/anything-llm that referenced this pull request Jul 3, 2025
* Enable customization of chunk length and overlap

* fix onboarding link
show max limit in UI and prevent overlap >= chunk size
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Chunking and Text Splitter customization

2 participants