Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

index: split long paragraph under third level heading in markdown #221

Closed
Tracked by #566
sykp241095 opened this issue Aug 12, 2024 · 0 comments · Fixed by #623
Closed
Tracked by #566

index: split long paragraph under third level heading in markdown #221

sykp241095 opened this issue Aug 12, 2024 · 0 comments · Fixed by #623
Assignees
@Mini256 @wd0517
Labels
area/index-building
Milestone
Release v0.5.0

Comments

@sykp241095
Copy link
Member

sykp241095 commented Aug 12, 2024 •
edited by Mini256
Loading

autoflow/backend/app/rag/build_index.py

Line 51 in 8a3bddb

# spliter = MarkdownNodeParser()

@Mini256 Mini256 changed the title connector: split large paragraph into small pieces while chunking Markdown file parser: split long paragraph under third level heading in markdown Aug 12, 2024
@sykp241095 sykp241095 changed the title file parser: split long paragraph under third level heading in markdown index: split long paragraph under third level heading in markdown Oct 29, 2024
@sykp241095 sykp241095 assigned wd0517 and unassigned Mini256 Dec 2, 2024
@Mini256 Mini256 reopened this Dec 4, 2024
@Mini256 Mini256 added this to the Release v0.3.1 milestone Dec 4, 2024
@Mini256 Mini256 self-assigned this Dec 4, 2024
@Mini256 Mini256 mentioned this issue Jan 6, 2025
Open
4 tasks
@Mini256 Mini256 mentioned this issue Feb 14, 2025
Merged
Mini256 added a commit that referenced this issue Feb 17, 2025
@Mini256
feat: support configure chunking setting on knowledge base API (#623)
51ef131 
close #221
part of #527
NG85 pushed a commit to NG85/autoflow that referenced this issue Feb 18, 2025
@Mini256 @NG85
feat: support configure chunking setting on knowledge base API (pingc…
fc4ec42 
…ap#623)

close pingcap#221
part of pingcap#527
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Mini256 Mini256

@wd0517 wd0517

Labels
area/index-building
Projects
None yet
Milestone
Release v0.5.0
Development

Successfully merging a pull request may close this issue.

feat: support configure chunking setting on knowledge base API pingcap/autoflow
3 participants
@sykp241095 @Mini256 @wd0517