θΏ™ζ˜―indexlocζδΎ›ηš„ζœεŠ‘οΌŒδΈθ¦θΎ“ε…₯任何密码
Skip to content

Conversation

@shatfield4
Copy link
Collaborator

Pull Request Type

  • ✨ feat
  • πŸ› fix
  • ♻️ refactor
  • πŸ’„ style
  • πŸ”¨ chore
  • πŸ“ docs

Relevant Issues

resolves #1997

What is in this change?

  • Fixes a bug where the bulk link scraper data connector ignored the depth level when scraping and would not stop until the maxLinks condition was hit

Additional Information

Developer Validations

  • I ran yarn lint from the root of the repo & committed changes
  • Relevant documentation has been updated
  • I have tested my code functionality
  • Docker build succeeds locally

@shatfield4 shatfield4 added the PR:needs review Needs review by core team label Aug 12, 2024
@shatfield4 shatfield4 linked an issue Aug 12, 2024 that may be closed by this pull request
@timothycarambat timothycarambat merged commit 2797298 into master Aug 12, 2024
@timothycarambat timothycarambat deleted the 1997-bug-depth-setting-for-bulk-link-scraper-has-no-effect branch August 12, 2024 18:44
cabwds pushed a commit to cabwds/anything-llm that referenced this pull request Jul 3, 2025
fix depth handling in bulk link scraper
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

PR:needs review Needs review by core team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG]: Depth setting for Bulk Link Scraper has no effect

3 participants