Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Support Elasticsearch as memory vectorDB #1040

Draft
wants to merge 9 commits into
base: develop
Choose a base branch
from

Conversation

dej611
Copy link

@dej611 dej611 commented Feb 27, 2025

Description

This is an attempt to add an adapter for the memory storage in order to let the user configure a different vectorDB than the bundled Qdrant one.
I have 0 experience with python, so sorry about silly mistakes in this PR.

My idea was to start with something simple like configure it via .env file and the transition for the final user should be completely transparent.
I guess a setting UI would be a nicer experience here, keeping the API_KEY approach.

Features planned:

  • ability to configure an ES host
    • Test it with a local instance (HOST + PORT + API_KEY)
  • support cloud instance
    • Test it with a cloud instance (CLOUD_ID + API_KEY)
  • abstract the VectorMemory logic with an adapter
    • remap all the collection logic into ES-specific logic
    • provide lean adapters for ES results
    • provide basic knn search
    • handle the switch embedder scenario
    • implement dump logic

Related to issue #1039

Type of change

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update

Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant