Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize HybridRouter dependencies #514

Open
jamescalam opened this issue Jan 19, 2025 · 0 comments
Open

Optimize HybridRouter dependencies #514

jamescalam opened this issue Jan 19, 2025 · 0 comments
Assignees
Labels
enhancement Enhancement to existing features

Comments

@jamescalam
Copy link
Member

jamescalam commented Jan 19, 2025

I want us to work on dependencies for hybrid usage of SR, there are a few issues / things to optimize:

  • Fully drop pinecone-text library use, we should swap to our own local bm25 calculation or using alternative, more active, library that supports bm25 vectors.
  • Allow users to use HybridRouter without needing to install local hybrid dependencies. Right now a user must install semantic-router[hybrid] to use the HybridRouter. We should drop that requirement in favour allowing various dependencies to support hybrid (such as AurelioBM25Encoder or BM25Encoder, not both). I'd like to get support for sentence-transformer sparse encoders asap too, so just factor that future thing into development on this task.
@jamescalam jamescalam added the enhancement Enhancement to existing features label Jan 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Enhancement to existing features
Projects
None yet
Development

No branches or pull requests

2 participants