Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make generation and chunker sections of configuration optional #166

Open
gkumbhat opened this issue Aug 19, 2024 · 1 comment
Open

Make generation and chunker sections of configuration optional #166

gkumbhat opened this issue Aug 19, 2024 · 1 comment
Labels
enhancement New feature or request

Comments

@gkumbhat
Copy link
Collaborator

gkumbhat commented Aug 19, 2024

Description

As a user of detection only / standalone detection endpoints, we want the ability to configure orchestrator with only detectors and potentially not even need chunkers (if users are using the default whole_doc_chunker provided with the orchestrator).

Detection only endpoints (i.e. those under Detection tasks here only work with detectors and do not require generation / calling out to a generation provider such as in config here), making the generation section of the configuration not entirely necessary.

@gkumbhat gkumbhat added the enhancement New feature or request label Aug 19, 2024
@evaline-ju evaline-ju changed the title Make generation and chunker section of configuration optional Make generation and chunker sections of configuration optional Aug 19, 2024
@evaline-ju
Copy link
Collaborator

Here, we may want to consider making conditionally enabled routes, based on the optional presence of providers, ref. from other work by @declark1 https://github.com/IBM/text-generation-router/blob/3bd9789b2a7039c9f84407903f7e177fcd8bf89f/fmaas-router/src/server.rs#L64-L75

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants