Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ollama context length setting "num_ctx" for a very long text #61

Open
antonsapt4 opened this issue Sep 9, 2024 · 2 comments
Open

Ollama context length setting "num_ctx" for a very long text #61

antonsapt4 opened this issue Sep 9, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@antonsapt4
Copy link

Hi I just installed this great plugin, and looking if there are setting to for "num_ctx" because I seems cannot find it on the Brain sections.

Forgive me if its already present and if not, it might be a good additions because Ollama will use default value that make the context and prompt truncated. https://github.com/ollama/ollama/blob/main/docs/api.md

image

Thanks!

@SystemSculpt
Copy link
Owner

This isn't a feature yet, but I may add it. I'm really teetering on a fine line of trying my best not to overcomplicate things for users, but also allow for fine-tuning in cases such as your own. I'm going to keep this issue open to see if there's any interest from other people, as well as open for when I do the larger update of offering both a simplified, typical user-friendly version in combination with an expert mode that you can toggle on and mess with all of these more specific settings.

@SystemSculpt SystemSculpt added the enhancement New feature or request label Sep 13, 2024
@josh-stephens
Copy link

josh-stephens commented Sep 13, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants