Skip to content

ADFA-5187 | Dynamically size n_ctx based on model metadata and available RAM - #75

Open
jatezzz wants to merge 1 commit into
mainfrom
fix/ADFA-5187-dynamic-n-ctx
Open

ADFA-5187 | Dynamically size n_ctx based on model metadata and available RAM#75
jatezzz wants to merge 1 commit into
mainfrom
fix/ADFA-5187-dynamic-n-ctx

feat(ai-agent-local): size n_ctx per model and device

c1f8b38
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar