Skip to content

server : add slot_prompt_similarity getter/setter #22393

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
bernardladenthin wants to merge 2 commits into from
+13 −0
Closed

server : add slot_prompt_similarity getter/setter #22393

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
6737a7d
server : add slot_prompt_similarity getter/setter
bernardladenthin Apr 26, 2026
2e7a762
Merge branch 'master' into master
bernardladenthin Jun 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 8 additions & 0 deletions tools/server/server-context.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3972,6 +3972,14 @@ server_response_reader server_context::get_response_reader() {
return impl->get_response_reader();
}

float server_context::get_slot_prompt_similarity() const {
return impl->slot_prompt_similarity;
}

void server_context::set_slot_prompt_similarity(float value) {
impl->slot_prompt_similarity = value;
}

server_context_meta server_context::get_meta() const {
auto bos_id = llama_vocab_bos(impl->vocab);
auto eos_id = llama_vocab_eos(impl->vocab);
Expand Down
5 changes: 5 additions & 0 deletions tools/server/server-context.h
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -104,6 +104,11 @@ struct server_context {
// not thread-safe, should only be used from the main thread
server_context_meta get_meta() const;

// get/set the slot-prompt-similarity threshold for slot selection
// not thread-safe, should only be used from the main thread
float get_slot_prompt_similarity() const;
void set_slot_prompt_similarity(float value);

// note: must be set before load_model() is called
void set_state_callback(server_state_callback_t callback);
};
Expand Down