Skip to content

[Feature] [STUDIO] Custom Profiles that includes ALL settings #7347

Description

@rafpigna

Currently, the "Profiles" feature seems to focus on generation hyperparameters (Temperature, Top P, Top K....). It would be very useful to be able to save/restore profiles that also include technical loading settings such as Context Length and KV Cache Dtype. This would allow users to quickly switch between different configurations (e.g., "High VRAM mode" vs "Long Context mode").***

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestFeature request pending on roadmap

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions