Skip to content

Conversation

@aibrahim-oai
Copy link
Collaborator

@aibrahim-oai aibrahim-oai commented Dec 4, 2025

  • Remove model_family from config
  • Make sure to still override config elements related to model_family like supporting reasoning

pub model_reasoning_summary: ReasoningSummary,

/// Optional override to force-enable reasoning summaries for the configured model.
pub model_supports_reasoning_summaries: Option<bool>,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why add these now? Was there a way to override these before that you are removing?

Copy link
Collaborator Author

@aibrahim-oai aibrahim-oai Dec 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no there wasn't. my guess is there was at some point before introducing model family but it was a chaos so we weren't respecting them anymore.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry. yes it was updating model family in load_from_base_config_with_overrides which I thought it's only for tests per it's doc string but it's used to construct config

Self::load_from_base_config_with_overrides(cfg, overrides, codex_home)

let cell = new_reasoning_summary_block(
"**High level reasoning without closing".to_string(),
&config,
&models_manager,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you need to be passing this in?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can just pass model_family.reasoning_summary_format but I am not sure what is best here actually.

pub struct ModelClient {
config: Arc<Config>,
auth_manager: Option<Arc<AuthManager>>,
models_manager: Arc<ModelsManager>,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this seems wrong, why are we not passing model family here? Client lifetime is equal to turn lifetime as the model doesn't change.

parent_otel.with_model(config.model.as_str(), config.model_family.slug.as_str());
let child_otel = parent_otel.with_model(
config.model.as_str(),
models_manager
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't like how many places we are calling construct_model_family in. Ideally we'd be passing model_family around.

Copy link
Collaborator

@pakrym-oai pakrym-oai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we pass model_manager around less and model_family more?

@aibrahim-oai aibrahim-oai merged commit 9b20555 into main Dec 4, 2025
26 checks passed
@aibrahim-oai aibrahim-oai deleted the remove-model-family branch December 4, 2025 19:58
@github-actions github-actions bot locked and limited conversation to collaborators Dec 4, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants