Skip to content

[DON'T MERGE] Test comment triggered CI#71

Closed
jiarong0907 wants to merge 5 commits intomainfrom
test-comment-ci
Closed

[DON'T MERGE] Test comment triggered CI#71
jiarong0907 wants to merge 5 commits intomainfrom
test-comment-ci

Conversation

@jiarong0907
Copy link
Contributor

No description provided.

@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/eval

@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

1 similar comment
@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

1 similar comment
@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

4 similar comments
@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

@yl231
Copy link
Contributor

yl231 commented Feb 15, 2026

/evaluate

@github-actions
Copy link

Router Evaluation Results

Router: vllm-sr
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.6723
Accuracy 66.53%
Total Cost $0.537873
Avg Cost per Query $0.000064
Avg Cost per 1K Queries $0.0640
Number of Queries 8400
Robustness Score 0.9071

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.9410
Opt.Cost (Cost Efficiency) 0.9012
Opt.Acc (Accuracy vs Optimal) 1.0000

Evaluation completed by RouterArena automated workflow

@jiarong0907
Copy link
Contributor Author

/evaluate

@github-actions
Copy link

Router Evaluation Results

Router: vllm-sr
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.6723
Accuracy 66.53%
Total Cost $0.537873
Avg Cost per Query $0.000064
Avg Cost per 1K Queries $0.0640
Number of Queries 8400
Robustness Score 0.9071

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.9410
Opt.Cost (Cost Efficiency) 0.9012
Opt.Acc (Accuracy vs Optimal) 1.0000

Evaluation completed by RouterArena automated workflow

@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907 jiarong0907 deleted the test-comment-ci branch February 16, 2026 05:39
@jiarong0907 jiarong0907 restored the test-comment-ci branch February 17, 2026 15:11
@jiarong0907 jiarong0907 reopened this Feb 17, 2026
@jiarong0907
Copy link
Contributor Author

/evaluate

2 similar comments
@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

@jiarong0907
Copy link
Contributor Author

/evaluate

@github-actions
Copy link

Router Evaluation Results

Router: vllm-sr
Dataset Split: full

RouterArena Metrics

Metric Value
RouterArena Score 0.6718
Accuracy 66.49%
Total Cost $0.537873
Avg Cost per Query $0.000064
Avg Cost per 1K Queries $0.0640
Number of Queries 8400
Robustness Score 0.9071

Optimality Metrics

Metric Value
Opt.Sel (Optimal Selection) 0.9410
Opt.Cost (Cost Efficiency) 0.9012
Opt.Acc (Accuracy vs Optimal) 1.0000

Evaluation completed by RouterArena automated workflow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments