Welcome to Pyomo's performance test results portal!
Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).
Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.
Last update: Jan-21-2026 23:18
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.19σ | 0.733σ | 0.0531σ | ||||
| TestMisc_test_bilinear_100 | 1.52σ | 0.534σ | 0.506σ | 0.691σ | 0.754σ | ||
| TestMisc_test_bilinear_100000 | 0.85σ | 0.508σ | 0.0738σ | 0.583σ | 0.672σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.38σ | 0.917σ | 0.85σ | 0.899σ | 0.881σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.0907σ | 0.711σ | 1.08σ | 0.819σ | 0.485σ | ||
| TestMisc_test_diag_quicksum_100 | 0.599σ | 0.782σ | 0.629σ | 0.741σ | 0.847σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.636σ | 0.571σ | 0.952σ | 1.01σ | 1.49σ | ||
| TestMisc_test_diag_sum_100 | 1.11σ | 1.01σ | 1.01σ | 1.05σ | 1.04σ | ||
| TestMisc_test_diag_sum_100000 | 0.954σ | 1.0σ | 0.915σ | 1.09σ | 1.17σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.33σ | 0.418σ | 0.918σ | 0.644σ | 0.863σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.972σ | 0.986σ | 1.06σ | 0.911σ | 0.907σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.839σ | 0.911σ | 0.899σ | 0.967σ | 0.864σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.863σ | 0.949σ | 1.1σ | 0.846σ | 0.919σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.898σ | 0.868σ | 0.937σ | 0.819σ | 0.868σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.862σ | 0.805σ | 0.953σ | 0.907σ | 0.953σ | ||
| TestJump_test_clnlbean_5000 | 0.907σ | 0.948σ | 0.859σ | ||||
| TestJump_test_clnlbean_50000 | 0.903σ | 0.89σ | 0.864σ | ||||
| TestJump_test_facility_25 | 0.848σ | 0.971σ | 0.867σ | 0.993σ | 0.855σ | ||
| TestJump_test_facility_5 | 1.5σ | 1.27σ | 0.902σ | 1.06σ | 0.825σ | ||
| TestJump_test_facility_quicksum_25 | 0.846σ | 0.843σ | 0.877σ | 0.888σ | 0.866σ | ||
| TestJump_test_facility_quicksum_5 | 1.05σ | 1.2σ | 0.964σ | 0.921σ | 0.858σ | ||
| TestJump_test_lqcp_10 | 0.97σ | 1.05σ | 1.21σ | 1.05σ | 1.06σ | ||
| TestJump_test_lqcp_500 | 0.403σ | 0.0958σ | 0.949σ | 0.871σ | 0.883σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.41σ | 1.12σ | 1.05σ | 0.969σ | 1.08σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.09σ | 0.911σ | 0.998σ | 0.828σ | 0.887σ | ||
| TestJump_test_opf_662 | 0.989σ | 0.831σ | 0.906σ | ||||
| TestJump_test_opf_6620 | 1.15σ | 0.861σ | 0.96σ | ||||
| TestJump_test_opf_quicksum_662 | 0.948σ | 0.836σ | 0.878σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.11σ | 0.871σ | 0.952σ | ||||
| TestDevel_test_issue_691 | 1.18σ | 0.605σ | 1.03σ | 1.0σ | 0.971σ | ||
| TestModels_test_dcopf_case2383wp | 1.09σ | 0.911σ | 0.863σ | 0.64σ | 0.97σ | ||
| TestModels_test_uc_20140901_expected | 0.893σ | 0.854σ | 0.872σ | 0.851σ | 0.949σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.168σ | 0.0773σ | 0.0848σ | ||||
| TestMisc_test_bilinear_100 | 0.237σ | -0.218σ | -0.331σ | -0.138σ | -0.125σ | ||
| TestMisc_test_bilinear_100000 | 0.0459σ | 0.052σ | 0.00699σ | 0.0232σ | 0.0862σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.49σ | -0.353σ | -0.556σ | -0.46σ | -0.354σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.542σ | 0.127σ | 0.173σ | 0.0475σ | 0.179σ | ||
| TestMisc_test_diag_quicksum_100 | 0.68σ | -0.234σ | -0.255σ | -0.307σ | -0.125σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.174σ | 0.0978σ | 0.153σ | 0.0812σ | 0.169σ | ||
| TestMisc_test_diag_sum_100 | 0.27σ | -0.285σ | -0.246σ | -0.255σ | -0.2σ | ||
| TestMisc_test_diag_sum_100000 | 0.0378σ | 0.0132σ | 0.0901σ | 0.23σ | 0.243σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.387σ | -0.0965σ | -0.0371σ | -0.0342σ | 0.0497σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.374σ | 0.0443σ | 0.138σ | 0.169σ | 0.193σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.453σ | -0.074σ | 0.0156σ | 0.00188σ | 0.0919σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0486σ | 0.209σ | 0.211σ | 0.158σ | 0.164σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.401σ | -0.27σ | -0.112σ | -0.0421σ | -0.0295σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.0534σ | 0.0111σ | 0.0474σ | 0.108σ | 0.155σ | ||
| TestJump_test_clnlbean_5000 | 0.0832σ | 0.153σ | 0.163σ | ||||
| TestJump_test_clnlbean_50000 | 0.0794σ | 0.104σ | 0.0721σ | ||||
| TestJump_test_facility_25 | 0.105σ | 0.188σ | 0.0772σ | 0.0455σ | 0.288σ | ||
| TestJump_test_facility_5 | 0.266σ | -0.182σ | -0.296σ | -0.219σ | -0.0184σ | ||
| TestJump_test_facility_quicksum_25 | 0.0746σ | 0.282σ | 0.286σ | 0.0809σ | 0.242σ | ||
| TestJump_test_facility_quicksum_5 | 0.332σ | -0.208σ | -0.216σ | -0.0571σ | -0.0392σ | ||
| TestJump_test_lqcp_10 | 0.357σ | -0.794σ | -0.599σ | -0.723σ | -0.315σ | ||
| TestJump_test_lqcp_500 | 0.12σ | 0.202σ | 0.0941σ | 0.0404σ | 0.185σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.322σ | -0.145σ | -0.588σ | -0.512σ | -0.279σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.0754σ | 0.258σ | 0.169σ | 0.0681σ | 0.111σ | ||
| TestJump_test_opf_662 | 0.0432σ | 0.0768σ | 0.0242σ | ||||
| TestJump_test_opf_6620 | 0.0261σ | 0.0901σ | 0.0247σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0624σ | 0.0639σ | 0.0133σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.108σ | 0.0693σ | 0.0145σ | ||||
| TestDevel_test_issue_691 | 0.46σ | 0.147σ | 0.124σ | 0.28σ | 0.218σ | ||
| TestModels_test_dcopf_case2383wp | 0.194σ | 0.133σ | 0.132σ | 0.143σ | 0.259σ | ||
| TestModels_test_uc_20140901_expected | 0.207σ | 0.18σ | 0.0882σ | 0.143σ | 0.199σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.16σ | 0.141σ | 0.247σ | ||||
| TestMisc_test_bilinear_100 | 0.382σ | -0.608σ | -0.31σ | -0.456σ | -0.358σ | ||
| TestMisc_test_bilinear_100000 | 0.19σ | 0.101σ | 0.0876σ | 0.207σ | 0.142σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.397σ | -0.294σ | -0.477σ | -0.111σ | -0.242σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.178σ | 0.107σ | 0.128σ | 0.143σ | 0.149σ | ||
| TestMisc_test_diag_quicksum_100 | 0.699σ | -0.606σ | -0.55σ | -0.452σ | -0.544σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.0949σ | 0.144σ | 0.142σ | -0.00128σ | 0.144σ | ||
| TestMisc_test_diag_sum_100 | 0.326σ | -0.642σ | -0.636σ | -0.639σ | -0.596σ | ||
| TestMisc_test_diag_sum_100000 | 0.303σ | 0.162σ | 0.0833σ | 0.0182σ | 0.065σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.473σ | 0.0297σ | -0.0404σ | -0.22σ | 0.0355σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.114σ | 0.296σ | 0.202σ | -0.0084σ | 0.192σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.364σ | 0.0548σ | -0.00978σ | -0.0753σ | -0.0034σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.103σ | 0.337σ | 0.304σ | 0.0275σ | 0.128σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.354σ | 0.0242σ | 0.0188σ | 0.0255σ | 0.0458σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.0928σ | 0.225σ | 0.206σ | 0.0741σ | 0.171σ | ||
| TestJump_test_clnlbean_5000 | 0.0967σ | 0.264σ | 0.11σ | ||||
| TestJump_test_clnlbean_50000 | 0.11σ | 0.124σ | 0.0701σ | ||||
| TestJump_test_facility_25 | 0.163σ | 0.202σ | 0.136σ | 0.0731σ | 0.14σ | ||
| TestJump_test_facility_5 | 0.164σ | -0.0328σ | -0.0877σ | -0.0908σ | -0.0862σ | ||
| TestJump_test_facility_quicksum_25 | 0.181σ | 0.16σ | 0.117σ | 0.0636σ | 0.125σ | ||
| TestJump_test_facility_quicksum_5 | 0.154σ | -0.0746σ | -0.224σ | -0.0848σ | -0.0461σ | ||
| TestJump_test_lqcp_10 | 0.479σ | -0.538σ | -0.387σ | -0.405σ | -0.406σ | ||
| TestJump_test_lqcp_500 | 0.0564σ | 0.197σ | 0.169σ | 0.0203σ | 0.0256σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.34σ | -0.524σ | -0.499σ | -0.539σ | -0.371σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.0401σ | 0.0885σ | 0.0799σ | 0.0122σ | -0.0217σ | ||
| TestJump_test_opf_662 | 0.081σ | 0.112σ | 0.0401σ | ||||
| TestJump_test_opf_6620 | -0.0166σ | 0.0148σ | 0.0304σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0524σ | 0.0485σ | 0.0897σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.0481σ | 0.0272σ | 0.11σ | ||||
| TestDevel_test_issue_691 | 0.247σ | 0.0226σ | 0.024σ | 0.0995σ | 0.071σ | ||
| TestModels_test_dcopf_case2383wp | 0.293σ | 0.128σ | 0.15σ | 0.0482σ | 0.0249σ | ||
| TestModels_test_uc_20140901_expected | 0.142σ | 0.246σ | 0.175σ | 0.0775σ | 0.174σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.175σ | 0.404σ | 0.319σ | ||||
| TestMisc_test_bilinear_100 | 0.687σ | -0.389σ | -0.403σ | -0.321σ | -0.327σ | ||
| TestMisc_test_bilinear_100000 | 0.809σ | 0.17σ | 0.393σ | 0.304σ | 0.263σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.817σ | -0.379σ | -0.468σ | -0.259σ | -0.178σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.39σ | 0.172σ | 0.359σ | 0.32σ | 0.311σ | ||
| TestMisc_test_diag_quicksum_100 | 0.61σ | -0.509σ | -0.567σ | -0.594σ | -0.567σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.468σ | -0.111σ | 0.095σ | 0.0598σ | 0.00865σ | ||
| TestMisc_test_diag_sum_100 | 0.547σ | -0.741σ | -0.867σ | -0.992σ | -0.604σ | ||
| TestMisc_test_diag_sum_100000 | 0.324σ | -0.0494σ | 0.068σ | 0.142σ | -0.0489σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.531σ | -0.124σ | -0.0775σ | 0.0774σ | -0.0559σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.157σ | 0.214σ | 0.283σ | 0.153σ | 0.025σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.354σ | -0.249σ | -0.184σ | -0.065σ | -0.0508σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.104σ | 0.295σ | 0.368σ | 0.118σ | 0.0294σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.303σ | -0.223σ | 0.0727σ | 0.0261σ | -0.087σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.306σ | 0.204σ | 0.207σ | 0.202σ | 0.0636σ | ||
| TestJump_test_clnlbean_5000 | 0.218σ | 0.0173σ | 0.595σ | ||||
| TestJump_test_clnlbean_50000 | 0.269σ | 0.0646σ | 0.342σ | ||||
| TestJump_test_facility_25 | 0.173σ | 0.000863σ | 0.0505σ | 0.0501σ | 0.117σ | ||
| TestJump_test_facility_5 | 0.145σ | -0.336σ | -0.223σ | -0.209σ | -0.0996σ | ||
| TestJump_test_facility_quicksum_25 | 0.256σ | 0.0327σ | 0.0514σ | 0.0801σ | 0.0857σ | ||
| TestJump_test_facility_quicksum_5 | 0.0886σ | -0.392σ | -0.0913σ | -0.246σ | -0.0843σ | ||
| TestJump_test_lqcp_10 | 0.582σ | -0.867σ | -0.699σ | -0.794σ | -0.393σ | ||
| TestJump_test_lqcp_500 | 0.346σ | 0.111σ | 0.0663σ | 0.0876σ | 0.195σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.447σ | -0.596σ | -0.691σ | -0.536σ | -0.225σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.285σ | 0.0686σ | 0.0907σ | 0.138σ | 0.24σ | ||
| TestJump_test_opf_662 | 0.154σ | 0.0661σ | 0.417σ | ||||
| TestJump_test_opf_6620 | 0.239σ | 0.196σ | 0.268σ | ||||
| TestJump_test_opf_quicksum_662 | 0.19σ | 0.0997σ | 0.217σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.24σ | 0.0826σ | 0.408σ | ||||
| TestDevel_test_issue_691 | 0.816σ | 0.464σ | 0.197σ | 0.19σ | 0.145σ | ||
| TestModels_test_dcopf_case2383wp | 0.558σ | -0.0282σ | 0.111σ | 0.103σ | 0.166σ | ||
| TestModels_test_uc_20140901_expected | 0.0975σ | 0.0397σ | 0.126σ | 0.0648σ | 0.00827σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.512σ | 0.107σ | 0.0731σ | ||||
| TestMisc_test_bilinear_100 | 0.15σ | -0.236σ | -0.638σ | -0.469σ | -0.752σ | ||
| TestMisc_test_bilinear_100000 | 0.368σ | 0.0566σ | 0.187σ | -0.0198σ | 0.0911σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.363σ | -0.838σ | -0.794σ | -0.823σ | -0.786σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.432σ | 0.123σ | 0.138σ | 0.0122σ | 0.108σ | ||
| TestMisc_test_diag_quicksum_100 | 0.669σ | -0.849σ | -1.02σ | -0.835σ | -0.782σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.0706σ | -0.118σ | -0.0227σ | 0.0297σ | 0.137σ | ||
| TestMisc_test_diag_sum_100 | 0.462σ | -0.887σ | -0.701σ | -0.756σ | -0.706σ | ||
| TestMisc_test_diag_sum_100000 | 0.0526σ | -0.093σ | -0.122σ | 0.0127σ | 0.217σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.378σ | -0.201σ | -0.17σ | -0.0691σ | 0.000798σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.0412σ | -0.1σ | -0.033σ | -0.0574σ | 0.0674σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.575σ | -0.327σ | -0.0987σ | -0.05σ | 0.0219σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.133σ | -0.00762σ | -0.00816σ | -0.0393σ | 0.07σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.379σ | -0.362σ | -0.163σ | -0.081σ | -0.114σ | ||
| TestMisc_test_pmedian_tuple_test8 | -0.018σ | -0.109σ | -0.00957σ | 0.0587σ | 0.0789σ | ||
| TestJump_test_clnlbean_5000 | 0.0915σ | 0.0325σ | 0.0479σ | ||||
| TestJump_test_clnlbean_50000 | 0.0555σ | 0.0359σ | 0.0501σ | ||||
| TestJump_test_facility_25 | 0.238σ | 0.164σ | -0.0434σ | -0.00336σ | 0.162σ | ||
| TestJump_test_facility_5 | 0.198σ | -0.171σ | -0.215σ | -0.199σ | -0.0586σ | ||
| TestJump_test_facility_quicksum_25 | 0.273σ | 0.0685σ | -0.0464σ | -0.000199σ | 0.0952σ | ||
| TestJump_test_facility_quicksum_5 | 0.129σ | -0.288σ | -0.226σ | -0.179σ | -0.0405σ | ||
| TestJump_test_lqcp_10 | 0.0828σ | -0.801σ | -0.748σ | -0.751σ | -0.528σ | ||
| TestJump_test_lqcp_500 | 0.0683σ | -0.0137σ | -0.112σ | -0.0462σ | 0.0574σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.161σ | -0.381σ | -1.17σ | -0.759σ | -0.661σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.155σ | -0.0662σ | 0.0236σ | -0.0985σ | 0.0403σ | ||
| TestJump_test_opf_662 | -0.104σ | 0.115σ | 0.0444σ | ||||
| TestJump_test_opf_6620 | -0.129σ | 0.0149σ | 0.0696σ | ||||
| TestJump_test_opf_quicksum_662 | -0.174σ | -0.00816σ | 0.21σ | ||||
| TestJump_test_opf_quicksum_6620 | -0.116σ | -0.0663σ | 0.0691σ | ||||
| TestDevel_test_issue_691 | 0.00312σ | 0.0404σ | 0.0196σ | -0.0383σ | -0.159σ | ||
| TestModels_test_dcopf_case2383wp | 0.32σ | -0.0933σ | -0.163σ | -0.146σ | 0.204σ | ||
| TestModels_test_uc_20140901_expected | -0.0322σ | -0.0199σ | 0.0157σ | -0.144σ | 0.0719σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.316σ | 1.7σ | 0.075σ | ||||
| TestMisc_test_bilinear_100 | 1.14σ | 0.888σ | 0.716σ | 0.779σ | 0.772σ | ||
| TestMisc_test_bilinear_100000 | 0.277σ | 0.518σ | 0.342σ | 1.9σ | 1.46σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.709σ | 0.801σ | 0.971σ | 0.933σ | 0.936σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.845σ | 0.478σ | 0.163σ | 1.62σ | 1.3σ | ||
| TestMisc_test_diag_quicksum_100 | 0.69σ | 0.86σ | 0.769σ | 0.96σ | 0.528σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.825σ | -0.229σ | 0.333σ | 0.226σ | 0.175σ | ||
| TestMisc_test_diag_sum_100 | 1.55σ | 0.695σ | 0.86σ | 0.829σ | 0.862σ | ||
| TestMisc_test_diag_sum_100000 | 1.06σ | -0.0608σ | 0.341σ | 0.284σ | 0.7σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.786σ | 0.704σ | 0.777σ | 0.608σ | 0.185σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.937σ | 0.0695σ | 0.631σ | 0.565σ | 0.514σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.511σ | 0.898σ | 0.99σ | 0.574σ | 0.64σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.993σ | 0.445σ | 0.6σ | 0.247σ | 0.739σ | ||
| TestMisc_test_pmedian_tuple_test4 | 0.457σ | 0.61σ | 0.713σ | 0.66σ | 0.44σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.19σ | 0.375σ | 0.272σ | 0.137σ | 0.325σ | ||
| TestJump_test_clnlbean_5000 | 0.397σ | 0.154σ | 0.853σ | ||||
| TestJump_test_clnlbean_50000 | 1.01σ | 0.377σ | 1.18σ | ||||
| TestJump_test_facility_25 | 0.476σ | 0.38σ | 0.717σ | 0.66σ | 0.286σ | ||
| TestJump_test_facility_5 | 0.619σ | 0.366σ | 1.16σ | 0.576σ | 0.963σ | ||
| TestJump_test_facility_quicksum_25 | 0.356σ | 0.224σ | 0.228σ | 0.389σ | 1.02σ | ||
| TestJump_test_facility_quicksum_5 | 0.486σ | 0.495σ | 0.704σ | 0.462σ | 0.979σ | ||
| TestJump_test_lqcp_10 | 0.324σ | 0.669σ | 0.791σ | 0.866σ | 0.646σ | ||
| TestJump_test_lqcp_500 | 0.48σ | 1.04σ | 1.23σ | 1.1σ | 1.66σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.66σ | 0.863σ | 0.726σ | 0.712σ | 0.691σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.17σ | 0.627σ | 0.738σ | 0.941σ | 1.32σ | ||
| TestJump_test_opf_662 | 0.733σ | 0.419σ | 1.45σ | ||||
| TestJump_test_opf_6620 | 0.456σ | 0.248σ | 0.564σ | ||||
| TestJump_test_opf_quicksum_662 | 0.248σ | 0.995σ | 0.929σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.552σ | 1.11σ | 1.22σ | ||||
| TestDevel_test_issue_691 | 0.94σ | 1.19σ | 1.13σ | 0.214σ | 1.4σ | ||
| TestModels_test_dcopf_case2383wp | 1.12σ | 0.379σ | 0.731σ | 0.62σ | 1.3σ | ||
| TestModels_test_uc_20140901_expected | 0.865σ | 1.13σ | 1.35σ | 0.612σ | 1.04σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.17σ | 0.173σ | 0.192σ | ||||
| TestMisc_test_bilinear_100 | 0.332σ | -0.366σ | -0.565σ | -0.337σ | -0.299σ | ||
| TestMisc_test_bilinear_100000 | 0.181σ | 0.119σ | 0.185σ | 0.19σ | 0.0669σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.0665σ | -0.674σ | -0.197σ | -0.607σ | -0.564σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.0872σ | 0.164σ | 0.192σ | 0.154σ | 0.0547σ | ||
| TestMisc_test_diag_quicksum_100 | 1.03σ | -0.472σ | -0.332σ | -0.649σ | -0.623σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.0862σ | -0.0198σ | -0.0368σ | 0.113σ | 0.167σ | ||
| TestMisc_test_diag_sum_100 | 0.99σ | -0.767σ | -0.671σ | -0.647σ | -0.432σ | ||
| TestMisc_test_diag_sum_100000 | 0.0889σ | 0.0478σ | 0.0327σ | 0.12σ | 0.122σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.23σ | -0.163σ | -0.0895σ | -0.00253σ | 0.00129σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.0435σ | -0.0181σ | 0.203σ | 0.186σ | 0.178σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.583σ | 0.384σ | -0.0703σ | 0.00178σ | 0.0542σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.000581σ | 0.0113σ | 0.0198σ | 0.219σ | 0.269σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.34σ | -0.069σ | -0.0357σ | 0.0449σ | 0.0344σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.462σ | 0.0633σ | 0.0462σ | 0.204σ | 0.17σ | ||
| TestJump_test_clnlbean_5000 | 0.155σ | 0.184σ | 0.114σ | ||||
| TestJump_test_clnlbean_50000 | 0.262σ | 0.107σ | 0.0362σ | ||||
| TestJump_test_facility_25 | 0.26σ | 0.136σ | 0.0805σ | 0.0704σ | 0.115σ | ||
| TestJump_test_facility_5 | 0.414σ | -0.0311σ | -0.061σ | -0.133σ | -0.0761σ | ||
| TestJump_test_facility_quicksum_25 | 0.35σ | 0.0514σ | -0.0121σ | 0.132σ | 0.115σ | ||
| TestJump_test_facility_quicksum_5 | 0.23σ | -0.231σ | -0.228σ | -0.0386σ | -0.0307σ | ||
| TestJump_test_lqcp_10 | 0.827σ | -0.484σ | -0.476σ | -0.476σ | -0.416σ | ||
| TestJump_test_lqcp_500 | 0.184σ | 0.144σ | -0.00427σ | 0.0122σ | -0.0106σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.564σ | -0.566σ | -0.528σ | -0.556σ | -0.435σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.346σ | 0.122σ | -0.00844σ | 0.0944σ | -0.0285σ | ||
| TestJump_test_opf_662 | 0.0169σ | 0.0206σ | 0.0976σ | ||||
| TestJump_test_opf_6620 | 0.423σ | 0.0918σ | 0.0756σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0891σ | 0.0685σ | 0.123σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.365σ | 0.0508σ | 0.0919σ | ||||
| TestDevel_test_issue_691 | 0.316σ | 0.13σ | 0.13σ | 0.371σ | 0.273σ | ||
| TestModels_test_dcopf_case2383wp | 0.324σ | 0.0402σ | 0.105σ | 0.133σ | 0.0419σ | ||
| TestModels_test_uc_20140901_expected | 0.309σ | 0.0192σ | -0.00918σ | 0.102σ | 0.0617σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.119σ | 0.0512σ | 0.0845σ | ||||
| TestMisc_test_bilinear_100 | 0.176σ | -0.41σ | -0.467σ | -0.305σ | -0.19σ | ||
| TestMisc_test_bilinear_100000 | 0.0843σ | 0.211σ | 0.12σ | 0.122σ | 0.174σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.229σ | -0.501σ | -0.522σ | -0.61σ | -0.25σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.277σ | 0.251σ | 0.145σ | 0.151σ | 0.197σ | ||
| TestMisc_test_diag_quicksum_100 | 0.723σ | -0.458σ | -0.673σ | -0.629σ | -0.723σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.0273σ | 0.263σ | 0.17σ | 0.151σ | 0.155σ | ||
| TestMisc_test_diag_sum_100 | 0.42σ | -0.0975σ | -0.189σ | -0.195σ | -0.181σ | ||
| TestMisc_test_diag_sum_100000 | 0.0289σ | 0.141σ | 0.254σ | 0.35σ | 0.238σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.296σ | -0.0232σ | -0.00873σ | -0.0435σ | 0.0453σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.0315σ | 0.204σ | 0.381σ | 0.0481σ | 0.264σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.414σ | 0.0135σ | 0.00301σ | 1.07σ | 0.122σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.042σ | 0.248σ | 0.114σ | 0.00526σ | 0.235σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.378σ | 0.0244σ | -0.113σ | -0.0409σ | 0.0859σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.0803σ | 0.182σ | 0.241σ | 0.0438σ | 0.301σ | ||
| TestJump_test_clnlbean_5000 | 0.207σ | 0.111σ | 0.139σ | ||||
| TestJump_test_clnlbean_50000 | 0.207σ | 0.175σ | 0.191σ | ||||
| TestJump_test_facility_25 | 0.179σ | 0.281σ | 0.11σ | 0.153σ | 0.184σ | ||
| TestJump_test_facility_5 | 0.0929σ | -0.231σ | -0.0526σ | -0.0456σ | -0.0479σ | ||
| TestJump_test_facility_quicksum_25 | 0.101σ | 0.225σ | 0.442σ | 0.196σ | 0.159σ | ||
| TestJump_test_facility_quicksum_5 | 0.319σ | -0.134σ | -0.117σ | 0.0265σ | 0.00131σ | ||
| TestJump_test_lqcp_10 | 0.13σ | -0.52σ | -0.462σ | -0.51σ | -0.372σ | ||
| TestJump_test_lqcp_500 | -0.0108σ | 0.0571σ | 0.21σ | 0.108σ | 0.117σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.00612σ | -0.452σ | -0.389σ | -0.553σ | -0.355σ | ||
| TestJump_test_lqcp_quicksum_500 | -0.0212σ | 0.0864σ | 0.151σ | 0.0419σ | 0.0387σ | ||
| TestJump_test_opf_662 | -0.0258σ | 0.0445σ | 0.0438σ | ||||
| TestJump_test_opf_6620 | -0.014σ | -0.00927σ | 0.101σ | ||||
| TestJump_test_opf_quicksum_662 | -0.0125σ | 0.0305σ | 0.117σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.0656σ | 0.0683σ | 0.0809σ | ||||
| TestDevel_test_issue_691 | 0.375σ | 0.0595σ | 0.0385σ | 0.0783σ | 0.0647σ | ||
| TestModels_test_dcopf_case2383wp | 0.084σ | 0.0268σ | 0.143σ | 0.0775σ | 0.103σ | ||
| TestModels_test_uc_20140901_expected | 0.158σ | 0.193σ | 0.192σ | 0.346σ | 0.273σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | -0.772σ | 0.239σ | 0.16σ | ||||
| TestMisc_test_bilinear_100 | 0.486σ | -0.644σ | -0.532σ | -0.811σ | -1.01σ | ||
| TestMisc_test_bilinear_100000 | 0.458σ | 0.496σ | 0.517σ | 0.363σ | 0.423σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.18σ | -0.965σ | -0.798σ | -0.858σ | -0.621σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.0624σ | 0.41σ | 0.37σ | 0.195σ | 0.305σ | ||
| TestMisc_test_diag_quicksum_100 | 0.0483σ | -0.663σ | -0.673σ | -0.909σ | -0.779σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.0849σ | 0.0304σ | 0.147σ | 0.139σ | 0.324σ | ||
| TestMisc_test_diag_sum_100 | -0.0384σ | -1.21σ | -0.907σ | -1.03σ | -0.813σ | ||
| TestMisc_test_diag_sum_100000 | 0.0566σ | 0.123σ | 0.149σ | 0.0578σ | 0.215σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.431σ | -0.391σ | -0.248σ | -0.151σ | 0.188σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.0631σ | 0.131σ | -0.0591σ | -0.0212σ | 0.305σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.243σ | 0.00328σ | -0.122σ | 0.082σ | 0.18σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.0409σ | 0.213σ | 0.105σ | 0.0277σ | 0.367σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.486σ | -0.24σ | -0.512σ | -0.117σ | 0.0795σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.133σ | 0.104σ | -0.0491σ | -0.0275σ | 0.292σ | ||
| TestJump_test_clnlbean_5000 | 0.225σ | 0.0191σ | 0.194σ | ||||
| TestJump_test_clnlbean_50000 | 0.384σ | 0.0759σ | 0.122σ | ||||
| TestJump_test_facility_25 | 0.416σ | -0.0235σ | -0.15σ | 0.199σ | -0.0351σ | ||
| TestJump_test_facility_5 | 0.11σ | -0.403σ | -0.502σ | -0.182σ | -0.304σ | ||
| TestJump_test_facility_quicksum_25 | 0.304σ | -0.0835σ | -0.149σ | 0.0209σ | -0.108σ | ||
| TestJump_test_facility_quicksum_5 | 0.104σ | -0.464σ | -0.268σ | -0.197σ | -0.251σ | ||
| TestJump_test_lqcp_10 | 0.109σ | -0.806σ | -0.476σ | -0.513σ | -0.517σ | ||
| TestJump_test_lqcp_500 | 0.433σ | 0.0536σ | -0.131σ | -0.0231σ | -0.0635σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.141σ | -0.478σ | -0.697σ | -0.44σ | -0.66σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.16σ | 0.0378σ | -0.0111σ | 0.126σ | 0.0149σ | ||
| TestJump_test_opf_662 | 0.114σ | 0.0278σ | 0.222σ | ||||
| TestJump_test_opf_6620 | 0.329σ | -0.0287σ | 0.12σ | ||||
| TestJump_test_opf_quicksum_662 | 0.123σ | -0.0162σ | 0.17σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.0633σ | 0.00661σ | 0.137σ | ||||
| TestDevel_test_issue_691 | 0.785σ | 0.171σ | 0.304σ | 0.301σ | 0.47σ | ||
| TestModels_test_dcopf_case2383wp | 0.631σ | -0.0736σ | -0.0818σ | 0.0443σ | 0.0945σ | ||
| TestModels_test_uc_20140901_expected | 0.0612σ | 0.19σ | -0.0254σ | 0.119σ | 0.136σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 0.601σ | 0.342σ | 0.0961σ | ||||
| TestMisc_test_bilinear_100 | 0.22σ | -0.914σ | -1.33σ | -1.17σ | -0.506σ | ||
| TestMisc_test_bilinear_100000 | 0.105σ | 0.0649σ | -0.132σ | 0.308σ | 0.47σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 0.499σ | -0.713σ | -1.04σ | -0.849σ | -0.731σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.364σ | 0.0729σ | -0.0805σ | 0.123σ | 0.323σ | ||
| TestMisc_test_diag_quicksum_100 | 0.763σ | -0.826σ | -0.944σ | -0.997σ | -0.454σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.189σ | -0.128σ | -0.132σ | 0.0199σ | 0.113σ | ||
| TestMisc_test_diag_sum_100 | -0.0241σ | -1.19σ | -1.24σ | -0.92σ | -0.891σ | ||
| TestMisc_test_diag_sum_100000 | 0.117σ | -0.159σ | -0.205σ | 0.0988σ | 0.0452σ | ||
| TestMisc_test_pmedian_quicksum_test4 | -0.286σ | -0.51σ | -0.738σ | -0.0286σ | -0.121σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.29σ | -0.152σ | -0.223σ | 0.0365σ | -0.0221σ | ||
| TestMisc_test_pmedian_sum_test4 | -0.278σ | -0.622σ | -0.45σ | -0.115σ | -0.118σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.204σ | -0.185σ | -0.0739σ | 0.0171σ | 0.0359σ | ||
| TestMisc_test_pmedian_tuple_test4 | -0.219σ | -0.362σ | -0.31σ | 0.0352σ | -0.138σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.134σ | -0.0929σ | -0.149σ | -0.0215σ | 0.0164σ | ||
| TestJump_test_clnlbean_5000 | 0.0815σ | 0.0479σ | 0.104σ | ||||
| TestJump_test_clnlbean_50000 | 0.09σ | 0.0179σ | 0.15σ | ||||
| TestJump_test_facility_25 | 0.249σ | 0.0257σ | -0.0483σ | 0.0217σ | 0.109σ | ||
| TestJump_test_facility_5 | 0.175σ | -0.409σ | -0.364σ | 0.189σ | -0.037σ | ||
| TestJump_test_facility_quicksum_25 | 0.162σ | 0.0143σ | 0.0524σ | 0.0663σ | 0.113σ | ||
| TestJump_test_facility_quicksum_5 | 0.227σ | -0.298σ | -0.0231σ | -0.195σ | 0.00261σ | ||
| TestJump_test_lqcp_10 | 0.272σ | -0.0347σ | -0.638σ | -0.539σ | -0.323σ | ||
| TestJump_test_lqcp_500 | 0.0531σ | 0.0906σ | -0.047σ | 0.184σ | 0.0898σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.336σ | -0.91σ | -0.745σ | -0.32σ | -0.572σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.0871σ | 0.0147σ | -0.112σ | 0.0611σ | 0.0916σ | ||
| TestJump_test_opf_662 | 0.141σ | -0.00711σ | 0.197σ | ||||
| TestJump_test_opf_6620 | 0.272σ | 0.101σ | 0.167σ | ||||
| TestJump_test_opf_quicksum_662 | 0.0806σ | 0.13σ | 0.137σ | ||||
| TestJump_test_opf_quicksum_6620 | 0.0638σ | 0.0646σ | 0.338σ | ||||
| TestDevel_test_issue_691 | 0.251σ | 0.0566σ | 0.0371σ | 0.104σ | 0.261σ | ||
| TestModels_test_dcopf_case2383wp | 0.189σ | 0.0691σ | 0.0208σ | 0.153σ | 0.243σ | ||
| TestModels_test_uc_20140901_expected | 0.118σ | -0.0124σ | -0.0308σ | -0.0539σ | 0.0368σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.65σ | 1.24σ | 1.2σ | ||||
| TestMisc_test_bilinear_100 | 0.352σ | 1.63σ | 1.64σ | 1.51σ | 1.55σ | ||
| TestMisc_test_bilinear_100000 | 1.68σ | 1.57σ | 1.87σ | 1.61σ | 1.39σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.24σ | 0.573σ | 0.996σ | 1.15σ | 1.64σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 2.11σ | 1.22σ | 1.64σ | 1.88σ | 1.68σ | ||
| TestMisc_test_diag_quicksum_100 | 1.2σ | 1.04σ | 0.926σ | 0.136σ | 0.686σ | ||
| TestMisc_test_diag_quicksum_100000 | 1.31σ | 1.37σ | 1.56σ | 0.693σ | 0.4σ | ||
| TestMisc_test_diag_sum_100 | 1.19σ | 0.943σ | 1.33σ | 1.69σ | 1.61σ | ||
| TestMisc_test_diag_sum_100000 | 1.36σ | 1.48σ | 1.68σ | 1.58σ | 1.57σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 1.66σ | 1.71σ | 0.94σ | 1.42σ | 1.41σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.848σ | 0.764σ | 1.07σ | 1.46σ | 0.963σ | ||
| TestMisc_test_pmedian_sum_test4 | 2.11σ | 1.85σ | 1.52σ | 1.31σ | 1.62σ | ||
| TestMisc_test_pmedian_sum_test8 | 1.96σ | 0.208σ | 0.192σ | 1.34σ | 1.52σ | ||
| TestMisc_test_pmedian_tuple_test4 | 1.92σ | 1.56σ | 1.43σ | 1.41σ | 1.82σ | ||
| TestMisc_test_pmedian_tuple_test8 | 1.72σ | 1.25σ | 0.479σ | 0.436σ | 0.895σ | ||
| TestJump_test_clnlbean_5000 | 0.281σ | 0.0958σ | 0.466σ | ||||
| TestJump_test_clnlbean_50000 | 0.991σ | 0.548σ | 0.115σ | ||||
| TestJump_test_facility_25 | 0.184σ | 0.605σ | 1.01σ | 1.33σ | 0.785σ | ||
| TestJump_test_facility_5 | 1.89σ | 1.03σ | 1.78σ | 1.01σ | 0.742σ | ||
| TestJump_test_facility_quicksum_25 | 1.86σ | 1.09σ | 0.433σ | 1.68σ | 0.191σ | ||
| TestJump_test_facility_quicksum_5 | 0.265σ | 0.403σ | 0.386σ | 0.292σ | 0.239σ | ||
| TestJump_test_lqcp_10 | 0.735σ | 1.34σ | 0.577σ | 0.878σ | 0.569σ | ||
| TestJump_test_lqcp_500 | 0.605σ | 1.22σ | 1.03σ | 1.69σ | 1.01σ | ||
| TestJump_test_lqcp_quicksum_10 | 1.57σ | 0.949σ | 0.67σ | 1.35σ | 1.65σ | ||
| TestJump_test_lqcp_quicksum_500 | 1.29σ | 0.688σ | 0.665σ | 1.73σ | 0.829σ | ||
| TestJump_test_opf_662 | 0.226σ | 0.341σ | 0.345σ | ||||
| TestJump_test_opf_6620 | 0.532σ | 0.218σ | 1.2σ | ||||
| TestJump_test_opf_quicksum_662 | 1.14σ | 0.949σ | 1.13σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.02σ | 0.842σ | 1.59σ | ||||
| TestDevel_test_issue_691 | 0.912σ | 1.31σ | 1.66σ | 0.441σ | 1.05σ | ||
| TestModels_test_dcopf_case2383wp | 0.641σ | 1.37σ | 1.25σ | 1.29σ | 1.34σ | ||
| TestModels_test_uc_20140901_expected | 1.66σ | 0.9σ | 0.258σ | 0.61σ | 1.12σ |
| Problem\Measure | create_instance | discretize | postprocessing | nl | lp | bar | gams |
|---|---|---|---|---|---|---|---|
| TestStochPDEgas_test_stochpdegas_automatic | 1.03σ | 0.394σ | 1.19σ | ||||
| TestMisc_test_bilinear_100 | 0.752σ | 1.5σ | 1.38σ | 1.74σ | 1.52σ | ||
| TestMisc_test_bilinear_100000 | 0.395σ | 0.32σ | 0.645σ | 0.345σ | 0.345σ | ||
| TestMisc_test_bilinear_nlcontext_100 | 1.66σ | 1.25σ | 1.1σ | 1.2σ | 1.52σ | ||
| TestMisc_test_bilinear_nlcontext_100000 | 0.593σ | 0.287σ | 0.11σ | 0.0916σ | 0.854σ | ||
| TestMisc_test_diag_quicksum_100 | 1.83σ | 1.8σ | 1.25σ | 2.24σ | 1.8σ | ||
| TestMisc_test_diag_quicksum_100000 | 0.277σ | 0.114σ | 0.149σ | 0.678σ | 0.534σ | ||
| TestMisc_test_diag_sum_100 | 1.36σ | 1.88σ | 1.19σ | 1.8σ | 1.28σ | ||
| TestMisc_test_diag_sum_100000 | 0.151σ | 0.498σ | 0.26σ | 0.191σ | 0.337σ | ||
| TestMisc_test_pmedian_quicksum_test4 | 0.613σ | 1.14σ | 0.625σ | 0.331σ | 0.426σ | ||
| TestMisc_test_pmedian_quicksum_test8 | 0.195σ | 0.189σ | 0.403σ | 0.271σ | 0.275σ | ||
| TestMisc_test_pmedian_sum_test4 | 0.853σ | 1.26σ | 0.626σ | 0.839σ | 0.578σ | ||
| TestMisc_test_pmedian_sum_test8 | 0.254σ | 0.0778σ | 0.476σ | 0.328σ | 0.193σ | ||
| TestMisc_test_pmedian_tuple_test4 | 1.31σ | 0.822σ | 0.0387σ | 1.0σ | 0.251σ | ||
| TestMisc_test_pmedian_tuple_test8 | 0.14σ | 0.216σ | 0.46σ | 0.169σ | 0.404σ | ||
| TestJump_test_clnlbean_5000 | 0.836σ | 1.83σ | 0.953σ | ||||
| TestJump_test_clnlbean_50000 | 0.705σ | 1.48σ | 0.79σ | ||||
| TestJump_test_facility_25 | 0.31σ | 1.65σ | 0.21σ | 0.246σ | 0.0863σ | ||
| TestJump_test_facility_5 | 0.0902σ | 0.222σ | 0.238σ | 0.119σ | 0.255σ | ||
| TestJump_test_facility_quicksum_25 | 0.0617σ | 1.39σ | 0.392σ | 0.156σ | 0.882σ | ||
| TestJump_test_facility_quicksum_5 | 0.492σ | 0.95σ | 1.21σ | 0.47σ | 0.864σ | ||
| TestJump_test_lqcp_10 | 0.877σ | 1.02σ | 1.7σ | 1.48σ | 1.28σ | ||
| TestJump_test_lqcp_500 | 1.12σ | 0.922σ | 0.883σ | 0.15σ | 0.606σ | ||
| TestJump_test_lqcp_quicksum_10 | 0.166σ | 1.28σ | 1.43σ | 1.44σ | 0.7σ | ||
| TestJump_test_lqcp_quicksum_500 | 0.425σ | 0.783σ | 0.538σ | 0.271σ | 0.607σ | ||
| TestJump_test_opf_662 | 0.291σ | 0.791σ | 1.03σ | ||||
| TestJump_test_opf_6620 | 0.708σ | 0.858σ | 0.519σ | ||||
| TestJump_test_opf_quicksum_662 | 0.519σ | 0.78σ | 1.44σ | ||||
| TestJump_test_opf_quicksum_6620 | 1.48σ | 0.107σ | 0.296σ | ||||
| TestDevel_test_issue_691 | 0.244σ | 0.05σ | 0.02σ | 0.0562σ | 0.0786σ | ||
| TestModels_test_dcopf_case2383wp | 1.3σ | 1.47σ | 1.11σ | 1.49σ | 0.623σ | ||
| TestModels_test_uc_20140901_expected | 1.34σ | 1.23σ | 0.816σ | 1.0σ | 0.948σ |