Image

Performance Results


Welcome to Pyomo's performance test results portal!


Please explore the expandable sections below for different categories of Pyomo's current performance. The numbers shown are standard deviations away from the running average (where a positive number is slower than average, negative faster than average).

Note: Alerts are generated based on repeated performance. The table represents only the most recent run of the performance test suite.

Last update: Jan-21-2026 23:18

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.19σ 0.733σ 0.0531σ
TestMisc_test_bilinear_100 1.52σ 0.534σ 0.506σ 0.691σ 0.754σ
TestMisc_test_bilinear_100000 0.85σ 0.508σ 0.0738σ 0.583σ 0.672σ
TestMisc_test_bilinear_nlcontext_100 1.38σ 0.917σ 0.85σ 0.899σ 0.881σ
TestMisc_test_bilinear_nlcontext_100000 0.0907σ 0.711σ 1.08σ 0.819σ 0.485σ
TestMisc_test_diag_quicksum_100 0.599σ 0.782σ 0.629σ 0.741σ 0.847σ
TestMisc_test_diag_quicksum_100000 0.636σ 0.571σ 0.952σ 1.01σ 1.49σ
TestMisc_test_diag_sum_100 1.11σ 1.01σ 1.01σ 1.05σ 1.04σ
TestMisc_test_diag_sum_100000 0.954σ 1.0σ 0.915σ 1.09σ 1.17σ
TestMisc_test_pmedian_quicksum_test4 0.33σ 0.418σ 0.918σ 0.644σ 0.863σ
TestMisc_test_pmedian_quicksum_test8 0.972σ 0.986σ 1.06σ 0.911σ 0.907σ
TestMisc_test_pmedian_sum_test4 0.839σ 0.911σ 0.899σ 0.967σ 0.864σ
TestMisc_test_pmedian_sum_test8 0.863σ 0.949σ 1.1σ 0.846σ 0.919σ
TestMisc_test_pmedian_tuple_test4 0.898σ 0.868σ 0.937σ 0.819σ 0.868σ
TestMisc_test_pmedian_tuple_test8 0.862σ 0.805σ 0.953σ 0.907σ 0.953σ
TestJump_test_clnlbean_5000 0.907σ 0.948σ 0.859σ
TestJump_test_clnlbean_50000 0.903σ 0.89σ 0.864σ
TestJump_test_facility_25 0.848σ 0.971σ 0.867σ 0.993σ 0.855σ
TestJump_test_facility_5 1.5σ 1.27σ 0.902σ 1.06σ 0.825σ
TestJump_test_facility_quicksum_25 0.846σ 0.843σ 0.877σ 0.888σ 0.866σ
TestJump_test_facility_quicksum_5 1.05σ 1.2σ 0.964σ 0.921σ 0.858σ
TestJump_test_lqcp_10 0.97σ 1.05σ 1.21σ 1.05σ 1.06σ
TestJump_test_lqcp_500 0.403σ 0.0958σ 0.949σ 0.871σ 0.883σ
TestJump_test_lqcp_quicksum_10 1.41σ 1.12σ 1.05σ 0.969σ 1.08σ
TestJump_test_lqcp_quicksum_500 1.09σ 0.911σ 0.998σ 0.828σ 0.887σ
TestJump_test_opf_662 0.989σ 0.831σ 0.906σ
TestJump_test_opf_6620 1.15σ 0.861σ 0.96σ
TestJump_test_opf_quicksum_662 0.948σ 0.836σ 0.878σ
TestJump_test_opf_quicksum_6620 1.11σ 0.871σ 0.952σ
TestDevel_test_issue_691 1.18σ 0.605σ 1.03σ 1.0σ 0.971σ
TestModels_test_dcopf_case2383wp 1.09σ 0.911σ 0.863σ 0.64σ 0.97σ
TestModels_test_uc_20140901_expected 0.893σ 0.854σ 0.872σ 0.851σ 0.949σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.168σ 0.0773σ 0.0848σ
TestMisc_test_bilinear_100 0.237σ -0.218σ -0.331σ -0.138σ -0.125σ
TestMisc_test_bilinear_100000 0.0459σ 0.052σ 0.00699σ 0.0232σ 0.0862σ
TestMisc_test_bilinear_nlcontext_100 0.49σ -0.353σ -0.556σ -0.46σ -0.354σ
TestMisc_test_bilinear_nlcontext_100000 0.542σ 0.127σ 0.173σ 0.0475σ 0.179σ
TestMisc_test_diag_quicksum_100 0.68σ -0.234σ -0.255σ -0.307σ -0.125σ
TestMisc_test_diag_quicksum_100000 0.174σ 0.0978σ 0.153σ 0.0812σ 0.169σ
TestMisc_test_diag_sum_100 0.27σ -0.285σ -0.246σ -0.255σ -0.2σ
TestMisc_test_diag_sum_100000 0.0378σ 0.0132σ 0.0901σ 0.23σ 0.243σ
TestMisc_test_pmedian_quicksum_test4 -0.387σ -0.0965σ -0.0371σ -0.0342σ 0.0497σ
TestMisc_test_pmedian_quicksum_test8 0.374σ 0.0443σ 0.138σ 0.169σ 0.193σ
TestMisc_test_pmedian_sum_test4 -0.453σ -0.074σ 0.0156σ 0.00188σ 0.0919σ
TestMisc_test_pmedian_sum_test8 0.0486σ 0.209σ 0.211σ 0.158σ 0.164σ
TestMisc_test_pmedian_tuple_test4 -0.401σ -0.27σ -0.112σ -0.0421σ -0.0295σ
TestMisc_test_pmedian_tuple_test8 0.0534σ 0.0111σ 0.0474σ 0.108σ 0.155σ
TestJump_test_clnlbean_5000 0.0832σ 0.153σ 0.163σ
TestJump_test_clnlbean_50000 0.0794σ 0.104σ 0.0721σ
TestJump_test_facility_25 0.105σ 0.188σ 0.0772σ 0.0455σ 0.288σ
TestJump_test_facility_5 0.266σ -0.182σ -0.296σ -0.219σ -0.0184σ
TestJump_test_facility_quicksum_25 0.0746σ 0.282σ 0.286σ 0.0809σ 0.242σ
TestJump_test_facility_quicksum_5 0.332σ -0.208σ -0.216σ -0.0571σ -0.0392σ
TestJump_test_lqcp_10 0.357σ -0.794σ -0.599σ -0.723σ -0.315σ
TestJump_test_lqcp_500 0.12σ 0.202σ 0.0941σ 0.0404σ 0.185σ
TestJump_test_lqcp_quicksum_10 0.322σ -0.145σ -0.588σ -0.512σ -0.279σ
TestJump_test_lqcp_quicksum_500 0.0754σ 0.258σ 0.169σ 0.0681σ 0.111σ
TestJump_test_opf_662 0.0432σ 0.0768σ 0.0242σ
TestJump_test_opf_6620 0.0261σ 0.0901σ 0.0247σ
TestJump_test_opf_quicksum_662 0.0624σ 0.0639σ 0.0133σ
TestJump_test_opf_quicksum_6620 0.108σ 0.0693σ 0.0145σ
TestDevel_test_issue_691 0.46σ 0.147σ 0.124σ 0.28σ 0.218σ
TestModels_test_dcopf_case2383wp 0.194σ 0.133σ 0.132σ 0.143σ 0.259σ
TestModels_test_uc_20140901_expected 0.207σ 0.18σ 0.0882σ 0.143σ 0.199σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.16σ 0.141σ 0.247σ
TestMisc_test_bilinear_100 0.382σ -0.608σ -0.31σ -0.456σ -0.358σ
TestMisc_test_bilinear_100000 0.19σ 0.101σ 0.0876σ 0.207σ 0.142σ
TestMisc_test_bilinear_nlcontext_100 0.397σ -0.294σ -0.477σ -0.111σ -0.242σ
TestMisc_test_bilinear_nlcontext_100000 0.178σ 0.107σ 0.128σ 0.143σ 0.149σ
TestMisc_test_diag_quicksum_100 0.699σ -0.606σ -0.55σ -0.452σ -0.544σ
TestMisc_test_diag_quicksum_100000 0.0949σ 0.144σ 0.142σ -0.00128σ 0.144σ
TestMisc_test_diag_sum_100 0.326σ -0.642σ -0.636σ -0.639σ -0.596σ
TestMisc_test_diag_sum_100000 0.303σ 0.162σ 0.0833σ 0.0182σ 0.065σ
TestMisc_test_pmedian_quicksum_test4 -0.473σ 0.0297σ -0.0404σ -0.22σ 0.0355σ
TestMisc_test_pmedian_quicksum_test8 0.114σ 0.296σ 0.202σ -0.0084σ 0.192σ
TestMisc_test_pmedian_sum_test4 -0.364σ 0.0548σ -0.00978σ -0.0753σ -0.0034σ
TestMisc_test_pmedian_sum_test8 0.103σ 0.337σ 0.304σ 0.0275σ 0.128σ
TestMisc_test_pmedian_tuple_test4 -0.354σ 0.0242σ 0.0188σ 0.0255σ 0.0458σ
TestMisc_test_pmedian_tuple_test8 0.0928σ 0.225σ 0.206σ 0.0741σ 0.171σ
TestJump_test_clnlbean_5000 0.0967σ 0.264σ 0.11σ
TestJump_test_clnlbean_50000 0.11σ 0.124σ 0.0701σ
TestJump_test_facility_25 0.163σ 0.202σ 0.136σ 0.0731σ 0.14σ
TestJump_test_facility_5 0.164σ -0.0328σ -0.0877σ -0.0908σ -0.0862σ
TestJump_test_facility_quicksum_25 0.181σ 0.16σ 0.117σ 0.0636σ 0.125σ
TestJump_test_facility_quicksum_5 0.154σ -0.0746σ -0.224σ -0.0848σ -0.0461σ
TestJump_test_lqcp_10 0.479σ -0.538σ -0.387σ -0.405σ -0.406σ
TestJump_test_lqcp_500 0.0564σ 0.197σ 0.169σ 0.0203σ 0.0256σ
TestJump_test_lqcp_quicksum_10 0.34σ -0.524σ -0.499σ -0.539σ -0.371σ
TestJump_test_lqcp_quicksum_500 0.0401σ 0.0885σ 0.0799σ 0.0122σ -0.0217σ
TestJump_test_opf_662 0.081σ 0.112σ 0.0401σ
TestJump_test_opf_6620 -0.0166σ 0.0148σ 0.0304σ
TestJump_test_opf_quicksum_662 0.0524σ 0.0485σ 0.0897σ
TestJump_test_opf_quicksum_6620 0.0481σ 0.0272σ 0.11σ
TestDevel_test_issue_691 0.247σ 0.0226σ 0.024σ 0.0995σ 0.071σ
TestModels_test_dcopf_case2383wp 0.293σ 0.128σ 0.15σ 0.0482σ 0.0249σ
TestModels_test_uc_20140901_expected 0.142σ 0.246σ 0.175σ 0.0775σ 0.174σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.175σ 0.404σ 0.319σ
TestMisc_test_bilinear_100 0.687σ -0.389σ -0.403σ -0.321σ -0.327σ
TestMisc_test_bilinear_100000 0.809σ 0.17σ 0.393σ 0.304σ 0.263σ
TestMisc_test_bilinear_nlcontext_100 0.817σ -0.379σ -0.468σ -0.259σ -0.178σ
TestMisc_test_bilinear_nlcontext_100000 0.39σ 0.172σ 0.359σ 0.32σ 0.311σ
TestMisc_test_diag_quicksum_100 0.61σ -0.509σ -0.567σ -0.594σ -0.567σ
TestMisc_test_diag_quicksum_100000 0.468σ -0.111σ 0.095σ 0.0598σ 0.00865σ
TestMisc_test_diag_sum_100 0.547σ -0.741σ -0.867σ -0.992σ -0.604σ
TestMisc_test_diag_sum_100000 0.324σ -0.0494σ 0.068σ 0.142σ -0.0489σ
TestMisc_test_pmedian_quicksum_test4 -0.531σ -0.124σ -0.0775σ 0.0774σ -0.0559σ
TestMisc_test_pmedian_quicksum_test8 0.157σ 0.214σ 0.283σ 0.153σ 0.025σ
TestMisc_test_pmedian_sum_test4 -0.354σ -0.249σ -0.184σ -0.065σ -0.0508σ
TestMisc_test_pmedian_sum_test8 0.104σ 0.295σ 0.368σ 0.118σ 0.0294σ
TestMisc_test_pmedian_tuple_test4 -0.303σ -0.223σ 0.0727σ 0.0261σ -0.087σ
TestMisc_test_pmedian_tuple_test8 0.306σ 0.204σ 0.207σ 0.202σ 0.0636σ
TestJump_test_clnlbean_5000 0.218σ 0.0173σ 0.595σ
TestJump_test_clnlbean_50000 0.269σ 0.0646σ 0.342σ
TestJump_test_facility_25 0.173σ 0.000863σ 0.0505σ 0.0501σ 0.117σ
TestJump_test_facility_5 0.145σ -0.336σ -0.223σ -0.209σ -0.0996σ
TestJump_test_facility_quicksum_25 0.256σ 0.0327σ 0.0514σ 0.0801σ 0.0857σ
TestJump_test_facility_quicksum_5 0.0886σ -0.392σ -0.0913σ -0.246σ -0.0843σ
TestJump_test_lqcp_10 0.582σ -0.867σ -0.699σ -0.794σ -0.393σ
TestJump_test_lqcp_500 0.346σ 0.111σ 0.0663σ 0.0876σ 0.195σ
TestJump_test_lqcp_quicksum_10 0.447σ -0.596σ -0.691σ -0.536σ -0.225σ
TestJump_test_lqcp_quicksum_500 0.285σ 0.0686σ 0.0907σ 0.138σ 0.24σ
TestJump_test_opf_662 0.154σ 0.0661σ 0.417σ
TestJump_test_opf_6620 0.239σ 0.196σ 0.268σ
TestJump_test_opf_quicksum_662 0.19σ 0.0997σ 0.217σ
TestJump_test_opf_quicksum_6620 0.24σ 0.0826σ 0.408σ
TestDevel_test_issue_691 0.816σ 0.464σ 0.197σ 0.19σ 0.145σ
TestModels_test_dcopf_case2383wp 0.558σ -0.0282σ 0.111σ 0.103σ 0.166σ
TestModels_test_uc_20140901_expected 0.0975σ 0.0397σ 0.126σ 0.0648σ 0.00827σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.512σ 0.107σ 0.0731σ
TestMisc_test_bilinear_100 0.15σ -0.236σ -0.638σ -0.469σ -0.752σ
TestMisc_test_bilinear_100000 0.368σ 0.0566σ 0.187σ -0.0198σ 0.0911σ
TestMisc_test_bilinear_nlcontext_100 0.363σ -0.838σ -0.794σ -0.823σ -0.786σ
TestMisc_test_bilinear_nlcontext_100000 0.432σ 0.123σ 0.138σ 0.0122σ 0.108σ
TestMisc_test_diag_quicksum_100 0.669σ -0.849σ -1.02σ -0.835σ -0.782σ
TestMisc_test_diag_quicksum_100000 0.0706σ -0.118σ -0.0227σ 0.0297σ 0.137σ
TestMisc_test_diag_sum_100 0.462σ -0.887σ -0.701σ -0.756σ -0.706σ
TestMisc_test_diag_sum_100000 0.0526σ -0.093σ -0.122σ 0.0127σ 0.217σ
TestMisc_test_pmedian_quicksum_test4 -0.378σ -0.201σ -0.17σ -0.0691σ 0.000798σ
TestMisc_test_pmedian_quicksum_test8 0.0412σ -0.1σ -0.033σ -0.0574σ 0.0674σ
TestMisc_test_pmedian_sum_test4 -0.575σ -0.327σ -0.0987σ -0.05σ 0.0219σ
TestMisc_test_pmedian_sum_test8 0.133σ -0.00762σ -0.00816σ -0.0393σ 0.07σ
TestMisc_test_pmedian_tuple_test4 -0.379σ -0.362σ -0.163σ -0.081σ -0.114σ
TestMisc_test_pmedian_tuple_test8 -0.018σ -0.109σ -0.00957σ 0.0587σ 0.0789σ
TestJump_test_clnlbean_5000 0.0915σ 0.0325σ 0.0479σ
TestJump_test_clnlbean_50000 0.0555σ 0.0359σ 0.0501σ
TestJump_test_facility_25 0.238σ 0.164σ -0.0434σ -0.00336σ 0.162σ
TestJump_test_facility_5 0.198σ -0.171σ -0.215σ -0.199σ -0.0586σ
TestJump_test_facility_quicksum_25 0.273σ 0.0685σ -0.0464σ -0.000199σ 0.0952σ
TestJump_test_facility_quicksum_5 0.129σ -0.288σ -0.226σ -0.179σ -0.0405σ
TestJump_test_lqcp_10 0.0828σ -0.801σ -0.748σ -0.751σ -0.528σ
TestJump_test_lqcp_500 0.0683σ -0.0137σ -0.112σ -0.0462σ 0.0574σ
TestJump_test_lqcp_quicksum_10 0.161σ -0.381σ -1.17σ -0.759σ -0.661σ
TestJump_test_lqcp_quicksum_500 0.155σ -0.0662σ 0.0236σ -0.0985σ 0.0403σ
TestJump_test_opf_662 -0.104σ 0.115σ 0.0444σ
TestJump_test_opf_6620 -0.129σ 0.0149σ 0.0696σ
TestJump_test_opf_quicksum_662 -0.174σ -0.00816σ 0.21σ
TestJump_test_opf_quicksum_6620 -0.116σ -0.0663σ 0.0691σ
TestDevel_test_issue_691 0.00312σ 0.0404σ 0.0196σ -0.0383σ -0.159σ
TestModels_test_dcopf_case2383wp 0.32σ -0.0933σ -0.163σ -0.146σ 0.204σ
TestModels_test_uc_20140901_expected -0.0322σ -0.0199σ 0.0157σ -0.144σ 0.0719σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.316σ 1.7σ 0.075σ
TestMisc_test_bilinear_100 1.14σ 0.888σ 0.716σ 0.779σ 0.772σ
TestMisc_test_bilinear_100000 0.277σ 0.518σ 0.342σ 1.9σ 1.46σ
TestMisc_test_bilinear_nlcontext_100 0.709σ 0.801σ 0.971σ 0.933σ 0.936σ
TestMisc_test_bilinear_nlcontext_100000 0.845σ 0.478σ 0.163σ 1.62σ 1.3σ
TestMisc_test_diag_quicksum_100 0.69σ 0.86σ 0.769σ 0.96σ 0.528σ
TestMisc_test_diag_quicksum_100000 0.825σ -0.229σ 0.333σ 0.226σ 0.175σ
TestMisc_test_diag_sum_100 1.55σ 0.695σ 0.86σ 0.829σ 0.862σ
TestMisc_test_diag_sum_100000 1.06σ -0.0608σ 0.341σ 0.284σ 0.7σ
TestMisc_test_pmedian_quicksum_test4 0.786σ 0.704σ 0.777σ 0.608σ 0.185σ
TestMisc_test_pmedian_quicksum_test8 0.937σ 0.0695σ 0.631σ 0.565σ 0.514σ
TestMisc_test_pmedian_sum_test4 0.511σ 0.898σ 0.99σ 0.574σ 0.64σ
TestMisc_test_pmedian_sum_test8 0.993σ 0.445σ 0.6σ 0.247σ 0.739σ
TestMisc_test_pmedian_tuple_test4 0.457σ 0.61σ 0.713σ 0.66σ 0.44σ
TestMisc_test_pmedian_tuple_test8 1.19σ 0.375σ 0.272σ 0.137σ 0.325σ
TestJump_test_clnlbean_5000 0.397σ 0.154σ 0.853σ
TestJump_test_clnlbean_50000 1.01σ 0.377σ 1.18σ
TestJump_test_facility_25 0.476σ 0.38σ 0.717σ 0.66σ 0.286σ
TestJump_test_facility_5 0.619σ 0.366σ 1.16σ 0.576σ 0.963σ
TestJump_test_facility_quicksum_25 0.356σ 0.224σ 0.228σ 0.389σ 1.02σ
TestJump_test_facility_quicksum_5 0.486σ 0.495σ 0.704σ 0.462σ 0.979σ
TestJump_test_lqcp_10 0.324σ 0.669σ 0.791σ 0.866σ 0.646σ
TestJump_test_lqcp_500 0.48σ 1.04σ 1.23σ 1.1σ 1.66σ
TestJump_test_lqcp_quicksum_10 0.66σ 0.863σ 0.726σ 0.712σ 0.691σ
TestJump_test_lqcp_quicksum_500 1.17σ 0.627σ 0.738σ 0.941σ 1.32σ
TestJump_test_opf_662 0.733σ 0.419σ 1.45σ
TestJump_test_opf_6620 0.456σ 0.248σ 0.564σ
TestJump_test_opf_quicksum_662 0.248σ 0.995σ 0.929σ
TestJump_test_opf_quicksum_6620 0.552σ 1.11σ 1.22σ
TestDevel_test_issue_691 0.94σ 1.19σ 1.13σ 0.214σ 1.4σ
TestModels_test_dcopf_case2383wp 1.12σ 0.379σ 0.731σ 0.62σ 1.3σ
TestModels_test_uc_20140901_expected 0.865σ 1.13σ 1.35σ 0.612σ 1.04σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.17σ 0.173σ 0.192σ
TestMisc_test_bilinear_100 0.332σ -0.366σ -0.565σ -0.337σ -0.299σ
TestMisc_test_bilinear_100000 0.181σ 0.119σ 0.185σ 0.19σ 0.0669σ
TestMisc_test_bilinear_nlcontext_100 0.0665σ -0.674σ -0.197σ -0.607σ -0.564σ
TestMisc_test_bilinear_nlcontext_100000 0.0872σ 0.164σ 0.192σ 0.154σ 0.0547σ
TestMisc_test_diag_quicksum_100 1.03σ -0.472σ -0.332σ -0.649σ -0.623σ
TestMisc_test_diag_quicksum_100000 0.0862σ -0.0198σ -0.0368σ 0.113σ 0.167σ
TestMisc_test_diag_sum_100 0.99σ -0.767σ -0.671σ -0.647σ -0.432σ
TestMisc_test_diag_sum_100000 0.0889σ 0.0478σ 0.0327σ 0.12σ 0.122σ
TestMisc_test_pmedian_quicksum_test4 -0.23σ -0.163σ -0.0895σ -0.00253σ 0.00129σ
TestMisc_test_pmedian_quicksum_test8 0.0435σ -0.0181σ 0.203σ 0.186σ 0.178σ
TestMisc_test_pmedian_sum_test4 -0.583σ 0.384σ -0.0703σ 0.00178σ 0.0542σ
TestMisc_test_pmedian_sum_test8 0.000581σ 0.0113σ 0.0198σ 0.219σ 0.269σ
TestMisc_test_pmedian_tuple_test4 -0.34σ -0.069σ -0.0357σ 0.0449σ 0.0344σ
TestMisc_test_pmedian_tuple_test8 0.462σ 0.0633σ 0.0462σ 0.204σ 0.17σ
TestJump_test_clnlbean_5000 0.155σ 0.184σ 0.114σ
TestJump_test_clnlbean_50000 0.262σ 0.107σ 0.0362σ
TestJump_test_facility_25 0.26σ 0.136σ 0.0805σ 0.0704σ 0.115σ
TestJump_test_facility_5 0.414σ -0.0311σ -0.061σ -0.133σ -0.0761σ
TestJump_test_facility_quicksum_25 0.35σ 0.0514σ -0.0121σ 0.132σ 0.115σ
TestJump_test_facility_quicksum_5 0.23σ -0.231σ -0.228σ -0.0386σ -0.0307σ
TestJump_test_lqcp_10 0.827σ -0.484σ -0.476σ -0.476σ -0.416σ
TestJump_test_lqcp_500 0.184σ 0.144σ -0.00427σ 0.0122σ -0.0106σ
TestJump_test_lqcp_quicksum_10 0.564σ -0.566σ -0.528σ -0.556σ -0.435σ
TestJump_test_lqcp_quicksum_500 0.346σ 0.122σ -0.00844σ 0.0944σ -0.0285σ
TestJump_test_opf_662 0.0169σ 0.0206σ 0.0976σ
TestJump_test_opf_6620 0.423σ 0.0918σ 0.0756σ
TestJump_test_opf_quicksum_662 0.0891σ 0.0685σ 0.123σ
TestJump_test_opf_quicksum_6620 0.365σ 0.0508σ 0.0919σ
TestDevel_test_issue_691 0.316σ 0.13σ 0.13σ 0.371σ 0.273σ
TestModels_test_dcopf_case2383wp 0.324σ 0.0402σ 0.105σ 0.133σ 0.0419σ
TestModels_test_uc_20140901_expected 0.309σ 0.0192σ -0.00918σ 0.102σ 0.0617σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.119σ 0.0512σ 0.0845σ
TestMisc_test_bilinear_100 0.176σ -0.41σ -0.467σ -0.305σ -0.19σ
TestMisc_test_bilinear_100000 0.0843σ 0.211σ 0.12σ 0.122σ 0.174σ
TestMisc_test_bilinear_nlcontext_100 0.229σ -0.501σ -0.522σ -0.61σ -0.25σ
TestMisc_test_bilinear_nlcontext_100000 0.277σ 0.251σ 0.145σ 0.151σ 0.197σ
TestMisc_test_diag_quicksum_100 0.723σ -0.458σ -0.673σ -0.629σ -0.723σ
TestMisc_test_diag_quicksum_100000 0.0273σ 0.263σ 0.17σ 0.151σ 0.155σ
TestMisc_test_diag_sum_100 0.42σ -0.0975σ -0.189σ -0.195σ -0.181σ
TestMisc_test_diag_sum_100000 0.0289σ 0.141σ 0.254σ 0.35σ 0.238σ
TestMisc_test_pmedian_quicksum_test4 -0.296σ -0.0232σ -0.00873σ -0.0435σ 0.0453σ
TestMisc_test_pmedian_quicksum_test8 0.0315σ 0.204σ 0.381σ 0.0481σ 0.264σ
TestMisc_test_pmedian_sum_test4 -0.414σ 0.0135σ 0.00301σ 1.07σ 0.122σ
TestMisc_test_pmedian_sum_test8 0.042σ 0.248σ 0.114σ 0.00526σ 0.235σ
TestMisc_test_pmedian_tuple_test4 -0.378σ 0.0244σ -0.113σ -0.0409σ 0.0859σ
TestMisc_test_pmedian_tuple_test8 0.0803σ 0.182σ 0.241σ 0.0438σ 0.301σ
TestJump_test_clnlbean_5000 0.207σ 0.111σ 0.139σ
TestJump_test_clnlbean_50000 0.207σ 0.175σ 0.191σ
TestJump_test_facility_25 0.179σ 0.281σ 0.11σ 0.153σ 0.184σ
TestJump_test_facility_5 0.0929σ -0.231σ -0.0526σ -0.0456σ -0.0479σ
TestJump_test_facility_quicksum_25 0.101σ 0.225σ 0.442σ 0.196σ 0.159σ
TestJump_test_facility_quicksum_5 0.319σ -0.134σ -0.117σ 0.0265σ 0.00131σ
TestJump_test_lqcp_10 0.13σ -0.52σ -0.462σ -0.51σ -0.372σ
TestJump_test_lqcp_500 -0.0108σ 0.0571σ 0.21σ 0.108σ 0.117σ
TestJump_test_lqcp_quicksum_10 0.00612σ -0.452σ -0.389σ -0.553σ -0.355σ
TestJump_test_lqcp_quicksum_500 -0.0212σ 0.0864σ 0.151σ 0.0419σ 0.0387σ
TestJump_test_opf_662 -0.0258σ 0.0445σ 0.0438σ
TestJump_test_opf_6620 -0.014σ -0.00927σ 0.101σ
TestJump_test_opf_quicksum_662 -0.0125σ 0.0305σ 0.117σ
TestJump_test_opf_quicksum_6620 0.0656σ 0.0683σ 0.0809σ
TestDevel_test_issue_691 0.375σ 0.0595σ 0.0385σ 0.0783σ 0.0647σ
TestModels_test_dcopf_case2383wp 0.084σ 0.0268σ 0.143σ 0.0775σ 0.103σ
TestModels_test_uc_20140901_expected 0.158σ 0.193σ 0.192σ 0.346σ 0.273σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic -0.772σ 0.239σ 0.16σ
TestMisc_test_bilinear_100 0.486σ -0.644σ -0.532σ -0.811σ -1.01σ
TestMisc_test_bilinear_100000 0.458σ 0.496σ 0.517σ 0.363σ 0.423σ
TestMisc_test_bilinear_nlcontext_100 1.18σ -0.965σ -0.798σ -0.858σ -0.621σ
TestMisc_test_bilinear_nlcontext_100000 0.0624σ 0.41σ 0.37σ 0.195σ 0.305σ
TestMisc_test_diag_quicksum_100 0.0483σ -0.663σ -0.673σ -0.909σ -0.779σ
TestMisc_test_diag_quicksum_100000 0.0849σ 0.0304σ 0.147σ 0.139σ 0.324σ
TestMisc_test_diag_sum_100 -0.0384σ -1.21σ -0.907σ -1.03σ -0.813σ
TestMisc_test_diag_sum_100000 0.0566σ 0.123σ 0.149σ 0.0578σ 0.215σ
TestMisc_test_pmedian_quicksum_test4 -0.431σ -0.391σ -0.248σ -0.151σ 0.188σ
TestMisc_test_pmedian_quicksum_test8 0.0631σ 0.131σ -0.0591σ -0.0212σ 0.305σ
TestMisc_test_pmedian_sum_test4 -0.243σ 0.00328σ -0.122σ 0.082σ 0.18σ
TestMisc_test_pmedian_sum_test8 0.0409σ 0.213σ 0.105σ 0.0277σ 0.367σ
TestMisc_test_pmedian_tuple_test4 -0.486σ -0.24σ -0.512σ -0.117σ 0.0795σ
TestMisc_test_pmedian_tuple_test8 0.133σ 0.104σ -0.0491σ -0.0275σ 0.292σ
TestJump_test_clnlbean_5000 0.225σ 0.0191σ 0.194σ
TestJump_test_clnlbean_50000 0.384σ 0.0759σ 0.122σ
TestJump_test_facility_25 0.416σ -0.0235σ -0.15σ 0.199σ -0.0351σ
TestJump_test_facility_5 0.11σ -0.403σ -0.502σ -0.182σ -0.304σ
TestJump_test_facility_quicksum_25 0.304σ -0.0835σ -0.149σ 0.0209σ -0.108σ
TestJump_test_facility_quicksum_5 0.104σ -0.464σ -0.268σ -0.197σ -0.251σ
TestJump_test_lqcp_10 0.109σ -0.806σ -0.476σ -0.513σ -0.517σ
TestJump_test_lqcp_500 0.433σ 0.0536σ -0.131σ -0.0231σ -0.0635σ
TestJump_test_lqcp_quicksum_10 0.141σ -0.478σ -0.697σ -0.44σ -0.66σ
TestJump_test_lqcp_quicksum_500 0.16σ 0.0378σ -0.0111σ 0.126σ 0.0149σ
TestJump_test_opf_662 0.114σ 0.0278σ 0.222σ
TestJump_test_opf_6620 0.329σ -0.0287σ 0.12σ
TestJump_test_opf_quicksum_662 0.123σ -0.0162σ 0.17σ
TestJump_test_opf_quicksum_6620 0.0633σ 0.00661σ 0.137σ
TestDevel_test_issue_691 0.785σ 0.171σ 0.304σ 0.301σ 0.47σ
TestModels_test_dcopf_case2383wp 0.631σ -0.0736σ -0.0818σ 0.0443σ 0.0945σ
TestModels_test_uc_20140901_expected 0.0612σ 0.19σ -0.0254σ 0.119σ 0.136σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 0.601σ 0.342σ 0.0961σ
TestMisc_test_bilinear_100 0.22σ -0.914σ -1.33σ -1.17σ -0.506σ
TestMisc_test_bilinear_100000 0.105σ 0.0649σ -0.132σ 0.308σ 0.47σ
TestMisc_test_bilinear_nlcontext_100 0.499σ -0.713σ -1.04σ -0.849σ -0.731σ
TestMisc_test_bilinear_nlcontext_100000 0.364σ 0.0729σ -0.0805σ 0.123σ 0.323σ
TestMisc_test_diag_quicksum_100 0.763σ -0.826σ -0.944σ -0.997σ -0.454σ
TestMisc_test_diag_quicksum_100000 0.189σ -0.128σ -0.132σ 0.0199σ 0.113σ
TestMisc_test_diag_sum_100 -0.0241σ -1.19σ -1.24σ -0.92σ -0.891σ
TestMisc_test_diag_sum_100000 0.117σ -0.159σ -0.205σ 0.0988σ 0.0452σ
TestMisc_test_pmedian_quicksum_test4 -0.286σ -0.51σ -0.738σ -0.0286σ -0.121σ
TestMisc_test_pmedian_quicksum_test8 0.29σ -0.152σ -0.223σ 0.0365σ -0.0221σ
TestMisc_test_pmedian_sum_test4 -0.278σ -0.622σ -0.45σ -0.115σ -0.118σ
TestMisc_test_pmedian_sum_test8 0.204σ -0.185σ -0.0739σ 0.0171σ 0.0359σ
TestMisc_test_pmedian_tuple_test4 -0.219σ -0.362σ -0.31σ 0.0352σ -0.138σ
TestMisc_test_pmedian_tuple_test8 0.134σ -0.0929σ -0.149σ -0.0215σ 0.0164σ
TestJump_test_clnlbean_5000 0.0815σ 0.0479σ 0.104σ
TestJump_test_clnlbean_50000 0.09σ 0.0179σ 0.15σ
TestJump_test_facility_25 0.249σ 0.0257σ -0.0483σ 0.0217σ 0.109σ
TestJump_test_facility_5 0.175σ -0.409σ -0.364σ 0.189σ -0.037σ
TestJump_test_facility_quicksum_25 0.162σ 0.0143σ 0.0524σ 0.0663σ 0.113σ
TestJump_test_facility_quicksum_5 0.227σ -0.298σ -0.0231σ -0.195σ 0.00261σ
TestJump_test_lqcp_10 0.272σ -0.0347σ -0.638σ -0.539σ -0.323σ
TestJump_test_lqcp_500 0.0531σ 0.0906σ -0.047σ 0.184σ 0.0898σ
TestJump_test_lqcp_quicksum_10 0.336σ -0.91σ -0.745σ -0.32σ -0.572σ
TestJump_test_lqcp_quicksum_500 0.0871σ 0.0147σ -0.112σ 0.0611σ 0.0916σ
TestJump_test_opf_662 0.141σ -0.00711σ 0.197σ
TestJump_test_opf_6620 0.272σ 0.101σ 0.167σ
TestJump_test_opf_quicksum_662 0.0806σ 0.13σ 0.137σ
TestJump_test_opf_quicksum_6620 0.0638σ 0.0646σ 0.338σ
TestDevel_test_issue_691 0.251σ 0.0566σ 0.0371σ 0.104σ 0.261σ
TestModels_test_dcopf_case2383wp 0.189σ 0.0691σ 0.0208σ 0.153σ 0.243σ
TestModels_test_uc_20140901_expected 0.118σ -0.0124σ -0.0308σ -0.0539σ 0.0368σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.65σ 1.24σ 1.2σ
TestMisc_test_bilinear_100 0.352σ 1.63σ 1.64σ 1.51σ 1.55σ
TestMisc_test_bilinear_100000 1.68σ 1.57σ 1.87σ 1.61σ 1.39σ
TestMisc_test_bilinear_nlcontext_100 1.24σ 0.573σ 0.996σ 1.15σ 1.64σ
TestMisc_test_bilinear_nlcontext_100000 2.11σ 1.22σ 1.64σ 1.88σ 1.68σ
TestMisc_test_diag_quicksum_100 1.2σ 1.04σ 0.926σ 0.136σ 0.686σ
TestMisc_test_diag_quicksum_100000 1.31σ 1.37σ 1.56σ 0.693σ 0.4σ
TestMisc_test_diag_sum_100 1.19σ 0.943σ 1.33σ 1.69σ 1.61σ
TestMisc_test_diag_sum_100000 1.36σ 1.48σ 1.68σ 1.58σ 1.57σ
TestMisc_test_pmedian_quicksum_test4 1.66σ 1.71σ 0.94σ 1.42σ 1.41σ
TestMisc_test_pmedian_quicksum_test8 0.848σ 0.764σ 1.07σ 1.46σ 0.963σ
TestMisc_test_pmedian_sum_test4 2.11σ 1.85σ 1.52σ 1.31σ 1.62σ
TestMisc_test_pmedian_sum_test8 1.96σ 0.208σ 0.192σ 1.34σ 1.52σ
TestMisc_test_pmedian_tuple_test4 1.92σ 1.56σ 1.43σ 1.41σ 1.82σ
TestMisc_test_pmedian_tuple_test8 1.72σ 1.25σ 0.479σ 0.436σ 0.895σ
TestJump_test_clnlbean_5000 0.281σ 0.0958σ 0.466σ
TestJump_test_clnlbean_50000 0.991σ 0.548σ 0.115σ
TestJump_test_facility_25 0.184σ 0.605σ 1.01σ 1.33σ 0.785σ
TestJump_test_facility_5 1.89σ 1.03σ 1.78σ 1.01σ 0.742σ
TestJump_test_facility_quicksum_25 1.86σ 1.09σ 0.433σ 1.68σ 0.191σ
TestJump_test_facility_quicksum_5 0.265σ 0.403σ 0.386σ 0.292σ 0.239σ
TestJump_test_lqcp_10 0.735σ 1.34σ 0.577σ 0.878σ 0.569σ
TestJump_test_lqcp_500 0.605σ 1.22σ 1.03σ 1.69σ 1.01σ
TestJump_test_lqcp_quicksum_10 1.57σ 0.949σ 0.67σ 1.35σ 1.65σ
TestJump_test_lqcp_quicksum_500 1.29σ 0.688σ 0.665σ 1.73σ 0.829σ
TestJump_test_opf_662 0.226σ 0.341σ 0.345σ
TestJump_test_opf_6620 0.532σ 0.218σ 1.2σ
TestJump_test_opf_quicksum_662 1.14σ 0.949σ 1.13σ
TestJump_test_opf_quicksum_6620 1.02σ 0.842σ 1.59σ
TestDevel_test_issue_691 0.912σ 1.31σ 1.66σ 0.441σ 1.05σ
TestModels_test_dcopf_case2383wp 0.641σ 1.37σ 1.25σ 1.29σ 1.34σ
TestModels_test_uc_20140901_expected 1.66σ 0.9σ 0.258σ 0.61σ 1.12σ

Problem\Measure create_instance discretize postprocessing nl lp bar gams
TestStochPDEgas_test_stochpdegas_automatic 1.03σ 0.394σ 1.19σ
TestMisc_test_bilinear_100 0.752σ 1.5σ 1.38σ 1.74σ 1.52σ
TestMisc_test_bilinear_100000 0.395σ 0.32σ 0.645σ 0.345σ 0.345σ
TestMisc_test_bilinear_nlcontext_100 1.66σ 1.25σ 1.1σ 1.2σ 1.52σ
TestMisc_test_bilinear_nlcontext_100000 0.593σ 0.287σ 0.11σ 0.0916σ 0.854σ
TestMisc_test_diag_quicksum_100 1.83σ 1.8σ 1.25σ 2.24σ 1.8σ
TestMisc_test_diag_quicksum_100000 0.277σ 0.114σ 0.149σ 0.678σ 0.534σ
TestMisc_test_diag_sum_100 1.36σ 1.88σ 1.19σ 1.8σ 1.28σ
TestMisc_test_diag_sum_100000 0.151σ 0.498σ 0.26σ 0.191σ 0.337σ
TestMisc_test_pmedian_quicksum_test4 0.613σ 1.14σ 0.625σ 0.331σ 0.426σ
TestMisc_test_pmedian_quicksum_test8 0.195σ 0.189σ 0.403σ 0.271σ 0.275σ
TestMisc_test_pmedian_sum_test4 0.853σ 1.26σ 0.626σ 0.839σ 0.578σ
TestMisc_test_pmedian_sum_test8 0.254σ 0.0778σ 0.476σ 0.328σ 0.193σ
TestMisc_test_pmedian_tuple_test4 1.31σ 0.822σ 0.0387σ 1.0σ 0.251σ
TestMisc_test_pmedian_tuple_test8 0.14σ 0.216σ 0.46σ 0.169σ 0.404σ
TestJump_test_clnlbean_5000 0.836σ 1.83σ 0.953σ
TestJump_test_clnlbean_50000 0.705σ 1.48σ 0.79σ
TestJump_test_facility_25 0.31σ 1.65σ 0.21σ 0.246σ 0.0863σ
TestJump_test_facility_5 0.0902σ 0.222σ 0.238σ 0.119σ 0.255σ
TestJump_test_facility_quicksum_25 0.0617σ 1.39σ 0.392σ 0.156σ 0.882σ
TestJump_test_facility_quicksum_5 0.492σ 0.95σ 1.21σ 0.47σ 0.864σ
TestJump_test_lqcp_10 0.877σ 1.02σ 1.7σ 1.48σ 1.28σ
TestJump_test_lqcp_500 1.12σ 0.922σ 0.883σ 0.15σ 0.606σ
TestJump_test_lqcp_quicksum_10 0.166σ 1.28σ 1.43σ 1.44σ 0.7σ
TestJump_test_lqcp_quicksum_500 0.425σ 0.783σ 0.538σ 0.271σ 0.607σ
TestJump_test_opf_662 0.291σ 0.791σ 1.03σ
TestJump_test_opf_6620 0.708σ 0.858σ 0.519σ
TestJump_test_opf_quicksum_662 0.519σ 0.78σ 1.44σ
TestJump_test_opf_quicksum_6620 1.48σ 0.107σ 0.296σ
TestDevel_test_issue_691 0.244σ 0.05σ 0.02σ 0.0562σ 0.0786σ
TestModels_test_dcopf_case2383wp 1.3σ 1.47σ 1.11σ 1.49σ 0.623σ
TestModels_test_uc_20140901_expected 1.34σ 1.23σ 0.816σ 1.0σ 0.948σ