master-2.json ============= Performance version: 0.7.0 Report on Linux-4.15.0-42-generic-x86_64-with-glibc2.26 Number of logical CPUs: 8 Start date: 2019-01-21 15:01:28.390575 End date: 2019-01-21 15:42:37.276171 pydict-getitem-2.json ===================== Performance version: 0.7.0 Report on Linux-4.15.0-42-generic-x86_64-with-glibc2.26 Number of logical CPUs: 8 Start date: 2019-01-21 16:20:37.640218 End date: 2019-01-21 17:01:30.618245 ### 2to3 ### Mean +- std dev: 473 ms +- 6 ms -> 461 ms +- 6 ms: 1.03x faster Significant (t=15.35) ### chaos ### Mean +- std dev: 172 ms +- 3 ms -> 165 ms +- 3 ms: 1.05x faster Significant (t=18.97) ### crypto_pyaes ### Mean +- std dev: 173 ms +- 3 ms -> 165 ms +- 3 ms: 1.05x faster Significant (t=18.19) ### deltablue ### Mean +- std dev: 11.3 ms +- 0.3 ms -> 11.2 ms +- 0.3 ms: 1.00x faster Not significant ### django_template ### Mean +- std dev: 184 ms +- 4 ms -> 180 ms +- 3 ms: 1.02x faster Significant (t=8.35) ### dulwich_log ### Mean +- std dev: 111 ms +- 2 ms -> 108 ms +- 2 ms: 1.02x faster Significant (t=9.55) ### fannkuch ### Mean +- std dev: 641 ms +- 24 ms -> 607 ms +- 9 ms: 1.06x faster Significant (t=14.58) ### float ### Mean +- std dev: 154 ms +- 3 ms -> 164 ms +- 7 ms: 1.07x slower Significant (t=-15.90) ### go ### Mean +- std dev: 398 ms +- 29 ms -> 373 ms +- 8 ms: 1.07x faster Significant (t=9.00) ### hexiom ### Mean +- std dev: 17.1 ms +- 0.5 ms -> 15.5 ms +- 0.4 ms: 1.10x faster Significant (t=28.95) ### html5lib ### Mean +- std dev: 137 ms +- 8 ms -> 137 ms +- 8 ms: 1.00x slower Not significant ### json_dumps ### Mean +- std dev: 18.1 ms +- 0.3 ms -> 18.4 ms +- 0.3 ms: 1.02x slower Not significant ### json_loads ### Mean +- std dev: 38.0 us +- 0.9 us -> 39.1 us +- 0.9 us: 1.03x slower Significant (t=-9.73) ### logging_format ### Mean +- std dev: 15.5 us +- 0.5 us -> 15.7 us +- 0.3 us: 1.02x slower Not significant ### logging_silent ### Mean +- std dev: 320 ns +- 12 ns -> 308 ns +- 14 ns: 1.04x faster Significant (t=7.47) ### logging_simple ### Mean +- std dev: 14.4 us +- 0.3 us -> 15.0 us +- 0.3 us: 1.05x slower Significant (t=-15.13) ### mako ### Mean +- std dev: 24.2 ms +- 0.4 ms -> 24.7 ms +- 0.4 ms: 1.02x slower Not significant ### meteor_contest ### Mean +- std dev: 144 ms +- 6 ms -> 151 ms +- 3 ms: 1.05x slower Significant (t=-12.04) ### nbody ### Mean +- std dev: 172 ms +- 2 ms -> 178 ms +- 5 ms: 1.04x slower Significant (t=-12.80) ### nqueens ### Mean +- std dev: 145 ms +- 9 ms -> 146 ms +- 3 ms: 1.01x slower Not significant ### pathlib ### Mean +- std dev: 30.8 ms +- 0.6 ms -> 31.3 ms +- 1.1 ms: 1.02x slower Not significant ### pickle ### Mean +- std dev: 12.2 us +- 0.2 us -> 12.3 us +- 0.2 us: 1.01x slower Not significant ### pickle_dict ### Mean +- std dev: 32.0 us +- 0.4 us -> 32.1 us +- 0.7 us: 1.00x slower Not significant ### pickle_list ### Mean +- std dev: 5.00 us +- 0.09 us -> 4.95 us +- 0.12 us: 1.01x faster Not significant ### pickle_pure_python ### Mean +- std dev: 723 us +- 31 us -> 704 us +- 27 us: 1.03x faster Significant (t=4.91) ### pidigits ### Mean +- std dev: 228 ms +- 4 ms -> 229 ms +- 9 ms: 1.00x slower Not significant ### python_startup ### Mean +- std dev: 12.2 ms +- 0.3 ms -> 12.2 ms +- 0.2 ms: 1.00x slower Not significant ### python_startup_no_site ### Mean +- std dev: 8.37 ms +- 0.18 ms -> 8.29 ms +- 0.18 ms: 1.01x faster Not significant ### raytrace ### Mean +- std dev: 758 ms +- 21 ms -> 831 ms +- 39 ms: 1.10x slower Significant (t=-18.25) ### regex_compile ### Mean +- std dev: 257 ms +- 8 ms -> 275 ms +- 7 ms: 1.07x slower Significant (t=-19.25) ### regex_dna ### Mean +- std dev: 214 ms +- 13 ms -> 229 ms +- 3 ms: 1.07x slower Significant (t=-12.03) ### regex_effbot ### Mean +- std dev: 3.67 ms +- 0.11 ms -> 3.92 ms +- 0.11 ms: 1.07x slower Significant (t=-18.29) ### regex_v8 ### Mean +- std dev: 28.8 ms +- 0.5 ms -> 31.4 ms +- 0.7 ms: 1.09x slower Significant (t=-34.37) ### richards ### Mean +- std dev: 110 ms +- 4 ms -> 120 ms +- 9 ms: 1.09x slower Significant (t=-10.54) ### scimark_fft ### Mean +- std dev: 466 ms +- 12 ms -> 488 ms +- 11 ms: 1.05x slower Significant (t=-15.15) ### scimark_lu ### Mean +- std dev: 251 ms +- 6 ms -> 256 ms +- 8 ms: 1.02x slower Not significant ### scimark_monte_carlo ### Mean +- std dev: 152 ms +- 3 ms -> 151 ms +- 4 ms: 1.01x faster Not significant ### scimark_sor ### Mean +- std dev: 283 ms +- 14 ms -> 280 ms +- 8 ms: 1.01x faster Not significant ### scimark_sparse_mat_mult ### Mean +- std dev: 5.90 ms +- 0.17 ms -> 5.90 ms +- 0.07 ms: 1.00x faster Not significant ### spectral_norm ### Mean +- std dev: 187 ms +- 5 ms -> 186 ms +- 10 ms: 1.00x faster Not significant ### sqlalchemy_declarative ### Mean +- std dev: 225 ms +- 5 ms -> 222 ms +- 5 ms: 1.01x faster Not significant ### sqlalchemy_imperative ### Mean +- std dev: 41.3 ms +- 1.4 ms -> 42.3 ms +- 1.6 ms: 1.02x slower Significant (t=-5.06) ### sqlite_synth ### Mean +- std dev: 4.33 us +- 0.13 us -> 4.29 us +- 0.13 us: 1.01x faster Not significant ### sympy_expand ### Mean +- std dev: 595 ms +- 19 ms -> 589 ms +- 12 ms: 1.01x faster Not significant ### sympy_integrate ### Mean +- std dev: 26.7 ms +- 0.8 ms -> 26.8 ms +- 1.5 ms: 1.01x slower Not significant ### sympy_str ### Mean +- std dev: 283 ms +- 11 ms -> 276 ms +- 4 ms: 1.03x faster Significant (t=6.93) ### sympy_sum ### Mean +- std dev: 144 ms +- 6 ms -> 144 ms +- 4 ms: 1.00x faster Not significant ### telco ### Mean +- std dev: 9.27 ms +- 0.29 ms -> 9.09 ms +- 0.24 ms: 1.02x faster Not significant ### tornado_http ### Mean +- std dev: 273 ms +- 5 ms -> 266 ms +- 9 ms: 1.02x faster Significant (t=6.90) ### unpack_sequence ### Mean +- std dev: 66.7 ns +- 3.2 ns -> 64.9 ns +- 7.5 ns: 1.03x faster Significant (t=2.45) ### unpickle ### Mean +- std dev: 23.0 us +- 0.4 us -> 20.7 us +- 0.4 us: 1.11x faster Significant (t=44.71) ### unpickle_list ### Mean +- std dev: 6.79 us +- 0.17 us -> 5.79 us +- 0.08 us: 1.17x faster Significant (t=59.02) ### unpickle_pure_python ### Mean +- std dev: 543 us +- 37 us -> 505 us +- 11 us: 1.07x faster Significant (t=10.56) ### xml_etree_generate ### Mean +- std dev: 151 ms +- 5 ms -> 148 ms +- 5 ms: 1.02x faster Significant (t=4.82) ### xml_etree_iterparse ### Mean +- std dev: 141 ms +- 3 ms -> 141 ms +- 4 ms: 1.00x faster Not significant ### xml_etree_parse ### Mean +- std dev: 202 ms +- 5 ms -> 202 ms +- 3 ms: 1.00x faster Not significant ### xml_etree_process ### Mean +- std dev: 123 ms +- 3 ms -> 122 ms +- 2 ms: 1.01x faster Not significant