Repository navigation
Windows: enable compiler optimizations when building Python in debug mode #89278
Description
| BPO | 45115 |
|---|---|
| Nosy | @pfmoore, @vstinner, @tjguk, @zware, @zooba, @corona10 |
| PRs |
Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.
Show more details
GitHub fields:
assignee = None
closed_at = <Date 2021-09-07.13:47:19.165>
created_at = <Date 2021-09-06.15:21:42.501>
labels = ['OS-windows', '3.11']
title = 'Windows: enable compiler optimizations when building Python in debug mode'
updated_at = <Date 2021-09-07.13:47:19.164>
user = 'https://github.com/vstinner'bugs.python.org fields:
activity = <Date 2021-09-07.13:47:19.164>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2021-09-07.13:47:19.165>
closer = 'vstinner'
components = ['Windows']
creation = <Date 2021-09-06.15:21:42.501>
creator = 'vstinner'
dependencies = []
files = []
hgrepos = []
issue_num = 45115
keywords = ['patch']
message_count = 5.0
messages = ['401141', '401142', '401145', '401156', '401273']
nosy_count = 6.0
nosy_names = ['paul.moore', 'vstinner', 'tim.golden', 'zach.ware', 'steve.dower', 'corona10']
pr_nums = ['28181', '28128']
priority = 'normal'
resolution = 'rejected'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue45115'
versions = ['Python 3.11']
Activity
vstinner commentedon Sep 6, 2021
The Visual Studio project of Python, PCBuild\ directory, disables compiler optimizations when Python is built in debug mode. It seems to be the default in Visual Studio.
Disabling compiler optimizations cause two kinds of issues:
It increases the stack memory: tests using a deep call stack are more likely to crash (test_pickle, test_marshal, test_exceptions).
Running the Python test suite take 19 min 41 sec instead of 12 min 19 sec on Windows x64: 1.6x slower. Because of that, we cannot use a debug build in the GitHub Action pre-commit CI, and we miss bugs which are catched "too late", in Windows buildbots. See my latest attempt to use a debug build in GitHub Actions: bpo-43244: GitHub Action builds Python in debug mode on Windows #24914
Example of test_marshal:
I propose to only change the compiler options for the pythoncore project which builds most important files for the Python "core". See attached PR.
vstinner commentedon Sep 6, 2021
This change is motivated by my PR 28128 which converts the Py_TYPE() macro to a static inline function. The problem is that by default, MSC disables inlining and test_exceptions does crash with a stack overflow, since my change increases the usage of the stack memory: see bpo-44348.
By the problem is wider than just Py_TYPE().
See also bpo-45094: "Consider using __forceinline and __attribute__((always_inline)) on static inline functions (Py_INCREF, Py_TYPE) for debug builds".
vstinner commentedon Sep 6, 2021
I recently documented the "Python debug build":
https://docs.python.org/dev/using/configure.html#python-debug-build
zooba commentedon Sep 6, 2021
I strongly disagree. If CI needs to be faster, please just change the CI configuration. If contributors have to wait a few minutes longer, they can wait - they'll save that time in local compilations.
Local debugging absolutely relies on debug builds. You'd be destroying the workflow of most Windows-based developers with this change. It's not worth it.
vstinner commentedon Sep 7, 2021
Steve:
Ok, I reject my issue.
I found a portable way to fix bpo-44348: it doesn't depend on the OS, nor the compiler, nor compiler options. The fix is to use the trashcan mecanism in the BaseException deallocator: commit fb30509.