resource: RLIMIT_xxx and RUSAGE_xxx constants are missing on macOS 10.15.4

[vstinner]

BPO	40144
Nosy	@ronaldoussoren, @vstinner, @ned-deily, @shihai1991

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2020-04-02.10:11:11.145>
created_at = <Date 2020-04-01.22:29:54.503>
labels = ['OS-mac', 'invalid', 'tests', '3.9']
title = 'resource: RLIMIT_xxx and RUSAGE_xxx constants are missing on macOS 10.15.4'
updated_at = <Date 2020-04-02.10:11:11.144>
user = 'https://github.com/vstinner'

bugs.python.org fields:

activity = <Date 2020-04-02.10:11:11.144>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2020-04-02.10:11:11.145>
closer = 'vstinner'
components = ['macOS', 'Tests']
creation = <Date 2020-04-01.22:29:54.503>
creator = 'vstinner'
dependencies = []
files = []
hgrepos = []
issue_num = 40144
keywords = []
message_count = 9.0
messages = ['365521', '365524', '365525', '365526', '365547', '365573', '365575', '365576', '365577']
nosy_count = 4.0
nosy_names = ['ronaldoussoren', 'vstinner', 'ned.deily', 'shihai1991']
pr_nums = []
priority = 'normal'
resolution = 'not a bug'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue40144'
versions = ['Python 3.9']

[vstinner]

Failure seen on the macOS job on a PR:

https://github.com/python/cpython/pull/19252/checks?check_run_id=552502971
of https://github.com/python/cpython/pull/19252/files

Reformatted error:

AssertionError: Regex didn't match:

"Fatal Python error: _enter_buffered_busy: could not acquire lock for <(_io\\.)?BufferedWriter name='<stderr>'> at interpreter shutdown, possibly due to daemon threads"

not found in

'Traceback (most recent call last):
  File "<string>", line 15, in <module>
  File "/Users/runner/runners/2.165.2/work/cpython/cpython/Lib/test/support/__init__.py", line 2913, in __enter__
    self.old_value = resource.getrlimit(resource.RLIMIT_CORE)
AttributeError: module \'resource\' has no attribute \'RLIMIT_CORE\'
'

It seems like resource.RLIMIT_CORE is not available on this macOS machine.

[vstinner]

https://github.com/python/cpython/pull/19252/checks?check_run_id=552502971

test.pythoninfo says:

os.uname: posix.uname_result(sysname='Darwin', nodename='Mac-1307.local', release='19.4.0', version='Darwin Kernel Version 19.4.0: Wed Mar 4 22:28:40 PST 2020; root:xnu-6153.101.6~15/RELEASE_X86_64', machine='x86_64')

platform.platform: macOS-10.15.4-x86_64-i386-64bit

[vstinner]

Other errors on the same build:

13 tests failed:
test_capi test_cmd_line test_exceptions test_faulthandler test_gc
test_io test_repl test_resource test_selectors test_subprocess
test_sys test_tempfile test_tracemalloc

test_subprocess: AttributeError: module 'resource' has no attribute 'RLIMIT_NOFILE'

test_selectors.test_above_fd_setsize(): AttributeError: module 'resource' has no attribute 'RLIMIT_NOFILE'

test_resource.test_getrusage(): AttributeError: module 'resource' has no attribute 'RUSAGE_SELF'

Many tests failed because of SuppressCrashReport issue (missing resource.RLIMIT_CORE).

[vstinner]

Yesterday, macOS job was fine with test.pythoninfo:

os.uname: posix.uname_result(sysname='Darwin', nodename='Mac-1303.local', release='19.3.0', version='Darwin Kernel Version 19.3.0: Thu Jan 9 20:58:23 PST 2020; root:xnu-6153.81.5~1/RELEASE_X86_64', machine='x86_64')

platform.platform: macOS-10.15.3-x86_64-i386-64bit

So something changed in<sys/resource.h> header between macOS 10.15.3 and macOS 10.15.4.

[vstinner]

I upgraded my macbook to macOS 10.15.4:

$ ./python.exe -m test.pythoninfo|grep -E 'uname|platform'

os.uname: posix.uname_result(sysname='Darwin', nodename='macbook', release='19.4.0', version='Darwin Kernel Version 19.4.0: Wed Mar 4 22:28:40 PST 2020; root:xnu-6153.101.6~15/RELEASE_X86_64', machine='x86_64')

platform.platform: macOS-10.15.4-x86_64-i386-64bit

I get resource attributes:

$ ./python.exe
Python 3.9.0a5+ (heads/master:e27916b, Apr  2 2020, 02:58:34) 
[Clang 11.0.3 (clang-1103.0.32.29)] on darwin
>>> import resource
>>> resource.RLIMIT_CORE
4
>>> resource.RLIMIT_NOFILE
8
>>> resource.RUSAGE_SELF
0

I'm not sure what's wrong with the macOS job. It doesn't seem to use a "framework" build, but:

./configure --with-pydebug --with-openssl=/usr/local/opt/openssl --prefix=/opt/python-dev
make -j4

[ned-deily]

There's nothing wrong with the Azure CI job, AFAICT. The issue seems to be in the changes made by the PR itself. Testing on 10.15.4 from master HEAD, test_resource passes as always. But after applying the PR under test in the CI, PR 19252 from bpo-1635741, the test fails. It wasn't obvious to me from a quick glance what the problem is but it's late here :)

[vstinner]

There's nothing wrong with the Azure CI job, AFAICT. The issue seems to be in the changes made by the PR itself.

The PR modify the resource module. Oh. OOOOH. I see :-D

[shihai1991]

The PR modify the resource module. Oh. OOOOH. I see :-D
Do I miss something?

[vstinner]

Ignore this issue, it's a typo in the PR ;-)