os.getgrouplist() can fail on macOS if the user has more than 17 groups

[corona10]

BPO	40014
Nosy	@ronaldoussoren, @vstinner, @ned-deily, @zooba, @corona10, @miss-islington, @shihai1991
PRs	bpo-40014: Skip os.getgrouplist related test if OSError is raised. #19075 bpo-40014: test.pythoninfo catchs os.getgrouplist() error #19117 bpo-40014: Fix os.getgrouplist() failure on macOS with many groups #19118 [3.8] bpo-40014: Fix os.getgrouplist() on macOS (GH-19118) #19123 [3.7] bpo-40014: Fix os.getgrouplist() on macOS (GH-19118) #19124 bpo-40014: Fix os.getgrouplist() #19126 [3.8] bpo-40014: Fix os.getgrouplist() (GH-19126) #19143 [3.7] bpo-40014: Fix os.getgrouplist() (GH-19126) #19144

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2020-03-24.17:51:27.264>
created_at = <Date 2020-03-19.16:04:54.967>
labels = ['OS-mac', '3.7', '3.8', '3.9', 'type-feature', 'tests']
title = 'os.getgrouplist() can fail on macOS if the user has more than 17 groups'
updated_at = <Date 2020-03-24.17:51:27.264>
user = 'https://github.com/corona10'

bugs.python.org fields:

activity = <Date 2020-03-24.17:51:27.264>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2020-03-24.17:51:27.264>
closer = 'vstinner'
components = ['macOS', 'Tests']
creation = <Date 2020-03-19.16:04:54.967>
creator = 'corona10'
dependencies = []
files = []
hgrepos = []
issue_num = 40014
keywords = ['patch']
message_count = 17.0
messages = ['364607', '364608', '364610', '364615', '364862', '364864', '364870', '364880', '364884', '364885', '364888', '364889', '364904', '364950', '364955', '364956', '364957']
nosy_count = 7.0
nosy_names = ['ronaldoussoren', 'vstinner', 'ned.deily', 'steve.dower', 'corona10', 'miss-islington', 'shihai1991']
pr_nums = ['19075', '19117', '19118', '19123', '19124', '19126', '19143', '19144']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'enhancement'
url = 'https://bugs.python.org/issue40014'
versions = ['Python 3.7', 'Python 3.8', 'Python 3.9']

[corona10]

example: https://github.com/python/cpython/pull/19073/checks?check_run_id=519539592

I suggest to not to add information for os.getgrouplist
if the OSError is raised.

[corona10]

or adding <OSError> might be great just like getpwuid

[vstinner]

These errors are really strange.

Steve Dower: are you aware of anything recent change on the macOS job of Azure Pipelines / GH Actions.

pythoninfo:
---
os.uname: posix.uname_result(sysname='Darwin', nodename='Mac-1422.local', release='19.3.0', version='Darwin Kernel Version 19.3.0: Thu Jan 9 20:58:23 PST 2020; root:xnu-6153.81.5~1/RELEASE_X86_64', machine='x86_64')

platform.architecture: 64bit

platform.platform: macOS-10.15.3-x86_64-i386-64bit
---

example: https://github.com/python/cpython/pull/19073/checks?check_run_id=519539592

./python.exe -m test.pythoninfo
ERROR: collect_pwd() failed
Traceback (most recent call last):
  File "/Users/runner/runners/2.165.2/work/cpython/cpython/Lib/test/pythoninfo.py", line 761, in collect_info
    collect_func(info_add)
  File "/Users/runner/runners/2.165.2/work/cpython/cpython/Lib/test/pythoninfo.py", line 336, in collect_pwd
    groups = os.getgrouplist(entry.pw_name, entry.pw_gid)
OSError: [Errno 0] Error

Collection failed: exit with error

PR 19075

test_posix.test_getgrouplist() failed with:

======================================================================
ERROR: test_getgrouplist (test.test_posix.PosixTester)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/Users/runner/runners/2.165.2/work/cpython/cpython/Lib/test/test_posix.py", line 1028, in test_getgrouplist
    self.assertIn(group, posix.getgrouplist(user, group))
OSError: [Errno 25] Inappropriate ioctl for device

[ned-deily]

This error has to do with the number of groups a particular user is associated with. We’ve squashed similar bugs in the past but it looks like something has changed again in recent releases of macOS. It’s not Azure specific.