6 tests fail using SOURCE_DATE_EPOCH env var

[vstinner]

BPO	34022
Nosy	@doko42, @vstinner, @benjaminp, @mcepl, @elprans, @serhiy-storchaka, @thehesiod, @yan12125, @eli-schwartz, @miss-islington
PRs	bpo-34022: Unbreak importlib tests when SOURCE_DATE_EPOCH is set #9484 bpo-34022: Stop forcing of hash-based invalidation with SOURCE_DATE_EPOCH #9607 bpo-34726: Fix handling of hash-based pycs in zipimport #10327 [3.7] bpo-34022: Stop forcing of hash-based invalidation with SOURCE_DATE_EPOCH (GH-9607) #10775
Files	osc-build-log.txt

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2018-11-29.00:11:53.335>
created_at = <Date 2018-07-02.12:18:35.907>
labels = ['3.8', '3.7', 'tests']
title = '6 tests fail using SOURCE_DATE_EPOCH env var'
updated_at = <Date 2019-06-28.09:25:54.479>
user = 'https://github.com/vstinner'

bugs.python.org fields:

activity = <Date 2019-06-28.09:25:54.479>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2018-11-29.00:11:53.335>
closer = 'vstinner'
components = ['Tests']
creation = <Date 2018-07-02.12:18:35.907>
creator = 'vstinner'
dependencies = []
files = ['47665']
hgrepos = []
issue_num = 34022
keywords = ['patch']
message_count = 36.0
messages = ['320875', '320876', '320877', '320885', '320886', '320892', '320894', '320895', '320903', '320919', '320924', '320937', '320938', '320939', '320941', '320943', '320944', '321068', '321853', '326053', '326054', '326057', '326578', '326638', '327479', '327828', '329275', '330499', '330508', '330523', '330524', '330525', '330619', '330622', '330640', '346814']
nosy_count = 10.0
nosy_names = ['doko', 'vstinner', 'benjamin.peterson', 'mcepl', 'Elvis.Pranskevichus', 'serhiy.storchaka', 'thehesiod', 'yan12125', 'eschwartz', 'miss-islington']
pr_nums = ['9484', '9607', '10327', '10775']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = None
url = 'https://bugs.python.org/issue34022'
versions = ['Python 3.7', 'Python 3.8']

[vstinner]

https://build.opensuse.org/package/show/home:mcepl:work/python3

6 tests failed:
test_cmd_line_script test_compileall test_importlib
test_multiprocessing_main_handling test_py_compile test_runpy

======================================================================
ERROR: test_zipfile_compiled (test.test_runpy.RunPathTestCase)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/runpy.py", line 153, in _get_module_details
    code = loader.get_code(mod_name)
zipimport.ZipImportError: can't find module '__main__'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/runpy.py", line 219, in _get_main_module_details
    return _get_module_details(main_name)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/runpy.py", line 155, in _get_module_details
    raise error(format(e)) from e
ImportError: can't find module '__main__'

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_runpy.py", line 715, in test_zipfile_compiled
    mod_name=mod_name, check_loader=False)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_runpy.py", line 631, in _check_script
    self.check_code_execution(create_ns, expected_ns)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_runpy.py", line 130, in check_code_execution
    result_ns = create_namespace(None)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_runpy.py", line 606, in create_ns
    return run_path(script_name, init_globals)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/runpy.py", line 275, in run_path
    mod_name, mod_spec, code = _get_main_module_details()
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/runpy.py", line 223, in _get_main_module_details
    (main_name, sys.path[0])) from exc
ImportError: can't find '__main__' module in '/tmp/tmp40k8q99u/test_zip.zip'

======================================================================
FAIL: test_zipfile_compiled (test.test_cmd_line_script.CmdLineTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_cmd_line_script.py", line 268, in test_zipfile_compiled
    zipimport.zipimporter)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_cmd_line_script.py", line 129, in _check_script
    *run_args, __isolated=False, __cwd=cwd, **env_vars
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 157, in assert_python_ok
    return _assert_python(True, *args, **env_vars)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 143, in _assert_python
    res.fail(cmd_line)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 84, in fail
    err))
AssertionError: Process return code is 1
command line: ['/home/abuild/rpmbuild/BUILD/Python-3.7.0/python', '-X', 'faulthandler', '-E', '/tmp/tmpwlsj3czm/test_zip.zip', 'test1', 'test2', 'test3']

stdout:
---

---

stderr:
---
/home/abuild/rpmbuild/BUILD/Python-3.7.0/python: can't find '__main__' module in '/tmp/tmpwlsj3czm/test_zip.zip'
---

======================================================================
FAIL: test_overiden_unchecked_hash_based_pyc (test.test_importlib.source.test_file_loader.Frozen_SimpleTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 349, in test_overiden_unchecked_hash_based_pyc
    self.assertEqual(int.from_bytes(data[4:8], 'little'), 0b1)
AssertionError: 3 != 1

======================================================================
FAIL: test_unchecked_hash_based_pyc (test.test_importlib.source.test_file_loader.Frozen_SimpleTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 315, in test_unchecked_hash_based_pyc
    self.assertEqual(mod.state, 'old')
AssertionError: 'new' != 'old'
- new
+ old

======================================================================
FAIL: test_old_timestamp (test.test_importlib.source.test_file_loader.Frozen_SourceLoaderBadBytecodeTestPEP302)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 635, in test_old_timestamp
    self.assertEqual(bytecode_file.read(4), source_timestamp)
AssertionError: b'\xf0%\x1e8' != b'\xe2L6['

======================================================================
FAIL: test_old_timestamp (test.test_importlib.source.test_file_loader.Frozen_SourceLoaderBadBytecodeTestPEP451)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 635, in test_old_timestamp
    self.assertEqual(bytecode_file.read(4), source_timestamp)
AssertionError: b'\xf0%\x1e8' != b'\xe2L6['

======================================================================
FAIL: test_overiden_unchecked_hash_based_pyc (test.test_importlib.source.test_file_loader.Source_SimpleTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 349, in test_overiden_unchecked_hash_based_pyc
    self.assertEqual(int.from_bytes(data[4:8], 'little'), 0b1)
AssertionError: 3 != 1

======================================================================
FAIL: test_unchecked_hash_based_pyc (test.test_importlib.source.test_file_loader.Source_SimpleTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 315, in test_unchecked_hash_based_pyc
    self.assertEqual(mod.state, 'old')
AssertionError: 'new' != 'old'
- new
+ old

======================================================================
FAIL: test_old_timestamp (test.test_importlib.source.test_file_loader.Source_SourceLoaderBadBytecodeTestPEP302)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 635, in test_old_timestamp
    self.assertEqual(bytecode_file.read(4), source_timestamp)
AssertionError: b'\xf0%\x1e8' != b'\xe2L6['

======================================================================
FAIL: test_old_timestamp (test.test_importlib.source.test_file_loader.Source_SourceLoaderBadBytecodeTestPEP451)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/util.py", line 303, in wrapper
    to_return = fxn(*args, **kwargs)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_importlib/source/test_file_loader.py", line 635, in test_old_timestamp
    self.assertEqual(bytecode_file.read(4), source_timestamp)
AssertionError: b'\xf0%\x1e8' != b'\xe2L6['

======================================================================
FAIL: test_zipfile_compiled (test.test_multiprocessing_main_handling.ForkCmdLineTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_multiprocessing_main_handling.py", line 225, in test_zipfile_compiled
    self._check_script(zip_name)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_multiprocessing_main_handling.py", line 156, in _check_script
    rc, out, err = assert_python_ok(*run_args, __isolated=False)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 157, in assert_python_ok
    return _assert_python(True, *args, **env_vars)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 143, in _assert_python
    res.fail(cmd_line)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 84, in fail
    err))
AssertionError: Process return code is 1
command line: ['/home/abuild/rpmbuild/BUILD/Python-3.7.0/python', '-X', 'faulthandler', '-E', '/tmp/tmpjsax7ksh/test_zip.zip', 'fork']

stdout:
---

---

stderr:
---
/home/abuild/rpmbuild/BUILD/Python-3.7.0/python: can't find '__main__' module in '/tmp/tmpjsax7ksh/test_zip.zip'
---

======================================================================
FAIL: test_zipfile_compiled (test.test_multiprocessing_main_handling.ForkServerCmdLineTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_multiprocessing_main_handling.py", line 225, in test_zipfile_compiled
    self._check_script(zip_name)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_multiprocessing_main_handling.py", line 156, in _check_script
    rc, out, err = assert_python_ok(*run_args, __isolated=False)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 157, in assert_python_ok
    return _assert_python(True, *args, **env_vars)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 143, in _assert_python
    res.fail(cmd_line)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 84, in fail
    err))
AssertionError: Process return code is 1
command line: ['/home/abuild/rpmbuild/BUILD/Python-3.7.0/python', '-X', 'faulthandler', '-E', '/tmp/tmp50n_prgl/test_zip.zip', 'forkserver']

stdout:
---

---

stderr:
---
/home/abuild/rpmbuild/BUILD/Python-3.7.0/python: can't find '__main__' module in '/tmp/tmp50n_prgl/test_zip.zip'
---

======================================================================
FAIL: test_zipfile_compiled (test.test_multiprocessing_main_handling.SpawnCmdLineTest)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_multiprocessing_main_handling.py", line 225, in test_zipfile_compiled
    self._check_script(zip_name)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_multiprocessing_main_handling.py", line 156, in _check_script
    rc, out, err = assert_python_ok(*run_args, __isolated=False)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 157, in assert_python_ok
    return _assert_python(True, *args, **env_vars)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 143, in _assert_python
    res.fail(cmd_line)
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/support/script_helper.py", line 84, in fail
    err))
AssertionError: Process return code is 1
command line: ['/home/abuild/rpmbuild/BUILD/Python-3.7.0/python', '-X', 'faulthandler', '-E', '/tmp/tmp1npoq9bq/test_zip.zip', 'spawn']

stdout:
---

---

stderr:
---
/home/abuild/rpmbuild/BUILD/Python-3.7.0/python: can't find '__main__' module in '/tmp/tmp1npoq9bq/test_zip.zip'
---

======================================================================
FAIL: test_invalidation_mode (test.test_py_compile.PyCompileTests)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_py_compile.py", line 153, in test_invalidation_mode
    self.assertEqual(flags, 0b1)
AssertionError: 3 != 1

----------------------------------------------------------------------

======================================================================
FAIL: test_force (test.test_compileall.CommandLineTests)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 365, in test_force
    self.assertEqual(mtime, mtime2)
AssertionError: 1530285241.0427392 != 1530285301.18

======================================================================
FAIL: test_no_args_respects_force_flag (test.test_compileall.CommandLineTests)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 299, in test_no_args_respects_force_flag
    self.assertEqual(mtime, mtime2)
AssertionError: 1530285243.012693 != 1530285303.168

======================================================================
FAIL: test_pyc_invalidation_mode (test.test_compileall.CommandLineTests)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 533, in test_pyc_invalidation_mode
    self.assertEqual(int.from_bytes(data[4:8], 'little'), 0b01)
AssertionError: 3 != 1

======================================================================
FAIL: test_magic_number (test.test_compileall.CompileallTests)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 78, in test_magic_number
    self.recreation_check(b'\0\0\0\0')
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 61, in recreation_check
    self.assertEqual(*self.data())
AssertionError: b'B\r\r\n\x03\x00\x00\x00\\s\xa0J' != b'B\r\r\n\x00\x00\x00\x00\xfaL6['

======================================================================
FAIL: test_mtime (test.test_compileall.CompileallTests)
----------------------------------------------------------------------

Traceback (most recent call last):
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 74, in test_mtime
    0, 1))
  File "/home/abuild/rpmbuild/BUILD/Python-3.7.0/Lib/test/test_compileall.py", line 61, in recreation_check
    self.assertEqual(*self.data())
AssertionError: b'B\r\r\n\x03\x00\x00\x00\\s\xa0J' != b'B\r\r\n\x00\x00\x00\x00\xfaL6['

[vstinner]

It seems like the same (or similar? I didn't check) tests fail on Debian:

https://buildd.debian.org/status/fetch.php?pkg=python3.7&arch=amd64&ver=3.7.0-1&stamp=1530136859&raw=0

[mcepl]

I would add that Debian doesn't seem to fare that much better ... https://buildd.debian.org/status/fetch.php?pkg=python3.7&arch=amd64&ver=3.7.0-1&stamp=1530136859&raw=0

[vstinner]

I'm unable to reproduce the issue on Fedora using the same configure command:

$ ./configure --host=x86_64-suse-linux-gnu --build=x86_64-suse-linux-gnu --program-prefix= --disable-dependency-tracking --prefix=/usr --exec-prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin --sysconfdir=/etc --datadir=/usr/share --includedir=/usr/include --libdir=/usr/lib64 --libexecdir=/usr/lib --localstatedir=/var --sharedstatedir=/var/lib --mandir=/usr/share/man --infodir=/usr/share/info --disable-dependency-tracking --docdir=/usr/share/doc/packages/python --enable-ipv6 --with-fpectl --enable-shared --with-ensurepip=no --with-system-ffi --with-system-expat --with-lto --enable-loadable-sqlite-extensions
$ make
$ LD_LIBRARY_PATH=$PWD ./python -m test -j0  test_cmd_line_script test_compileall test_importlib  test_multiprocessing_main_handling test_py_compile test_runpy
...
All 6 tests OK.
...
Tests result: SUCCESS

[vstinner]

Thread on python-dev:
"[Python-Dev] Failing tests [Was: Re: Python 3.7.0 is now available! (and so is 3.6.6)]"
https://mail.python.org/pipermail/python-dev/2018-July/154208.html

My reply:
https://mail.python.org/pipermail/python-dev/2018-July/154224.html

Extract:

"""
I'm running the Python test suite every day on Fedora and all tests
pass. We also run tests multiple times per day on Travis CI (Ubuntu)
and buildbots (Debian, Gentoo, RHEL, SLES).

Wait, there is a SLES buildbot and all tests pass except of
test_gdb.test_threads(). SLES is OpenSUSE no?

The Debian buildbot is green on all branches.
"""

[vstinner]

I also ran the Python test suite on Debian sid using the master branch of Python and all tests pass:
---

$ ./configure --prefix=/usr --enable-ipv6 --enable-loadable-sqlite-extensions --with-dbmliborder=bdb:gdbm --with-computed-gotos --without-ensurepip --with-system-expat --with-system-libmpdec  --with-system-ffi
$ make
$ LD_LIBRARY_PATH=$PWD ./python -m test -j0 test_cmd_line_script test_compileall test_importlib test_multiprocessing_main_handling test_py_compile test_runpy

All 6 tests OK.
---

I also ran the full test suite on Debian Stretch: again, all tests passed.

Maybe the package builder use a custom configuration or patches? Or issues are specific to Python 3.7? (again, I tested the master branch)

[mcepl]

Hmm, what about version of gcc? I suspect some troubles could be caused by gcc version 8 (we have in openSUSE), or LTO option switched on?

[vstinner]

Hmm, what about version of gcc? I suspect some troubles could be caused by gcc version 8 (we have in openSUSE), or LTO option switched on?

For my tests on Fedora, I used gcc 8.1.1. I used the OpenSUSE configure command which includes --with-lto.

[serhiy-storchaka]

I built and ran these tests using commands from msg320892 on openSUSE Leap 42.3, and all tests are passed.

[mcepl]

It's somehow complicated, in the build chroot I can make tests run only with LD_LIBRARY_PATH set to $(readlink -f Python-3.7.0) and PYTHONPATH to Lib directory. However, then the set of failed tests changes. For example test_runpy runs without problems, but other fails:

5 tests failed:
test_asyncio test_concurrent_futures test_gdb test_logging
test_multiprocessing_main_handling

(complete log is attached)

[mcepl]

Yes, it must be something in the chroot, because when run in the plain command line, all tests as well on openSUSE Tumbleweed (with the latest updates).

393 tests OK.

1 test failed:
test_epoll

21 tests skipped:
test_ctypes test_devpoll test_idle test_kqueue test_msilib
test_nis test_ossaudiodev test_smtpnet test_sqlite test_ssl
test_startfile test_tcl test_tix test_tk test_ttk_guionly
test_ttk_textonly test_turtle test_winconsoleio test_winreg
test_winsound test_zipfile64

Re-running failed tests in verbose mode
Re-running test 'test_epoll' in verbose mode
test_add (test.test_epoll.TestEPoll) ... ok
test_badcreate (test.test_epoll.TestEPoll) ... ok
test_close (test.test_epoll.TestEPoll) ... ok
test_context_manager (test.test_epoll.TestEPoll) ... ok
test_control_and_wait (test.test_epoll.TestEPoll) ... ok
test_create (test.test_epoll.TestEPoll) ... ok
test_errors (test.test_epoll.TestEPoll) ... ok
test_fd_non_inheritable (test.test_epoll.TestEPoll) ... ok
test_fromfd (test.test_epoll.TestEPoll) ... ok
test_unregister_closed (test.test_epoll.TestEPoll) ... ok

----------------------------------------------------------------------
Ran 10 tests in 2.106s

OK

== Tests result: FAILURE then SUCCESS ==

393 tests OK.

21 tests skipped:
test_ctypes test_devpoll test_idle test_kqueue test_msilib
test_nis test_ossaudiodev test_smtpnet test_sqlite test_ssl
test_startfile test_tcl test_tix test_tk test_ttk_guionly
test_ttk_textonly test_turtle test_winconsoleio test_winreg
test_winsound test_zipfile64

1 re-run test:
test_epoll

[vstinner]

Yes, it must be something in the chroot, because when run in the plain command line, all tests as well on openSUSE Tumbleweed (with the latest updates).

Are you testing with patches? It may be interesting to try to get these patches upstream:

[ 59s] Patch #1 (Python-3.0b1-record-rpm.patch):
[ 59s] Patch #2 (python-3.6.0-multilib-new.patch):
[ 59s] Patch #4 (python-3.3.0b1-localpath.patch):
[ 59s] Patch #6 (python-3.3.0b1-fix_date_time_compiler.patch):
[ 59s] Patch #7 (python-3.3.0b1-curses-panel.patch):
[ 59s] Patch #9 (python-3.3.0b1-test-posix_fadvise.patch):
[ 59s] Patch #12 (python-3.3.3-skip-distutils-test_sysconfig_module.patch):
[ 59s] Patch #15 (subprocess-raise-timeout.patch):
[ 59s] Patch #22 (distutils-reproducible-compile.patch):

Some patches seem old. Are they still needed? Where can I find these patches? I'm interested by patches modifying site.py for example.