BUG: Test failures with 1.26.0rc1 in conda-forge #24660
Description
Describe the issue:
While our CI for 1.26.0b1 was all green, for rc1 we have two issues in conda-forge/numpy-feedstock#297:
linux-aarch64 has two test failures that don't just seem like minor tolerance violations:
=========================== short test summary info ============================
FAILED linalg/tests/test_linalg.py::TestCholesky::test_basic_property[float32-shape3] - AssertionError:
Not equal to tolerance rtol=1e-07, atol=0.00298023
[...]
Mismatched elements: 1617 / 2500 (64.7%)
Max absolute difference: 89.25262
Max relative difference: 2200.9631
x: array([[ 4.406959e+01, -1.291737e+00, -6.148944e-01, ..., -9.883090e+00,
-2.005572e+00, 7.965497e+00],
[-1.291737e+00, -7.090253e+00, 1.104174e+00, ..., -9.404308e-03,...
y: array([[ 44.06959 , -1.291737, -0.614894, ..., -1.707806, -0.06027 ,
3.596826],
[ -1.291737, 50.031647, -0.936252, ..., -9.246351, -12.977635,...
FAILED linalg/tests/test_linalg.py::TestCholesky::test_basic_property[float32-shape4] - AssertionError:
Not equal to tolerance rtol=1e-07, atol=0.000178814
[...]
Mismatched elements: 253 / 300 (84.3%)
Max absolute difference: 20.29966
Max relative difference: 237.33156
x: array([[[10.734334, -4.876828, -3.155457, -4.599753, 2.103036,
-1.243519, 3.030686, -4.149522, 0. , 0. ],
[-4.876828, 2.244246, 1.433589, 8.771067, 1.423618,...
y: array([[[10.734333, -4.876828, -3.155457, -4.599753, 2.103036,
-1.243519, 3.030686, -4.149522, -2.962044, 0.036255],
[-4.876828, 8.896948, 3.812659, -0.037113, -1.047684,...
2 failed, 34361 passed, 1117 skipped, 33 xfailed, 4 xpassed, 31 warnings in 2741.47s (0:45:41)
and pypy on windows, which seems to have some issues with cython resp. f2py:
=========================== short test summary info ===========================
FAILED random/tests/test_extending.py::test_cython - subprocess.CalledProcess...
FAILED tests/test_scripts.py::test_pep338 - subprocess.CalledProcessError: Co...
ERROR core/tests/test_mem_policy.py::test_set_policy - RuntimeError: could no...
ERROR core/tests/test_mem_policy.py::test_default_policy_singleton - RuntimeE...
ERROR core/tests/test_mem_policy.py::test_policy_propagation - RuntimeError: ...
ERROR core/tests/test_mem_policy.py::test_context_locality - RuntimeError: co...
ERROR core/tests/test_mem_policy.py::test_thread_locality - RuntimeError: cou...
ERROR core/tests/test_mem_policy.py::test_owner_is_base - RuntimeError: could...
2 failed, 38142 passed, 671 skipped, 36 xfailed, 26 xpassed, 23 warnings, 6 errors in 1984.29s (0:33:04)
Reproduce the code example:
Run tests in conda-forge CIError message:
See aboveRuntime information:
Test env aarch:
_openmp_mutex: 4.5-2_gnu conda-forge
_sysroot_linux-aarch64_curr_repodata_hack: 4-h57d6b7b_13 conda-forge
attrs: 23.1.0-pyh71513ae_1 conda-forge
backports.zoneinfo: 0.2.1-py311hec3470c_7 conda-forge
binutils_impl_linux-aarch64: 2.40-h870a726_0 conda-forge
binutils_linux-aarch64: 2.40-h94bbfa1_1 conda-forge
bzip2: 1.0.8-hf897c2e_4 conda-forge
ca-certificates: 2023.7.22-hcefe29a_0 conda-forge
click: 8.1.7-unix_pyh707e725_0 conda-forge
colorama: 0.4.6-pyhd8ed1ab_0 conda-forge
cython: 3.0.2-py311h8715677_0 conda-forge
exceptiongroup: 1.1.3-pyhd8ed1ab_0 conda-forge
execnet: 2.0.2-pyhd8ed1ab_0 conda-forge
gcc_impl_linux-aarch64: 12.3.0-hcde2664_0 conda-forge
gcc_linux-aarch64: 12.3.0-h464a8f7_1 conda-forge
gfortran_impl_linux-aarch64: 12.3.0-hb7244be_0 conda-forge
gfortran_linux-aarch64: 12.3.0-h1993883_1 conda-forge
gxx_impl_linux-aarch64: 12.3.0-hcde2664_0 conda-forge
gxx_linux-aarch64: 12.3.0-h21accf6_1 conda-forge
hypothesis: 6.84.2-pyha770c72_0 conda-forge
iniconfig: 2.0.0-pyhd8ed1ab_0 conda-forge
kernel-headers_linux-aarch64: 4.18.0-h5b4a56d_13 conda-forge
ld_impl_linux-aarch64: 2.40-h2d8c526_0 conda-forge
libblas: 3.9.0-18_linuxaarch64_openblas conda-forge
libcblas: 3.9.0-18_linuxaarch64_openblas conda-forge
libexpat: 2.5.0-hd600fc2_1 conda-forge
libffi: 3.4.2-h3557bc0_5 conda-forge
libgcc-devel_linux-aarch64: 12.3.0-h8b5ab12_0 conda-forge
libgcc-ng: 13.1.0-h2b4548d_0 conda-forge
libgfortran-ng: 13.1.0-he9431aa_0 conda-forge
libgfortran5: 13.1.0-h24e4805_0 conda-forge
libgomp: 13.1.0-h2b4548d_0 conda-forge
liblapack: 3.9.0-18_linuxaarch64_openblas conda-forge
libnsl: 2.0.0-hf897c2e_0 conda-forge
libopenblas: 0.3.24-pthreads_h5a5ec62_0 conda-forge
libsanitizer: 12.3.0-h8ebda82_0 conda-forge
libsqlite: 3.43.0-h194ca79_0 conda-forge
libstdcxx-devel_linux-aarch64: 12.3.0-h8b5ab12_0 conda-forge
libstdcxx-ng: 13.1.0-h452befe_0 conda-forge
libuuid: 2.38.1-hb4cce97_0 conda-forge
libzlib: 1.2.13-h31becfc_5 conda-forge
meson: 1.2.1-pyhd8ed1ab_0 conda-forge
ncurses: 6.4-h2e1726e_0 conda-forge
ninja: 1.11.1-hdd96247_0 conda-forge
numpy: 1.26.0rc1-py311h69ead2a_0 local
openssl: 3.1.2-h31becfc_0 conda-forge
packaging: 23.1-pyhd8ed1ab_0 conda-forge
pluggy: 1.3.0-pyhd8ed1ab_0 conda-forge
pytest: 7.4.1-pyhd8ed1ab_0 conda-forge
pytest-timeout: 2.1.0-pyhd8ed1ab_0 conda-forge
pytest-xdist: 3.3.1-pyhd8ed1ab_0 conda-forge
python: 3.11.5-h43d1f9e_0_cpython conda-forge
python_abi: 3.11-3_cp311 conda-forge
pytz: 2023.3.post1-pyhd8ed1ab_0 conda-forge
readline: 8.2-h8fc344f_1 conda-forge
setuptools: 59.8.0-py311hec3470c_1 conda-forge
sortedcontainers: 2.4.0-pyhd8ed1ab_0 conda-forge
sysroot_linux-aarch64: 2.17-h5b4a56d_13 conda-forge
tk: 8.6.12-hd8af866_0 conda-forge
tomli: 2.0.1-pyhd8ed1ab_0 conda-forge
typing_extensions: 4.7.1-pyha770c72_0 conda-forge
tzdata: 2023c-h71feb2d_0 conda-forge
xz: 5.2.6-h9cdd2b7_0 conda-forge
Test env pypy on windows
attrs: 23.1.0-pyh71513ae_1 conda-forge
backports.zoneinfo: 0.2.1-py39h0d475fb_7 conda-forge
bzip2: 1.0.8-h8ffe710_4 conda-forge
ca-certificates: 2023.7.22-h56e8100_0 conda-forge
click: 8.1.7-win_pyh7428d3b_0 conda-forge
colorama: 0.4.6-pyhd8ed1ab_0 conda-forge
cython: 3.0.2-py39h3665ca7_0 conda-forge
exceptiongroup: 1.1.3-pyhd8ed1ab_0 conda-forge
execnet: 2.0.2-pyhd8ed1ab_0 conda-forge
expat: 2.5.0-h63175ca_1 conda-forge
hypothesis: 6.84.2-pyha770c72_0 conda-forge
iniconfig: 2.0.0-pyhd8ed1ab_0 conda-forge
intel-openmp: 2023.2.0-h57928b3_49496 conda-forge
libblas: 3.9.0-18_win64_mkl conda-forge
libcblas: 3.9.0-18_win64_mkl conda-forge
libexpat: 2.5.0-h63175ca_1 conda-forge
libffi: 3.4.2-h8ffe710_5 conda-forge
libhwloc: 2.9.2-default_haede6df_1009 conda-forge
libiconv: 1.17-h8ffe710_0 conda-forge
liblapack: 3.9.0-18_win64_mkl conda-forge
libsqlite: 3.43.0-hcfcfb64_0 conda-forge
libxml2: 2.11.5-hc3477c8_1 conda-forge
libzlib: 1.2.13-hcfcfb64_5 conda-forge
meson: 1.2.1-pyhd8ed1ab_0 conda-forge
mkl: 2022.1.0-h6a75c08_874 conda-forge
ninja: 1.11.1-h91493d7_0 conda-forge
numpy: 1.26.0rc1-py39h821adfb_0 local
openssl: 3.1.2-hcfcfb64_0 conda-forge
packaging: 23.1-pyhd8ed1ab_0 conda-forge
pluggy: 1.3.0-pyhd8ed1ab_0 conda-forge
pthreads-win32: 2.9.1-hfa6e2cd_3 conda-forge
pypy3.9: 7.3.12-h994e1e7_4 conda-forge
pytest: 7.4.1-pyhd8ed1ab_0 conda-forge
pytest-timeout: 2.1.0-pyhd8ed1ab_0 conda-forge
pytest-xdist: 3.3.1-pyhd8ed1ab_0 conda-forge
python: 3.9.17-0_73_pypy conda-forge
python_abi: 3.9-3_pypy39_pp73 conda-forge
pytz: 2023.3.post1-pyhd8ed1ab_0 conda-forge
setuptools: 59.8.0-py39h0d475fb_1 conda-forge
sortedcontainers: 2.4.0-pyhd8ed1ab_0 conda-forge
sqlite: 3.43.0-hcfcfb64_0 conda-forge
tbb: 2021.10.0-h91493d7_0 conda-forge
tk: 8.6.12-h8ffe710_0 conda-forge
tomli: 2.0.1-pyhd8ed1ab_0 conda-forge
typing_extensions: 4.7.1-pyha770c72_0 conda-forge
tzdata: 2023c-h71feb2d_0 conda-forge
ucrt: 10.0.22621.0-h57928b3_0 conda-forge
vc: 14.3-h64f974e_17 conda-forge
vc14_runtime: 14.36.32532-hfdfe4a8_17 conda-forge
vs2015_runtime: 14.36.32532-h05e6639_17 conda-forge
xz: 5.2.6-h8d14728_0 conda-forge
zlib: 1.2.13-hcfcfb64_5 conda-forge
Context for the issue:
No response