[Python] Dask integration test fails due to what seems a pytest mark collection error

[raulcd]

Describe the bug, including details regarding any error messages, version, and platform.

test-conda-python-3.11-dask-latest is currently failing on the nightlies with:

 ============================= test session starts ==============================
platform linux -- Python 3.11.15, pytest-9.1.0, pluggy-1.6.0 -- /opt/conda/envs/arrow/bin/python3.11
cachedir: .pytest_cache
hypothesis profile 'ci' -> database=None, deadline=None, print_blob=True, derandomize=True, suppress_health_check=(HealthCheck.too_slow,)
rootdir: /
plugins: hypothesis-6.155.3
collecting ... collected 0 items / 1 error

==================================== ERRORS ====================================
_ ERROR collecting opt/conda/envs/arrow/lib/python3.11/site-packages/dask/dataframe/io/tests/test_parquet.py _
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_hooks.py:512: in __call__
    return self._hookexec(self.name, self._hookimpls.copy(), kwargs, firstresult)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_manager.py:120: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:250: in pytest_pycollect_makeitem
    return list(collector._genfunctions(name, obj))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:476: in _genfunctions
    self.ihook.pytest_generate_tests.call_extra(methods, dict(metafunc=metafunc))
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_hooks.py:573: in call_extra
    return self._hookexec(self.name, hookimpls, kwargs, firstresult)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/pluggy/_manager.py:120: in _hookexec
    return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:124: in pytest_generate_tests
    metafunc.parametrize(*marker.args, **marker.kwargs, _param_mark=marker)
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/python.py:1316: in parametrize
    argnames, parametersets = ParameterSet._for_parametrize(
opt/conda/envs/arrow/lib/python3.11/site-packages/_pytest/mark/structures.py:218: in _for_parametrize
    if len(param.values) != len(argnames):
       ^^^^^^^^^^^^^^^^^
E   TypeError: object of type 'NoneType' has no len()

Component(s)

Python

[raulcd]

This is related to:

• Pytest 9.1 support dask/dask#12465

Which has been fixed upstream here:
dask/dask@22ce952

It should be fixed on our CI once a new dask release is generated. It's basically an incompatibility with the latest pytest version on dask. I'll keep it open but once dask does a new release this should be fixed. I've validated locally.