Cannot import both pyarrow and osgeo in OSGeo4W shell

[jontwo]

The latest version of dask was causing an import error, but on further investigation it turns out that pyarrow and GDAL cannot be installed at the same time.

Repro case: importing on the command line, both libraries can be imported individually, but not together. You get a different error depending on the import order.

c:\>python -c "import pyarrow"

c:\>python -c "import osgeo"

c:\>python -c "import pyarrow;import osgeo"
Traceback (most recent call last):
  File "C:\OSGeo4W\apps\Python39\lib\site-packages\osgeo\__init__.py", line 30, in swig_import_helper
    return importlib.import_module(mname)
  File "C:\OSGeo4W\apps\Python39\lib\importlib\__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1030, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1007, in _find_and_load
  File "<frozen importlib._bootstrap>", line 986, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 666, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 565, in module_from_spec
  File "<frozen importlib._bootstrap_external>", line 1173, in create_module
  File "<frozen importlib._bootstrap>", line 228, in _call_with_frames_removed
ImportError: DLL load failed while importing _gdal: The specified procedure could not be found.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\OSGeo4W\apps\Python39\lib\site-packages\osgeo\__init__.py", line 35, in <module>
    _gdal = swig_import_helper()
  File "C:\OSGeo4W\apps\Python39\lib\site-packages\osgeo\__init__.py", line 32, in swig_import_helper
    return importlib.import_module('_gdal')
  File "C:\OSGeo4W\apps\Python39\lib\importlib\__init__.py", line 127, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
ModuleNotFoundError: No module named '_gdal'

c:\>python -c "import osgeo;import pyarrow"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "C:\OSGeo4W\apps\Python39\lib\site-packages\pyarrow\__init__.py", line 65, in <module>
    import pyarrow.lib as _lib
ImportError: DLL load failed while importing lib: The specified procedure could not be found.

System information:

QGIS version	3.34.4-Prizren
QGIS code revision	decd43dc
Qt version	5.15.3
Python version	3.9.18
GDAL/OGR version	3.8.4
PROJ version	9.3.1
EPSG Registry database version	v10.098 (2023-11-24)
GEOS version	3.12.1-CAPI-1.18.1
SQLite version	3.41.1
PDAL version	2.6.0
PostgreSQL client version	16.1
SpatiaLite version	5.1.0
QWT version	6.1.6
QScintilla2 version	2.13.4
OS version	Windows 10 Version 2009

[jef]

pyarrow is not part of OSGeo4W. To add it you probably have to build it against OSGeo4W's arrow (like GDAL).

[jontwo]

It's one of our requirements - I've pip installed it and it seems to otherwise work fine.

[jef]

Fixed in ​https://github.com/jef-n/OSGeo4W/cf3e48835a676262507d9d30385792702354756d