OS X: binary installation with PIP includes incompatible "libXau.6.0.0.dylib"

[TurtleWilly]

Installing anything that depends on PIL/pillow with PIP on an older Mac OS X/ OS X/ macOS (e.g. OS X Yosemite, 10.10.5) breaks, because the included pre-build "libXau.6.0.0.dylib" seems to be build without a compatibility fallback (aka needs a more recent version of the OS). I'm also not sure why this library is required at all on macOS, but that's just me wondering…

What did you do?

# prepare
$ cd /Volumes/Temporary/
$ python3.12 -m venv vcsitest
$ cd vcsitest/
$ source bin/activate

# install/use 'vcsi' as example case. Note: output reduced for clarity
(vcsitest) $ pip install vcsi
Collecting vcsi
  Using cached vcsi-7.0.16-py3-none-any.whl.metadata (16 kB)
…
Collecting pillow<11.0.0,>=10.0.0 (from vcsi)
  Using cached pillow-10.2.0-cp312-cp312-macosx_10_10_x86_64.whl.metadata (9.7 kB)
…
Installing collected packages: texttable, parsedatetime, pillow, numpy, MarkupSafe, jinja2, vcsi
Successfully installed MarkupSafe-2.1.5 jinja2-3.1.3 numpy-1.26.4 parsedatetime-2.6 pillow-10.2.0 texttable-1.7.0 vcsi-7.0.16

# try to run it
(vcsitest) $ bin/vcsi --version
Traceback (most recent call last):
  File "/Volumes/Temporary/vcsitest/bin/vcsi", line 5, in <module>
    from vcsi.vcsi import main
  File "/Volumes/Temporary/vcsitest/lib/python3.12/site-packages/vcsi/vcsi.py", line 33, in <module>
    from PIL import Image, ImageDraw, ImageFont
  File "/Volumes/Temporary/vcsitest/lib/python3.12/site-packages/PIL/Image.py", line 84, in <module>
    from . import _imaging as core
ImportError: dlopen(/Volumes/Temporary/vcsitest/lib/python3.12/site-packages/PIL/_imaging.cpython-312-darwin.so, 2): Library not loaded: @loader_path/libXau.6.0.0.dylib
  Referenced from: /Volumes/Temporary/vcsitest/lib/python3.12/site-packages/PIL/.dylibs/libxcb.1.1.0.dylib
  Reason: no suitable image found.  Did find:
	/Volumes/Temporary/vcsitest/lib/python3.12/site-packages/PIL/.dylibs/libXau.6.0.0.dylib: cannot load 'libXau.6.0.0.dylib' (load command 0x80000034 is unknown)
	/Volumes/Temporary/vcsitest/lib/python3.12/site-packages/PIL/.dylibs/libXau.6.0.0.dylib: cannot load 'libXau.6.0.0.dylib' (load command 0x80000034 is unknown)

What did you expect to happen?

Dylib loading to succeed. Application using pillow/PIL to run.

What actually happened?

Dylib failed to load, because of load command 0x80000034 is unknown (this load command is only supported by some way newer macOS version).

While I can't test/ verify this properly, I think all the other dylibs included in the package should work fine as they have the appropriate: LC_VERSION_MIN_MACOSX: version 10.10 (see otool -l <____>.dylib output):

$ cd /Volumes/Temporary/vcsitest/lib/python3.12/site-packages/PIL/.dylibs
# Note: output manually cleaned up for clarity here in the report
# Note: please note libXau missing the bits
$ for i in *.dylib; do echo -n "$i ->"; otool -l "$i" | fgrep ' version 10.'; done
libXau.6.0.0.dylib          ->
libbrotlicommon.1.1.0.dylib ->  version 10.10
libbrotlidec.1.1.0.dylib    ->  version 10.10
libfreetype.6.dylib         ->  version 10.10
libharfbuzz.0.dylib         ->  version 10.10
libjpeg.62.4.0.dylib        ->  version 10.10
liblcms2.2.dylib            ->  version 10.10
liblzma.5.dylib             ->  version 10.10
libopenjp2.2.5.0.dylib      ->  version 10.10
libpng16.16.dylib           ->  version 10.10
libsharpyuv.0.dylib         ->  version 10.10
libtiff.6.dylib             ->  version 10.10
libwebp.7.dylib             ->  version 10.10
libwebpdemux.2.dylib        ->  version 10.10
libwebpmux.3.dylib          ->  version 10.10
libxcb.1.1.0.dylib          ->  version 10.10
libz.1.3.dylib              ->  version 10.10

What are your OS, Python and Pillow versions?

• OS: 10.10.5 (OS X Yosemite)
• Python: 3.12.2
• Pillow: 10.2.0 (binary/ pre-build release via PIP: pillow-10.2.0-cp312-cp312-macosx_10_10_x86_64)

[radarhere]

Hi. Your problem has already been raised in #6862 (comment). #7764 should fix this for the next release of Pillow, due out in the next week.

If you would like to test the solution, try this - pillow-10.2.0-cp312-cp312-macosx_10_10_x86_64.whl.zip

[TurtleWilly]

Awesome! Yes, this new build works for me.

(vcsitest) $ pip install /Volumes/Temporary/pillow-10.2.0-cp312-cp312-macosx_10_10_x86_64.whl --force-reinstall
(vcsitest) $ ./bin/vcsi --help
usage: vcsi [-h] [-o OUTPUT_PATH] [-c CONFIG] [--start-delay-percent START_DELAY_PERCENT]
            [--end-delay-percent END_DELAY_PERCENT] [--delay-percent DELAY_PERCENT]
            [--grid-spacing GRID_SPACING] [--grid-horizontal-spacing GRID_HORIZONTAL_SPACING]
            [--grid-vertical-spacing GRID_VERTICAL_SPACING] [-w VCS_WIDTH] [-g GRID] [-s NUM_SAMPLES]
            …
…

(vcsitest) $ otool -l lib/python3.12/site-packages/PIL/.dylibs/libXau.6.0.0.dylib
…
Load command 8
      cmd LC_VERSION_MIN_MACOSX
  cmdsize 16
  version 10.10
      sdk 13.1
…

👍

I'm looking forward to the release. 😎

[radarhere]

Pillow 10.3.0 has been published to PyPI.

[TurtleWilly]

Tested an installation of vcsi (including the updated pillow) via pip inside a fresh venv. Works. 👍

[radarhere]

Be aware that Python 3.12.6 has just released, but without support macOS 10.10.

https://www.python.org/downloads/release/python-3126/

this release drops support for macOS versions 10.9 through 10.12

If you have any thoughts on this, now is the time to mention them. Otherwise, it looks like Pillow 11 will not build wheels that support Python 3.12 on macOS 10.10.

[aclark4life]

I got warnings from Homebrew recently about 10.13 being unsupported too, so this sounds reasonable.