Skip to content

ARROW-8237: [Python][Documentation] Minor corrections to python minimal build documentation #6845

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
JacekPliszka wants to merge 3 commits into from
Closed

ARROW-8237: [Python][Documentation] Minor corrections to python minimal build documentation #6845

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
fc84756
Minor variables cleanup in python/examples/minimal_build
JacekPliszka Apr 6, 2020
4aeadf7
Changing Fedora 31 minimal_build instructions to podman
JacekPliszka Apr 6, 2020
19221f7
Fixes for docker commands, and wording improvements
pitrou Apr 6, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
32 changes: 22 additions & 10 deletions python/examples/minimal_build/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,14 +26,12 @@ environments.

## Fedora 31

Build image:

First, build the Docker image using:
```
docker build -t arrow_fedora_minimal -f Dockerfile.fedora
docker build -t arrow_fedora_minimal -f Dockerfile.fedora .
```

Build with conda or pip/virtualenv:

Then build PyArrow with conda or pip/virtualenv, respectively:
```
# With pip/virtualenv
docker run --rm -t -i -v $PWD:/io arrow_fedora_minimal /io/build_venv.sh
Expand All @@ -44,18 +42,32 @@ docker run --rm -t -i -v $PWD:/io arrow_fedora_minimal /io/build_conda.sh

## Ubuntu 18.04

Build image:

First, build the Docker image using:
```
docker build -t arrow_ubuntu_minimal -f Dockerfile.ubuntu
docker build -t arrow_ubuntu_minimal -f Dockerfile.ubuntu .
```

Build with conda or pip/virtualenv:

Then build PyArrow with conda or pip/virtualenv, respectively:
```
# With pip/virtualenv
docker run --rm -t -i -v $PWD:/io arrow_ubuntu_minimal /io/build_venv.sh

# With conda
docker run --rm -t -i -v $PWD:/io arrow_ubuntu_minimal /io/build_conda.sh
```

## Building on Fedora - Podman and SELinux

In addition to using Podman instead of Docker, you need to specify `:Z`
for SELinux relabelling when binding a volume.

First, build the image using:
```
podman build -t arrow_fedora_minimal -f Dockerfile.fedora
```

Then build PyArrow with pip/virtualenv:
```
# With pip/virtualenv
podman run --rm -i -v $PWD:/io:Z -t arrow_fedora_minimal /io/build_venv.sh
```
23 changes: 12 additions & 11 deletions python/examples/minimal_build/build_venv.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,20 +21,21 @@ set -e
#----------------------------------------------------------------------
# Change this to whatever makes sense for your system

MINICONDA=$HOME/miniconda-for-arrow
LIBRARY_INSTALL_DIR=$HOME/local-libs
CPP_BUILD_DIR=$HOME/arrow-cpp-build
ARROW_ROOT=/arrow
export ARROW_HOME=/dist
export LD_LIBRARY_PATH=/dist/lib:$LD_LIBRARY_PATH
WORKDIR=${WORKDIR:-$HOME}
MINICONDA=$WORKDIR/miniconda-for-arrow
LIBRARY_INSTALL_DIR=$WORKDIR/local-libs
CPP_BUILD_DIR=$WORKDIR/arrow-cpp-build
ARROW_ROOT=$WORKDIR/arrow
export ARROW_HOME=$WORKDIR/dist
export LD_LIBRARY_PATH=$ARROW_HOME/lib:$LD_LIBRARY_PATH

git clone https://github.com/apache/arrow.git /arrow
virtualenv $WORKDIR/venv
source $WORKDIR/venv/bin/activate

virtualenv /venv
source /venv/bin/activate
git clone https://github.com/apache/arrow.git $ARROW_ROOT

pip install -r /arrow/python/requirements-build.txt \
-r /arrow/python/requirements-test.txt
pip install -r $ARROW_ROOT/python/requirements-build.txt \
-r $ARROW_ROOT/python/requirements-test.txt

#----------------------------------------------------------------------
# Build C++ library
Expand Down