x86-64 binary installer does not work on RHEL-6 generation OSes

[mj-harvey]

The perennial LIBC ABI incompatibility:

-bash-4.1$ ./bazel
./bazel: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.14' not found (required by ./bazel)
./bazel: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.15' not found (required by ./bazel)
./bazel: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by ./bazel)
-bash-4.1$ ldd ./bazel
./bazel: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.14' not found (required by ./bazel)
./bazel: /usr/lib64/libstdc++.so.6: version `GLIBCXX_3.4.15' not found (required by ./bazel)
./bazel: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by ./bazel)
    linux-vdso.so.1 =>  (0x00007fffd4fff000)
    librt.so.1 => /lib64/librt.so.1 (0x00007f3328181000)
    libz.so.1 => /lib64/libz.so.1 (0x00007f3327f6a000)
    libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00007f3327c64000)
    libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00007f3327a4e000)
    libc.so.6 => /lib64/libc.so.6 (0x00007f33276bd000)
    libpthread.so.0 => /lib64/libpthread.so.0 (0x00007f33274a1000)
    /lib64/ld-linux-x86-64.so.2 (0x0000003941600000)
    libm.so.6 => /lib64/libm.so.6 (0x00007f332721d000)

[mj-harvey]

Tested with 0.1.2rc2 with same results.
https://storage.googleapis.com/bazel/0.1.2/rc2/bazel-0.1.2rc2-installer-linux-x86_64.sh

[damienmg]

This is a KI. We will expand the number of supported platform for binary release in the future but we cannot work on it right now.

[mj-harvey]

Fair enough, but the level of c++ used in the code seems to make it impossible to compile on a RHEL6 system that has only the standard, venerable, compiler packages installed (see other issue)

[damienmg]

We should fix the C++ issue on the specific bugs. If we don't, then we will probably not be able to provide any binary release for those platform anyway :)

[kramasamy]

Even in CentOS it has the same issue. Hence we are not able to upgrade to bazel beta release. We are stuck with pre-beta version that we compiled and checked into the code base.

We are using bazel heavily to compile Heron, our new streaming system at Twitter.

[damienmg]

You are not able to build from source neither?

[kramasamy]

@damienmg - I have not tried from building the source. If anybody has tried successfully, I am willing to give it a go!

[kramasamy]

Tried to compile from source for the release 0.1.1. My environment uses gcc/g++ 4.8.2 and Java 8.
I am getting the following errors:

gcc -o /tmp/bazel.DoG14492/namespace-sandbox -std=c99 src/main/tools/namespace-sandbox.c src/main/tools/process-tools.c -lm
In file included from src/main/tools/namespace-sandbox.c:35:0:
src/main/tools/namespace-sandbox.c: In function ‘CheckNamespacesSupported’:
src/main/tools/namespace-sandbox.c:92:26: error: ‘CLONE_NEWUSER’ undeclared (first use in this function)
CLONE_NEWUSER | CLONE_NEWNS | CLONE_NEWUTS |
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c:92:26: note: each undeclared identifier is reported only once for each function it appears in
CLONE_NEWUSER | CLONE_NEWNS | CLONE_NEWUTS |
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c:92:56: error: ‘CLONE_NEWUTS’ undeclared (first use in this function)
CLONE_NEWUSER | CLONE_NEWNS | CLONE_NEWUTS |
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c:93:30: error: ‘CLONE_NEWIPC’ undeclared (first use in this function)
CLONE_NEWIPC | SIGCHLD,
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c: In function ‘CreateNamespaces’:
src/main/tools/namespace-sandbox.c:266:17: error: ‘CLONE_NEWUSER’ undeclared (first use in this function)
if (unshare(CLONE_NEWUSER | CLONE_NEWNS | CLONE_NEWUTS | CLONE_NEWIPC) ==
^
src/main/tools/namespace-sandbox.c:266:47: error: ‘CLONE_NEWUTS’ undeclared (first use in this function)
if (unshare(CLONE_NEWUSER | CLONE_NEWNS | CLONE_NEWUTS | CLONE_NEWIPC) ==
^
src/main/tools/namespace-sandbox.c:266:62: error: ‘CLONE_NEWIPC’ undeclared (first use in this function)
if (unshare(CLONE_NEWUSER | CLONE_NEWNS | CLONE_NEWUTS | CLONE_NEWIPC) ==
^
In file included from src/main/tools/namespace-sandbox.c:35:0:
src/main/tools/namespace-sandbox.c: In function ‘SetupDirectories’:
src/main/tools/namespace-sandbox.c:359:43: error: ‘MS_REC’ undeclared (first use in this function)
CHECK_CALL(mount("/proc", "proc", NULL, MS_REC | MS_BIND, NULL));
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c: In function ‘ChangeRoot’:
src/main/tools/namespace-sandbox.c:468:32: error: ‘MNT_DETACH’ undeclared (first use in this function)
CHECK_CALL(umount2(old_root, MNT_DETACH));
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c: In function ‘main’:
src/main/tools/namespace-sandbox.c:568:39: error: ‘MS_REC’ undeclared (first use in this function)
CHECK_CALL(mount("none", "/", NULL, MS_REC | MS_PRIVATE, NULL));
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^
src/main/tools/namespace-sandbox.c:568:48: error: ‘MS_PRIVATE’ undeclared (first use in this function)
CHECK_CALL(mount("none", "/", NULL, MS_REC | MS_PRIVATE, NULL));
^
src/main/tools/process-tools.h:34:8: note: in definition of macro ‘CHECK_CALL’
if ((x) == -1) {
^

[damienmg]

Arf we shouldn't build the namespace sandbox on system that does not support it.

Commenting the part https://github.com/bazelbuild/bazel/blob/master/scripts/bootstrap/compile.sh#L334 here for compiling the dummy one should workaround that.

[kramasamy]

I got further down and I am getting the following memory errors while compiling bazel

INFO: From Building src/main/java/libshell.jar (17 files):
Error occurred during initialization of VM
java.lang.OutOfMemoryError: unable to create new native thread
ERROR: /home/kramasamy/bazel-0.1.1/src/main/java/BUILD:3:1: Java compilation in rule '//src/main/java:shell' failed: java failed: error executing command external/local-jdk/bin/java -Xbootclasspath/p:third_party/java/jdk/langtools/javac.jar -client -jar bazel-out/host/bin/src/java_tools/buildjar/bootstrap_deploy.jar ... (remaining 1 argument(s) skipped): com.google.devtools.build.lib.shell.BadExitStatusException: Process exited with status 1.
Target //src:bazel failed to build
Use --verbose_failures to see the command lines of failed build steps.

[damienmg]

try to add build --jobs 100 or even lower in your bazelrc file (export BAZELRC=/path/to/bazelrc.file to use with compile.sh)

[kramasamy]

Thanks @damienmg for the suggestion. I was able to successfully compile it. After compilation, I would like to install it some where - similar to bazel-install for darwin and linux. Does it just involve only copying third_party/ tools/ to base_workspace directory and output/bazel to a bin directory? Or it has more steps?