[Packaging][Other] Downloading arrrow dependencies fails with 403 error on debian

[Infinical]

Describe the bug, including details regarding any error messages, version, and platform.

While installing arrow dependencies in a docker container it fails with 403 error when downloading the dependencies

#8 222.2 Err:7 https://apache.jfrog.io/artifactory/arrow/ubuntu jammy/main amd64 libarrow-glib1100 amd64 11.0.0-1
#8 222.2   403  Forbidden [IP: 52.92.243.129 443]
#8 222.2 Err:15 https://apache.jfrog.io/artifactory/arrow/ubuntu jammy/main amd64 libparquet1100 amd64 11.0.0-1
#8 222.2   403  Forbidden [IP: 52.92.243.129 443]
#8 222.2 Err:26 https://apache.jfrog.io/artifactory/arrow/ubuntu jammy/main amd64 libarrow-dev amd64 11.0.0-1
#8 222.2   403  Forbidden [IP: 52.92.243.129 443]
#8 222.2 Err:43 https://apache.jfrog.io/artifactory/arrow/ubuntu jammy/main amd64 libparquet-dev amd64 11.0.0-1
#8 222.2   403  Forbidden [IP: 52.92.243.129 443]
#8 222.4 Fetched 126 MB in 3min 25s (613 kB/s)

Component(s)

Packaging, Other

[kou]

Could you share a Dockerfile that reproduces this problem?

[Infinical]

@kou

FROM ubuntu:22.04


RUN apt-get update && apt install -y -V  wget lsb-release


RUN wget https://apache.jfrog.io/artifactory/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb \
  && apt install -y -V ./apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb > /dev/null 2>&1

RUN apt-get -y update \
    && apt-get -y install --no-install-recommends libarrow-glib-dev libparquet-glib-dev libarrow-dev libparquet-dev libgirepository1.0-dev libglib2.0 libglib2.0-dev

[raulcd]

Hi @Infinical ! I was having some issues yesterday morning with artifactory returning 403 for some requests. It seems to be solved now. Could you give it a try?
I think it was apache.jfrog.io having a temporary issue.

[Thingus]

Hi @raulcd
Letting you know that this has been an intermediate issue for me today and last week on a similar situation, with the following (snipped) dockerfile:

FROM postgres:12.11@sha256:8bff0179347982a6c083e1ed69cf4b65f12b8ae76e61f63b238c8c1ba4714c86
...snip...
RUN apt-get update \
     && apt install -y -V ca-certificates lsb-release wget
RUN  wget https://apache.jfrog.io/artifactory/arrow/$(lsb_release --id --short | tr 'A-Z' 'a-z')/apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb \
         && apt install -y -V ./apache-arrow-apt-source-latest-$(lsb_release --codename --short).deb \
         && apt update \
         && apt install -y -V libarrow-dev libparquet-dev \

The second RUN failed with 403 forbidden, so I tried running it from bash in the cached container; apt install libarrow-dev failed with the same error the first time, but happily ran on a retry.

[agoncharuk]

Hi, I am consistently getting this error when installing Arrow in an ubuntu:22.04 container (the IP in the error is 52.218.235.67). Are there any known workarounds?
Should we file an infra ticket with Apache?

[raulcd]

Thanks. I haven't been able to reproduce on my end. I've opened the following ticket on INFRA:
https://issues.apache.org/jira/browse/INFRA-24569
Please let them know any more details there! Thanks!

[ronocod]

We were seeing this a lot, and I think it's because the signed URLs used to download files from S3 are only valid for 30 seconds. The failures we saw were all on occasions that the download part of apt install took over 30 seconds. We updated our code to rerun apt install if it fails which mitigates the problem for now.

[kou]

https://issues.apache.org/jira/browse/INFRA-24569?focusedCommentId=17728543&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17728543

The timeout was updated on Monday. Have you had any further reports? If we don't hear back in a couple days I'll close this. If reports continue to come in let us know and we can have JFrog increase the timeout further.

I close this.

If this problem is still happen, please report it here.