Skip to content

Failure to retrieve pod logs cause job to fail #1462

@nuclearcat

Description

@nuclearcat

One of jobs failed with following message:

Exception: Unable to get pod log (500)
Reason: Internal Server Error
HTTP response headers: HTTPHeaderDict({'Audit-Id': '0de19bf4-1093-4998-9b87-095780f28ec1', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Date': 'Tue, 04 Oct 2022 12:12:27 GMT', 'Content-Length': '215'})
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Get \"https://10.240.0.16:10250/containerLogs/default/build-j84912-x86-64-clang-16-x86-64-defconfig-bcn49/kci-build\": EOF","code":500}

While i checked manually, kernel got built and properly uploaded to storage.
Likely best solution is to retry retrieving log several times and then even if it failed, keep going.
Following steps, where wget will retrieve several json files will verify if build is consistent, and log is not critical part of such integrity check.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions