Skip to content

Conversation

@driazati
Copy link
Member

@driazati driazati commented Nov 9, 2022

This makes C++ unittests follow the normal flow of build -> upload
artifacts -> download and run tests. To simplify the changes there is a
new utility for interacting with S3.

@tvm-bot
Copy link
Collaborator

tvm-bot commented Nov 9, 2022

Thanks for contributing to TVM! Please refer to the contributing guidelines https://tvm.apache.org/docs/contribute/ for useful information and tips. Please request code reviews from Reviewers by @-ing them in a comment.

Generated by tvm-bot

)
make(ci_hexagon, 'build', '-j2')
cmake_build(ci_hexagon, 'build', '-j2')
make_standalone_crt(ci_hexagon, 'build')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We would want to remove make_standalone_crt() here for the hexagon build.

cc: @mehrdadh

@driazati driazati marked this pull request as ready for review November 10, 2022 21:21
Comment on lines +28 to +36
// make_cpp_tests(ci_gpu, 'build')
// cpp_unittest(ci_gpu)
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These aren't run at all right now and are currently broken, so this leaves them commented out. The previous code uploaded the same binaries for both gpu and gpu2 since there was a fixed reference to the build directory. This resolves the issue which causes this to fail but doesn't fix the build failure itself, which we should leave for a follow up

@driazati driazati requested review from areusch and mehrdadh November 16, 2022 01:36
@@ -0,0 +1,44 @@
#!/usr/bin/env bash
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this used anywhere?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah forgot to add calls to these in the relevant jobs after their C++ testing, fixed

popd
fi

pushd "${BUILD_DIR}"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure what happened here. shouldn't ctest also move to wherever crttest was built?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The build stuff should all be moved into the corresponding build stage and downloaded in the relevant test step to actually be run, so this removes all the building and just runs ctest (the other stuff behind the flags is also moved to the other test script below)

@mehrdadh
Copy link
Member

@driazati can you push your branch to a TVM branch to test the jenkins changes?

@driazati
Copy link
Member Author

Certain GitHub forks are configured in Jenkins to be trusted (e.g. those for people on the oss team), so the extra step to push to apache/tvm isn't necessary. You can see the info here: https://ci.tlcpack.ai/job/tvm/indexing/events, when a job comes from an untrusted source it'll say something like

Checking pull request [#13335](https://github.com/apache/tvm/pull/13335)
    (not from a trusted source)
      ‘Jenkinsfile’ found

This makes C++ unittests follow the normal flow of build -> upload
artifacts -> download and run tests. To simplify the changes there is a
new utility for interacting with S3.
Copy link
Member

@mehrdadh mehrdadh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for working on this!!

@mehrdadh mehrdadh merged commit 490e0e3 into apache:main Nov 18, 2022
masahi pushed a commit that referenced this pull request Nov 21, 2022
The docs deploy is broken following #13335:
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/main/4754/pipeline

This avoids downloading the whole docs directory (which is just used to
host documentation previews for PRs) and just grabs the `docs.tgz` which
is actually used to deploy the docs.

Co-authored-by: driazati <driazati@users.noreply.github.com>
xinetzone pushed a commit to daobook/tvm that referenced this pull request Nov 25, 2022
* [ci] Split out C++ unittests

This makes C++ unittests follow the normal flow of build -> upload
artifacts -> download and run tests. To simplify the changes there is a
new utility for interacting with S3.

* Comments

Co-authored-by: driazati <driazati@users.noreply.github.com>
xinetzone pushed a commit to daobook/tvm that referenced this pull request Nov 25, 2022
The docs deploy is broken following apache#13335:
https://ci.tlcpack.ai/blue/organizations/jenkins/tvm/detail/main/4754/pipeline

This avoids downloading the whole docs directory (which is just used to
host documentation previews for PRs) and just grabs the `docs.tgz` which
is actually used to deploy the docs.

Co-authored-by: driazati <driazati@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants