Skip to content

Added initial infrastructure for MG C++ testing and a Pagerank MG test using it#1361

Merged
rapids-bot[bot] merged 32 commits intorapidsai:branch-0.18from
rlratzel:branch-0.18-pagerankmgtest
Feb 10, 2021
Merged

Added initial infrastructure for MG C++ testing and a Pagerank MG test using it#1361
rapids-bot[bot] merged 32 commits intorapidsai:branch-0.18from
rlratzel:branch-0.18-pagerankmgtest

Conversation

@rlratzel
Copy link
Copy Markdown
Contributor

@rlratzel rlratzel commented Jan 27, 2021

Added initial infrastructure for MG C++ testing and a Pagerank MG test using it.

Still a WIP, need to:

  • Shuffle step is currently failing
  • graph_t ctor expensive check is failing
  • Finish comparison code to reference SG Pagerank results
  • Fix the #include guard hack in test_utilities.hpp
  • Lots of cleanup
  • Refactor common steps into proper SetUp() and TearDown() functions

closes #1136

…files to include MPI, but also added the start of the MG Pagerank test file (builds, but tests are still incomplete).
…to be .cpp, utility calls sort_and_shuffle_values() but currently having an issue there. Still need to gather results from all GPUs and do comparison to reference.
@rlratzel rlratzel added 2 - In Progress improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Jan 27, 2021
@rlratzel rlratzel self-assigned this Jan 27, 2021
Copy link
Copy Markdown
Contributor

@seunghwak seunghwak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will add more reviews but I think this will unblock you.

As I commented in the review, if we are reading the entire edge list in every GPU, we don't need to shuffle edges, we just need to locally filter out edges that do not belong to this GPU.

Comment thread cpp/tests/CMakeLists.txt Outdated
Comment thread cpp/tests/README.md Outdated
Comment thread cpp/tests/utilities/mg_test_utilities.hpp Outdated
Comment thread cpp/tests/pagerank/pagerank_mg_test.cpp Outdated
Comment thread cpp/tests/pagerank/pagerank_mg_test.cpp Outdated
Comment thread cpp/tests/utilities/mg_test_utilities.cu Outdated
@rlratzel rlratzel changed the title Added initial infrastructure for MG C++ testing and a Pagerank MG test using it [skip-ci] Added initial infrastructure for MG C++ testing and a Pagerank MG test using it Jan 28, 2021
@BradReesWork BradReesWork added this to the 0.18 milestone Jan 29, 2021
Comment thread cpp/tests/CMakeLists.txt
…pagerankmgtest, first passing test: refactored utility to return renumber map and comparison maps to proper vertex now, still needs major cleanup and enabling of other tests.
@rlratzel rlratzel changed the title [skip-ci] Added initial infrastructure for MG C++ testing and a Pagerank MG test using it Added initial infrastructure for MG C++ testing and a Pagerank MG test using it Feb 8, 2021
@rlratzel rlratzel marked this pull request as ready for review February 8, 2021 07:20
@rlratzel rlratzel requested review from a team as code owners February 8, 2021 07:20
@codecov-io
Copy link
Copy Markdown

codecov-io commented Feb 8, 2021

Codecov Report

Merging #1361 (7dada93) into branch-0.18 (2fb0725) will increase coverage by 0.29%.
The diff coverage is 61.11%.

Impacted file tree graph

@@               Coverage Diff               @@
##           branch-0.18    #1361      +/-   ##
===============================================
+ Coverage        60.38%   60.67%   +0.29%     
===============================================
  Files               67       69       +2     
  Lines             3029     3120      +91     
===============================================
+ Hits              1829     1893      +64     
- Misses            1200     1227      +27     
Impacted Files Coverage Δ
python/cugraph/centrality/__init__.py 100.00% <ø> (ø)
python/cugraph/dask/structure/renumber.py 0.00% <0.00%> (ø)
python/cugraph/link_analysis/pagerank.py 100.00% <ø> (ø)
python/cugraph/comms/comms.py 34.52% <25.00%> (ø)
python/cugraph/dask/common/input_utils.py 23.07% <28.57%> (+1.14%) ⬆️
python/cugraph/dask/common/mg_utils.py 37.50% <38.09%> (-2.50%) ⬇️
python/cugraph/community/spectral_clustering.py 72.54% <38.46%> (-11.67%) ⬇️
python/cugraph/structure/number_map.py 59.20% <50.00%> (+3.24%) ⬆️
python/cugraph/structure/graph.py 66.99% <76.47%> (+0.19%) ⬆️
python/cugraph/utilities/utils.py 72.44% <84.61%> (+0.88%) ⬆️
... and 14 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 7e58591...7dada93. Read the comment docs.

@BradReesWork
Copy link
Copy Markdown
Member

rerun tests

Comment thread cpp/tests/pagerank/pagerank_mg_test.cpp Outdated
Comment thread cpp/tests/pagerank/pagerank_mg_test.cpp Outdated
Comment thread cpp/tests/utilities/mg_test_utilities.hpp Outdated
Comment thread cpp/tests/pagerank/pagerank_mg_test.cpp Outdated
@BradReesWork
Copy link
Copy Markdown
Member

rerun tests

Copy link
Copy Markdown
Collaborator

@ChuckHastings ChuckHastings left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the updates.

@BradReesWork
Copy link
Copy Markdown
Member

@gpucibot merge

@rapids-bot rapids-bot Bot merged commit 62111aa into rapidsai:branch-0.18 Feb 10, 2021
@seunghwak seunghwak mentioned this pull request Feb 26, 2021
4 tasks
rapids-bot Bot pushed a commit that referenced this pull request Mar 1, 2021
- [x] Add tests using graphs with isolated vertices
- [x] Add personalized PageRank tests
- [x] Test code refactoring
- [x] Create libcugraphtestutil.a

This PR fixes FIXMEs added in #1361 to address #1136

Authors:
  - Seunghwa Kang (@seunghwak)

Approvers:
  - Rick Ratzel (@rlratzel)
  - Andrei Schaffer (@aschaffer)
  - Brad Rees (@BradReesWork)

URL: #1419
@rlratzel rlratzel deleted the branch-0.18-pagerankmgtest branch June 17, 2022 00:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improvement / enhancement to an existing function non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEA] Multi-GPU C++ testing

7 participants