Skip to content
This repository was archived by the owner on Nov 1, 2024. It is now read-only.

[REVIEW] Added AWS EKS Examples using DASK+RAPIDS #144

Open
akaanirban wants to merge 7 commits intorapidsai:mainfrom
akaanirban:eks-mnmg-dev
Open

[REVIEW] Added AWS EKS Examples using DASK+RAPIDS #144
akaanirban wants to merge 7 commits intorapidsai:mainfrom
akaanirban:eks-mnmg-dev

Conversation

@akaanirban
Copy link
Contributor

This PR addresses #123 and adds:

  1. Setup guide for EKS cluster.
  2. Necessary pod config templates.
  3. A short notebook for running a XGBoost with Rapids and with smaller dataset.
  4. A longer notebook with performance sweeps on variety of algorithm in cuml and larger dataset.

CAVEAT + WIP:

  1. EKS issue with calling compute on a large dask_cudf.dataframe causing local client to restart

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@zronaghi zronaghi changed the title [REVIEW, WIP] Added AWS EKS Examples using DASK+RAPIDS [WIP] Added AWS EKS Examples using DASK+RAPIDS Jun 29, 2021
@akaanirban
Copy link
Contributor Author

Added Note stating the EKS specific issue of the client restarting on calling compute.

@zronaghi zronaghi requested a review from Nanthini10 July 8, 2021 21:59
Copy link
Contributor

@Nanthini10 Nanthini10 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Able to run MNMG_XGBoost, waiting on Full exploration.

@akaanirban
Copy link
Contributor Author

Incorporated review comments @Nanthini10 . Should we still keep this as WIP ? @zronaghi

@Nanthini10
Copy link
Contributor

Can you resolve the merge conflicts with README.md?

@akaanirban akaanirban changed the title [WIP] Added AWS EKS Examples using DASK+RAPIDS [REVIEW] Added AWS EKS Examples using DASK+RAPIDS Aug 12, 2021
@akaanirban akaanirban requested a review from Nanthini10 August 12, 2021 23:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments