Skip to content

[evaluate] add functions for gpt evaluation#3781

Merged
chengeharrison merged 1 commit intohpcaitech:dev/evaluationfrom
chengeharrison:dev/evaluate
May 22, 2023
Merged

[evaluate] add functions for gpt evaluation#3781
chengeharrison merged 1 commit intohpcaitech:dev/evaluationfrom
chengeharrison:dev/evaluate

Conversation

@chengeharrison
Copy link
Copy Markdown
Contributor

@chengeharrison chengeharrison commented May 19, 2023

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

#3714

📝 What does this PR do?

Summarize your work here.
if you have any plots/diagrams/screenshots/tables, please attach them here.

Add functions to enable gpt evaluation.

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

Copy link
Copy Markdown
Contributor

@TongLi3701 TongLi3701 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Yuanchen.

Overall looks good. Some minor comments .

Comment thread applications/Chat/evaluate/gpt_evaluate.py
Comment thread applications/Chat/evaluate/gpt_evaluate.py Outdated
Comment thread applications/Chat/evaluate/gpt_evaluate.py Outdated
Comment thread applications/Chat/evaluate/gpt_evaluate.py Outdated
Comment thread applications/Chat/evaluate/gpt_evaluate.py Outdated
Comment thread applications/Chat/evaluate/gpt_evaluate.py
Comment thread applications/Chat/evaluate/gpt_evaluate.py
Comment thread applications/Chat/evaluate/gpt_evaluate.py
Comment thread applications/Chat/evaluate/gpt_evaluate.py Outdated
Comment thread applications/Chat/evaluate/gpt_evaluate.py Outdated
Copy link
Copy Markdown
Contributor

@TongLi3701 TongLi3701 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks YuanChen.

Overall looks great. Just one minor comment.

Please merge once everyone is approved.

import pandas as pd
import seaborn as sns
import tqdm
from utils import jdump, jload
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems that utils is internal package?

If so, it should be the third group according the guideline: https://composed.blog/python/imports

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, I will fix that.

Comment thread applications/Chat/evaluate/gpt_evaluate.py
@chengeharrison chengeharrison merged commit 42bedc8 into hpcaitech:dev/evaluation May 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants