Skip to content

[ColossalChat][WIP] Refactor coati; Fix PPO, LORA; Add DPO#5148

Closed
YeAnbang wants to merge 23 commits intohpcaitech:mainfrom
YeAnbang:refactor_coati
Closed

[ColossalChat][WIP] Refactor coati; Fix PPO, LORA; Add DPO#5148
YeAnbang wants to merge 23 commits intohpcaitech:mainfrom
YeAnbang:refactor_coati

Conversation

@YeAnbang
Copy link
Copy Markdown
Contributor

@YeAnbang YeAnbang commented Dec 1, 2023

📌 Checklist before creating the PR

  • I have created an issue for this PR for traceability
  • The title follows the standard format: [doc/gemini/tensor/...]: A concise description
  • I have added relevant tags if possible for us to better distinguish different PRs

🚨 Issue number

Link this PR to your issue with words like fixed to automatically close the linked issue upon merge

e.g. fixed #1234, closed #1234, resolved #1234

📝 What does this PR do?

  • Refactor coati
  • Fix PPO, LORA
  • Add DPO
  • Adopt ColossalChat conversation format
  • Upgrade acceleration methods. Use Plugin and Boosters
  • Support tensor parallelism
  • Adopt ColossalChat conversation format
  • Fix tests

💥 Checklist before requesting a review

  • I have linked my PR to an issue (instruction)
  • My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
  • I have performed a self-review of my code
  • I have added thorough tests.
  • I have added docstrings for all the functions/methods I implemented

⭐️ Do you enjoy contributing to Colossal-AI?

  • 🌝 Yes, I do.
  • 🌚 No, I don't.

Tell us more if you don't enjoy contributing to Colossal-AI.

@YeAnbang YeAnbang requested a review from a team as a code owner December 1, 2023 09:49
@YeAnbang
Copy link
Copy Markdown
Contributor Author

YeAnbang commented Dec 1, 2023

Not ready for review. Thanks

@TongLi3701 TongLi3701 changed the title [Chat] Refactor coati; Fix PPO, LORA; Add DPO [ColossalChat][WIP] Refactor coati; Fix PPO, LORA; Add DPO Dec 1, 2023
@TongLi3701 TongLi3701 mentioned this pull request Jan 21, 2024
10 tasks
@TongLi3701 TongLi3701 closed this Mar 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants