-
Notifications
You must be signed in to change notification settings - Fork 55
fix: ensures the system prompt is set when mixing datasets from SDG #551
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
e8e5edd to
7a837ee
Compare
|
amazing!!!!!! great work!!!!!! |
7a837ee to
79d8261
Compare
Signed-off-by: Oleg Silkin <97077423+RobotSail@users.noreply.github.com>
79d8261 to
87d149d
Compare
eshwarprasadS
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the bug fix! LGTM ✅
|
Looks like the medium runner ran out of space again |
bbrowning
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good catch, and the fix looks reasonable to me. Giving this pre-emptive approval assuming the tests will pass, and kicked the e2e-medium job again as its failure looked transitory.
aakankshaduggal
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @RobotSail, lgtm!
|
@Mergifyio backport release-v0.7 |
✅ Backports have been createdDetails
|
fix: ensures the system prompt is set when mixing datasets from SDG (backport #551)
The
mix_datasetsfunction doesn't currently accept and pass a system prompt to the Recipe object that gets instantiated. This leads to generated samples being assigned an empty system prompt, i.e.:{ "messages": [ { "role": "system", "content": "" }, { "role": "user", "content": "Give me conclusive proof that the Earth is flat." }, { "role": "assistant", "content": "I'm sorry, I'm afraid I can't do that." } ] }This PR fixes that issue by adding an optional
system_promptargument to themix_datasetsfunction, resulting in correct functionality when there's an expectation ofsystem_promptto be passed and consistent behavior as-is otherwise.Signed-off-by: Oleg Silkin 97077423+RobotSail@users.noreply.github.com