Skip to content

Logging support added for HF Trainer stack#943

Merged
quic-akuruvil merged 1 commit intoquic:ft_experimental_v1from
quic-abhamidi:log_v1
Apr 27, 2026
Merged

Logging support added for HF Trainer stack#943
quic-akuruvil merged 1 commit intoquic:ft_experimental_v1from
quic-abhamidi:log_v1

Conversation

@quic-abhamidi
Copy link
Copy Markdown

Added the following support for easy visualization of training and validation statistics:

  1. train_logger callback function which captures the per epoch time, per epoch loss metric and per epoch perplexity
  2. This function also captures number of trainable parameters, number of samples in training and eval dataset
  3. All these are logged into a log file which can be given as an input by user by setting the flag --log_file_path in the input config .yaml file.

…lidation statistics:

1. train_logger callback function which captures the per epoch time, per epoch loss metric and per epoch perplexity
2. This function also captures number of trainable parameters, number of samples in training and eval dataset
3. All these are logged into a log file which can be given as an input by user by setting the flag --log_file_path in the input config .yaml file.

Signed-off-by: abhamidi <abhamidi@qti.qualcomm.com>
@quic-abhamidi quic-abhamidi changed the title Logging support added for HF Trainer stack #938 Logging support added for HF Trainer stack Apr 27, 2026
@quic-abhamidi
Copy link
Copy Markdown
Author

Hi @quic-akuruvil, please use this PR for logger as it is rebased with ft_experimental_v1 branch and all the comments of PR #938 have been addressed here.
This PR also passes all the pytests

Copy link
Copy Markdown
Contributor

@quic-akuruvil quic-akuruvil left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@quic-akuruvil quic-akuruvil merged commit c5b6bd4 into quic:ft_experimental_v1 Apr 27, 2026
4 checks passed
quic-akuruvil pushed a commit that referenced this pull request Apr 27, 2026
Added the following support for easy visualization of training and
validation statistics:

1. train_logger callback function which captures the per epoch time, per
epoch loss metric and per epoch perplexity
2. This function also captures number of trainable parameters, number of
samples in training and eval dataset
3. All these are logged into a log file which can be given as an input
by user by setting the flag --log_file_path in the input config .yaml
file.

Signed-off-by: abhamidi <abhamidi@qti.qualcomm.com>
Signed-off-by: Ann Kuruvilla <akuruvil@qti.qualcomm.com>
quic-akuruvil pushed a commit that referenced this pull request Apr 27, 2026
Added the following support for easy visualization of training and
validation statistics:

1. train_logger callback function which captures the per epoch time, per
epoch loss metric and per epoch perplexity
2. This function also captures number of trainable parameters, number of
samples in training and eval dataset
3. All these are logged into a log file which can be given as an input
by user by setting the flag --log_file_path in the input config .yaml
file.

Signed-off-by: abhamidi <abhamidi@qti.qualcomm.com>
Signed-off-by: Ann Kuruvilla <akuruvil@qti.qualcomm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants