Upgrade to transformers release V4.23.1

[KSGulin]

Note: currently targeted at copy of upstream release branch for easy comparison. Diff is intended to land on our main branch.

This PR integrates our existing transformers integration with the updated v4.23.1 upstream. See here for HuggingFace release notes.

Meant to land concurrently with neuralmagic/sparseml#1081

Testing Plan

• Integration tests (both cadences)
• SparseML QA docs training and export commands
• One training command from the text classification and token classification docs each

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[corey-nm]

Yeah I'm almost positive we could hot patch this stuff in instead of having repo forks.

Something like

import transformers

from transformers.models.bert.modeling_bert import BertSelfAttention as _BertSelfAttention

class PatchedBertSelfAttention(_BertSelfAttention):
    def __init__(self, *args, **kwargs):
        self.attention_scores_matmul = ...
    def forward(self):
        ...

transformers.models.bert.modeling_bert.BertSelfAttention = PatchedBertSelfAttention

[KSGulin]

Yeah I think now that most of the implementation has been moved on the sparseml side, there's definitely potential to explore here. One thing to keep in mind is that every time we've upgraded the HF repo had changes that broke our integration, so the hot patch would need to be easy to debug and amend. But in general I'm all for this

[corey-nm]

What was the reasoning for adding this class? Was this functionality not here before?

[KSGulin]

This is a file I noted for myself to remove before pushing and did not follow through

[KSGulin]

Committed the sin of editing history and paired down our fork changes to 3 commits

[corey-nm]

Will all the framework_file_paths have the same parent? Is that why we can just use the 1st one?

[corey-nm]

not sure if i like this better but thought i'd add

Suggested change

	return tuple(
	[_download_dataclass_zoo_stub_files(output) for output in outputs]
	)
	return tuple(map(_download_dataclass_zoo_stub_files, outputs))

[corey-nm]

Is this supposed to be here? Don't see it in others

[bfineran]

@corey-nm good comments, going to keep changes to existing flows out of scope for this PR as it's mean to be a rebase only, let's dig in together offline