Phi4-14b suddenly failing after transformers update.

[Sindre01]

After SynCodes update of transformers etc, is suddenly get this error when running phi4-14b. Anyone gotten the same?

´´´
lib/python3.11/site-packages/syncode/language_model.py", line 273, in _get_next_token
next_token = torch.multinomial(probs, num_samples=1).squeeze(1)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: prob_dist must be 1 or 2 dim
´´´

[shubhamugare]

Is this a problem even with syncode used as a custom logics processor?

[Sindre01]

No,the Syncode package.