Conversation
#15807 break the eval flow. Forward fix
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/15952
Note: Links to docs will display an error until the docs builds have been completed. This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This PR needs a
|
| quant_dtype = getattr(QuantDtype, f"use_{args.ptq}") | ||
| decoder_model_config = SUPPORTED_LLM_MODELS[args.decoder_model] | ||
| custom_annotations = decoder_model_config.custom_annotation | ||
| custom_annotations = decoder_model_config.quant_recipe.custom_quant_annotations |
There was a problem hiding this comment.
Sorry for the late catch. I just saw this PR.
And it actually needs to be called like this:
custom_annotations = decoder_model_config.quant_recipe().recipe.custom_quant_annotations|
Fixed in a different PR |
#15807 break the eval flow. Forward fix