[eplatero] Add support for exporting and compiling models for SpD#119

Merged

ochougul merged 30 commits intoquic:mainfrom

quic-agokhale:gen_spd_models

Dec 11, 2024

Commits on Dec 5, 2024

rebasing with main. previous local gen_spd_models was broken since it was not picking up latest changes from main. as such, I found common ancestor, picked up latest changes from main, and made new…
eplatero97
committed
add decode_seq_len to non-continuous batching case
eplatero97
committed
mirror test_causal_lm_models.py from main
eplatero97
committed
add more to the explanation of the model changes
eplatero97
committed
lint fixing
eplatero97
committed
alphabetical order imports on pytorch_transforms.py
eplatero97
committed
add init to spd directory
eplatero97
committed
replace modifying seq_len by letting user define proper config
eplatero97
committed
resolving 1st round comments from Onkar and made fix on gather implementation
eplatero97
committed
removing old unit tests
eplatero97
committed
* Added way to make num_logits_to_keep dynamic in ONNX and removed need to regenerate ONNX for different values of num_logits_to_keep only qpc is recompiled, * ran formatter , * reorganized pytorch…

ochougul
authored and
eplatero97
committed
changed interface to be similar to CB

ochougul
authored and
eplatero97
committed
made unit tests work with array approach
eplatero97
committed
for TLM, made specialization return 1 logit for prefill and for decode
eplatero97
committed
moved from to method because this flag only has implications for compile stage, not export
eplatero97
committed
fixing qpc directory naming to be backwards compatible
eplatero97
committed
updating docstrings and documentation
eplatero97
committed
revert changes to CLI exportation of onnx and specialization to reflect state in main branch
eplatero97
committed
fixed specializations creation and ran formatter

ochougul
authored and
eplatero97
committed
add pytorch-level unit test
eplatero97
committed
uncommented non-llama pytorch-level unit test
eplatero97
committed
modified pytorch level unit test and added hf vs ort vs qaic unit test
eplatero97
committed
change llama test model from jackfram to tinyllama to match other tests
eplatero97
committed
fix failing tlm_dlm tests by passing is_tlm correctly in modeling_auto
eplatero97
committed
rm dlm specialization
eplatero97
committed
updated quick_docs
eplatero97
committed
rm tlm dims test since that's already tested and generalize common code in pytorch_transforms
eplatero97
committed
rm flag from non-test definition
eplatero97
committed

Commits on Dec 6, 2024

rm unnecessary function that is not used
eplatero97
committed

Commits on Dec 10, 2024

ran formatter and linter
ochougul
committed