-
Notifications
You must be signed in to change notification settings - Fork 167
Enable custom op and avoid graph breaks #740
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
custom op define only support types like Tensor, Tensor[], int[], int, float, bool... Not support like Enum, Object and so on.. For fake function, we can not infer the shape in @compile_ops, thus we return None for all op which is return Tensor before. But these maybe not all problematic ops. There may be more during the testing process. update some new problematic ops need return None: |
21e73dc to
d5f9235
Compare
|
problem in accuracy: |
f9aa765 to
60c2990
Compare
7875021 to
a659b1d
Compare
* first commit * revert some conflict * revert some conflict2 * support custom op define schema for some ops * support some of op return None value * support gemm return None * support other op for custom * commit on mha, gemm, moe * fix pa test * commit for enable op * add mha op multi return support * support reduce * support mha fwd * add support mha fwd and mha_v3 * support mhd bwd and reformat files * fix ci error and support mha * rewrite ops * reformat * fix ci * fix ci * skip three ops in custom * add cpu backend * support rms_norm op * support hipb_mm and moe gate * fix bug * fix bug with comment * support mha_v3_varlen * use common func to reduce code in mha * reformat * fix some bug in ci * fix some bug in ci * fix rms norm bug * fix ci * fix ci * fix moe bug
* first commit * revert some conflict * revert some conflict2 * support custom op define schema for some ops * support some of op return None value * support gemm return None * support other op for custom * commit on mha, gemm, moe * fix pa test * commit for enable op * add mha op multi return support * support reduce * support mha fwd * add support mha fwd and mha_v3 * support mhd bwd and reformat files * fix ci error and support mha * rewrite ops * reformat * fix ci * fix ci * skip three ops in custom * add cpu backend * support rms_norm op * support hipb_mm and moe gate * fix bug * fix bug with comment * support mha_v3_varlen * use common func to reduce code in mha * reformat * fix some bug in ci * fix some bug in ci * fix rms norm bug * fix ci * fix ci * fix moe bug
No description provided.