benchmark case failed

[liqiangxl]

(1) easy fix for setupDivMaxSoftmaxDropoutForward, just change contiguity({true, false, false, true} to contiguity({true, c10::nullopt, c10::nullopt, true}
(2) failed in BiasDropoutAddLayernormBwd1_fp32 in assert:

      TORCH_INTERNAL_ASSERT(
          val.has_value(),
          "Tried to evaluate the extent, ",
          extent->toInlineString(),
          " for the ptype: ",
          p_type,
          " to set launch bounds but could not.");

works fine if skip this assert by:

      if(!val.has_value()) {
        continue;
      }

[zasdfgbnm]

For (2), might be related to my recent PR #86, and I am working on rewriting this part, so hopefully it will be fixed after I rewrite.

[zasdfgbnm]

I will self assign this issue, but since you already have the fix for setupDivMaxSoftmaxDropoutForward, could you post it as PR?

[liqiangxl]

sure

[zasdfgbnm]

Update:

1. This is not related to Rewrite ParallelDimensionMap with expr simplifier #86
2. Adding , norm_params->lparams to compileFusion also fix the issue, I think we should just do it.