[VL] Collapse trivial projects generated by rule PushDownInputFileExpression

[zml1206]

What changes were proposed in this pull request?

follow #7124
In PushDownInputFileExpression, we will add new project before leaf node and push down input file expression to the
new project, if scan is fallback and the outer project is cheap or fallback, we can collapse project to simplify physical plan.

How was this patch tested?

UT.

[github-actions]

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/apache/incubator-gluten/issues

Then could you also rename commit message and pull request title in the following format?

[GLUTEN-${ISSUES_ID}][COMPONENT]feat/fix: ${detailed message}

See also:

• Other pull requests

[github-actions]

Run Gluten Clickhouse CI

[github-actions]

Run Gluten Clickhouse CI

[zml1206]

cc @zhztheplayer Thank you.

[zhztheplayer]

Hi @zml1206, why this is done in rule PushDownInputFileExpression? Given that we already had individual rules like CollapseProjectExecTransformer to collapse projects. Should we have an individual rule for this feature as well?

[zml1206]

Hi @zml1206, why this is done in rule PushDownInputFileExpression?

Because this Project is produced by PushDownInputFileExpression, only when scan is fallback we try to collapse. The collapse conditions here are special. Normally there will not be two projects like this because of the spark CollapseProject rule. So done it in this rule would be more appropriate?

[baibaichen]

@zml1206 @zhztheplayer

IIUC, the following codes colud be removed, after this pr and #7124, right?

GlutenWholeStageColumnarRDD::compute()
    // To support input_file_name(). According to semantic we should return
    // the exact file name a row belongs to. However in columnar engine it's
    // not easy to accomplish this. so we return a list of file(part) names
    split match {
      case FirstZippedPartitionsPartition(_, g: GlutenPartition, _) =>
        InputFileBlockHolderProxy.set(g.files.mkString(","))
      case _ =>
        InputFileBlockHolderProxy.unset()
    }