Description
When Spark's ConstantFolding optimizer rule is disabled, an all-literal RLIKE expression reaches the native engine, which crashes with:
non scalar regexp patterns are not supported.
The error message is misleading — the issue is that both the input string and the pattern are scalar literals.
How to Reproduce
SET spark.sql.optimizer.excludedRules=org.apache.spark.sql.catalyst.optimizer.ConstantFolding;
SET spark.comet.regexp.allowIncompatible=true;
SELECT 'hello' RLIKE '^[a-z]+$';
Expected Behavior
The native engine should handle all-scalar RLIKE inputs gracefully — either by computing the correct result or by falling back to Spark.
Description
When Spark's
ConstantFoldingoptimizer rule is disabled, an all-literalRLIKEexpression reaches the native engine, which crashes with:The error message is misleading — the issue is that both the input string and the pattern are scalar literals.
How to Reproduce
Expected Behavior
The native engine should handle all-scalar RLIKE inputs gracefully — either by computing the correct result or by falling back to Spark.