Configure `statistics_truncate_length` in Parquet writer

[patchwork01]

Is your feature request related to a problem or challenge?

DataFusion has deprecated the configuration option datafusion.execution.parquet.max_statistics_size, because it's not used:

• Deprecate max statistics size properly #14188
• Deprecate "max statistics size" property in WriterProperties arrow-rs#6884

It seems to have been replaced in the Parquet library by statistics_truncate_length, added here:

• Enable truncation of binary statistics columns arrow-rs#5076

There doesn't seem to be a way to set this in DataFusion.

Describe the solution you'd like

We'd like a configuration option for statistics_truncate_length in ParquetOptions, to be applied to the Parquet WriterProperties similarly to column_index_truncate_length.

Describe alternatives you've considered

No response

Additional context

This causes the following issue:

• Statistics truncate length is not applied in DataFusion compaction gchq/sleeper#4240

[alamb]

Thanks @patchwork01 -- I agree it sounds like a good idea

[akoshchiy]

take