[metrics] OpenTelemetry metric reporter

[michaelkoepf]

Search before asking

• I searched in the issues and found nothing similar.

Motivation

Note: Low priority feature (created for tracking purposes)

OpenTelemetry Observability Primer

Fluss observability capabilities are currently limited to vendor-specific formats (e.g., metrics are exposed via Prometheus).

Adding an OpenTelemetry metric reporter allows users to choose their preferred observability backend and facilitates Fluss usage on Kubernetes.

Solution

• Add a metric reporter for OpenTelemetry
• Create a quickstart guide that shows how to get up and running incl. ingesting logs into OpenTelemetry (resource 1, resource 2)

Willingness to contribute

• I'm willing to submit a PR!

[wuchong]

Hi @michaelkoepf , how do you plan to integrate OpenTelemetry? Is it like flink-metrics-otel in Flink metrics? If yes, you can refer the code of flink-metrics-otel, because the metric system of Fluss is very similar to Flink.

[michaelkoepf]

no detailed plans yet. but i will have a look at the suggested flink-metrics-otel