Fluentbit support

[tvangundy]

Add fluentbit support

[Copilot]

Pull Request Overview

This PR adds Fluentbit support for telemetry processing by introducing new kustomize components and configuration resources for systemd, kubernetes, containerd, and fluentd deployments.

• Adds kustomize components and associated YAML files for different Fluentbit configurations.
• Integrates Lua filters and custom metrics configuration for log processing.
• Sets up helm and git repository resources to deploy the fluent-operator.

Reviewed Changes

Copilot reviewed 21 out of 21 changed files in this pull request and generated 1 comment.

Show a summary per file

File	Description
kustomize/telemetry/resources/fluentbit/systemd/kustomization.yaml	Adds systemd component with configuration references.
kustomize/telemetry/resources/fluentbit/systemd/fluentbit-clusterfilter.yaml	Introduces a ClusterFilter using a Lua filter for systemd logs.
kustomize/telemetry/resources/fluentbit/systemd/configmap.yaml	Provides a Lua script for timestamp formatting and log restructuring.
kustomize/telemetry/resources/fluentbit/kustomization.yaml	Registers the fluentbit deployment resource.
kustomize/telemetry/resources/fluentbit/kubernetes/kustomization.yaml	Adds kubernetes-level cluster input and filter components.
kustomize/telemetry/resources/fluentbit/kubernetes/fluentbit-clusterinput.yaml	Defines a ClusterInput for retrieving container logs.
kustomize/telemetry/resources/fluentbit/kubernetes/fluentbit-clusterfilter.yaml	Configures multiple filters for kubernetes logs including nesting and modifications.
kustomize/telemetry/resources/fluentbit/fluentd/kustomization.yaml	Registers the fluentd component configuration.
kustomize/telemetry/resources/fluentbit/fluentd/clusteroutput.yaml	Creates a ClusterOutput to forward logs to a fluentd endpoint.
kustomize/telemetry/resources/fluentbit/fluentbit.yaml	Sets up the FluentBit deployment and its corresponding cluster configuration.
kustomize/telemetry/resources/fluentbit/containerd/*	Provides containerd-specific components, including ClusterInput, ClusterFilter, and a ConfigMap with a Lua script.
kustomize/telemetry/base/fluentbit/*	Adds base kustomization, helm repository, helm release, and git repository resources for deploying the fluent operator.

Comments suppressed due to low confidence (1)

kustomize/telemetry/base/fluentbit/helm-release.yaml:22

• [nitpick] The key 'Kubernetes' is capitalized, which is inconsistent with typical YAML naming conventions; consider renaming it to 'kubernetes' for consistency.

    Kubernetes: false

[Copilot]

The 'match' value 'kube.' does not correspond to the input tag 'service.' defined in the corresponding ClusterInput, which may result in log filtering mismatches. Consider updating the match value to 'service.*' to ensure consistency.

Suggested change

	match: kube.*
	match: service.*