(dev) Add fluentbit to dev site.

[gseriche]

This pull request introduces significant updates to the Fluent Bit configuration and deployment files to improve logging, monitoring, and customization for Kubernetes clusters. The changes focus on removing outdated configurations, adding new filters and parsers, and enhancing Helm chart customizations for specific environments.

Removal of outdated configurations:

• fleet/lib/fluent-bit-kube-pre/fleet.yaml: Removed the defaultNamespace, labels, namespaceLabels, and helm configurations, including timeoutSeconds and waitForJobs. These are no longer required.
• fleet/lib/fluent-bit-kube-pre/manifests/externalsecret-fluentbit-kube-cred.yaml: Deleted the ExternalSecret configuration for Fluent Bit credentials, as credentials are no longer managed this way.

Enhanced Helm chart customizations:

• fleet/lib/fluent-bit-kube/fleet.yaml: Added targetCustomizations for the dev environment, allowing cluster-specific Helm values to be applied.

Improved Fluent Bit configuration:

• fleet/lib/fluent-bit-kube/values.yaml: Updated config to replace the systemd input with a tail input for kubelet logs, added new filters for Kubernetes metadata cleanup, and introduced new parsers for auditd_line and syslog_line formats. [1] [2]
• fleet/lib/fluent-bit-kube/values.yaml: Enhanced HTTP server settings with HTTP_Max_Connections and HTTP_Buffer_Size for better performance.

Monitoring improvements:

• fleet/lib/fluent-bit-kube/values.yaml: Added a new label prometheus.io/cluster to the serviceMonitor configuration for better integration with Prometheus.

Pending PR: #934

[jhoblitt]

I'm not sure I understand the title of this PR. The bundle being modified isn't included by any cluster. Is the intent to deploy fluentbit on all dev clusters?

[gseriche]

I'm not sure I understand the title of this PR. The bundle being modified isn't included by any cluster. Is the intent to deploy fluentbit on all dev clusters?

Yes, @jhoblitt, and next steps should be to add fluent-bit to the ls and cp.
Fluent-bit will extract the logs from the containers and send them to Loki.

[csilva-cl]

it looks ok, but i want to confirm it was tested in dev. (I cant see the ns)

[csilva-cl]

it looks ok, but i want to confirm it was tested in dev. (I cant see the ns)

scratch that, I can see the ns

[cbarria]

lgtm

@cbarria approved