Chart: add resources for cleanup and createuser jobs

[Aakcht]

Currently it's not possible to configure createUser Job and cleanup cronjob resources. This PR makes resources of these jobs configurable.

---

^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

[Aakcht]

Looks like the failing check is not related to this PR: Error: Process completed with exit code 137.

[mik-laj]

We have a few options for resource configuration, but no documentation about it.

workers.kerberosSidecar.resources
workers.resources
workers.logGroomerSidecar.resources
scheduler.resources
scheduler.logGroomerSidecar.resources
triggerer.resources
migrateDatabaseJob.resources
webserver.resources
flower.resources
statsd.resources
pgbouncer.resources
pgbouncer.metricsExporterSidecar.resources
redis.resources
dags.gitSync.resources

Would you take the time to describe it?

[mik-laj]

CC: @simplylizz

[Aakcht]

@mik-laj , do you want to describe it specifically on the page http://apache-airflow-docs.s3-website.eu-central-1.amazonaws.com/docs/helm-chart/latest/index.html ? From what I see, the parameters reference is available at http://apache-airflow-docs.s3-website.eu-central-1.amazonaws.com/docs/helm-chart/latest/parameters-ref.html and it already includes documentation about possible resource configuration. See https://github.com/apache/airflow/blob/main/docs/helm-chart/parameters-ref.rst and https://github.com/apache/airflow/blob/main/docs/conf.py .

[mik-laj]

@Aakcht We have reference documentation that allows a Helm / Kubernetes expert to take advantage of this option. However, we lack a guide that will allow a less experienced user to use this feature.

For example, Kubernetes has a page that describes how to create a deployment object.
https://kubernetes.io/docs/concepts/workloads/controllers/deployment/
Butt they have a reference page for this object type:
https://kubernetes.io/docs/reference/generated/kubernetes-api/v1.22/#deployment-v1-apps

[Aakcht]

@mik-laj Do you think something like http://apache-airflow-docs.s3-website.eu-central-1.amazonaws.com/docs/helm-chart/latest/using-additional-containers.html would work? I can add a similar page for the container resources.

[mik-laj]

Yes. Exactly.

[kaxil]

Good idea @mik-laj

[Aakcht]

@mik-laj @kaxil I've added the page for the container resources, please take a look.

[github-actions]

The PR is likely OK to be merged with just subset of tests for default Python and Database versions without running the full matrix of tests, because it does not modify the core of Airflow. If the committers decide that the full tests matrix is needed, they will add the label 'full tests needed'. Then you should rebase to the latest main or amend the last commit of the PR, and push it with --force-with-lease.