Suppress warnings when masking sensitive confs

[kaxil]

This is to prevent issues such as #43334 . This occurred when #43040 was merged. This PR fixes it.

Before:

root@131e2fda270d:/opt/airflow# airflow providers list
[2024-10-23T23:24:17.970+0000] {configuration.py:995} WARNING - section/key [core/asset_manager_kwargs] not found in config
[2024-10-23T23:24:17.971+0000] {configuration.py:995} WARNING - section/key [database/sql_alchemy_engine_args] not found in config
package_name                              | description                                                                                             | version
==========================================+=========================================================================================================+==========
apache-airflow-providers-airbyte          | Airbyte https://airbyte.com/                                                                            | 4.0.0
apache-airflow-providers-alibaba          | Alibaba Cloud integration (including Alibaba Cloud https://www.alibabacloud.com/)                       | 2.9.1

After:

root@131e2fda270d:/opt/airflow# airflow providers list
package_name                              | description                                                                                             | version
==========================================+=========================================================================================================+==========
apache-airflow-providers-airbyte          | Airbyte https://airbyte.com/                                                                            | 4.0.0
apache-airflow-providers-alibaba          | Alibaba Cloud integration (including Alibaba Cloud https://www.alibabacloud.com/)                       | 2.9.1

---

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

[kaxil]

@potiuk here is why @suppress_logs_and_warning wasn't working

[potiuk]

Nice find @kaxil !

[potiuk]

I am cherry-picking #43334 to (in #43336) - this one will also have to be cherry-picked.