Node Exporter using wrong address (wg0) as instance and prometheus target

[ncrmro]

Host operating system: output of uname -a

Linux hostame 6.1.0-13-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.55-1 (2023-09-29) x86_64 GNU/Linux

node_exporter version: output of node_exporter --version

1.6.1, 1.7.0

node_exporter command line flags

Same from kube-prometheu-stack

    - --path.procfs=/host/proc
    - --path.sysfs=/host/sys
    - --path.rootfs=/host/root
    - --path.udev.data=/host/root/run/udev/data
    - --web.listen-address=[$(HOST_IP)]:9100
    - --collector.filesystem.mount-points-exclude=^/(dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/.+)($|/)
    - --collector.filesystem.fs-types-exclude=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$

node_exporter log output

    - --path.procfs=/host/proc
    - --path.sysfs=/host/sys
    - --path.rootfs=/host/root
    - --path.udev.data=/host/root/run/udev/data
    - --web.listen-address=[$(HOST_IP)]:9100
    - --collector.filesystem.mount-points-exclude=^/(dev|proc|sys|var/lib/docker/.+|var/lib/kubelet/.+)($|/)
    - --collector.filesystem.fs-types-exclude=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$

Are you running node_exporter in Docker?

Yes in kubernetes

What did you do that produced an error?

I believe this happened after I added a bridge network interface

What did you expect to see?

I expected the instance to use the ip (LAN) ip address from

What did you see instead?

Prometheus is trying to use the wg0 IP address

[discordianfish]

I assume you mean the interface it binds to. That seems like a problem with kube-prometheus-stack