avahi-autoipd link-local conflicts with zerotier interfaces

[sarnold]

Yet another cause of netscript/routing failures, if avahi-daemon is running with the default bionic config it will break routing, although you can't see this until the interfaces are brought up:

root@arm:~# route
Kernel IP routing table
Destination     Gateway         Genmask         Flags Metric Ref    Use Iface
default         192.168.0.254   0.0.0.0         UG    203    0        0 eth0
link-local      0.0.0.0         255.255.0.0     U     210    0        0 ztevwxwlya
link-local      0.0.0.0         255.255.0.0     U     211    0        0 ztevw4x5ik
172.16.1.4      0.0.0.0         255.255.255.252 U     0      0        0 ztevw4x5ik
172.16.1.16     0.0.0.0         255.255.255.252 U     0      0        0 ztevwxwlya
192.168.0.0     0.0.0.0         255.255.255.0   U     203    0        0 eth0

And in the fpnd.log you can see this with VERBOSE enabled:

2020-06-11 02:16:42 UTC node_tools.data_funcs.wrapper +99: INFO [25480] Get data result: OK
2020-06-11 02:16:42 UTC node_tools.data_funcs.wrapper +106: DEBUG [25480] New cache time is: 2020-06-11 02:16:42 UTC
2020-06-11 02:16:42 UTC node_tools.helper_funcs.log_fpn_state +210: INFO [25480] fpn0 is UP
2020-06-11 02:16:42 UTC node_tools.helper_funcs.log_fpn_state +210: INFO [25480] fpn1 is UP
2020-06-11 02:16:42 UTC node_tools.helper_funcs.run_event_handlers +294: DEBUG [25480] running net_change_handler for iface fpn0 and state True
2020-06-11 02:16:42 UTC node_tools.helper_funcs.net_change_handler +233: DEBUG [25480] run_net_cmd using cmd: ['/usr/lib/fpnd/fpn0-setup.sh']
2020-06-11 02:16:42 UTC node_tools.helper_funcs.run_event_handlers +294: DEBUG [25480] running net_change_handler for iface fpn1 and state True
2020-06-11 02:16:42 UTC node_tools.helper_funcs.net_change_handler +233: DEBUG [25480] run_net_cmd using cmd: ['/usr/lib/fpnd/fpn1-setup.sh']
2020-06-11 02:16:42 UTC node_tools.helper_funcs.run_event_handlers +297: DEBUG [25480] running net_id_handler for iface fpn_id0 and net id edf70dc89ac63d90
2020-06-11 02:16:42 UTC node_tools.helper_funcs.net_id_handler +256: DEBUG [25480] Added network id edf70dc89ac63d90 to net_q
2020-06-11 02:16:42 UTC node_tools.helper_funcs.run_event_handlers +297: DEBUG [25480] running net_id_handler for iface fpn_id1 and net id edf70dc89a76e79a
2020-06-11 02:16:43 UTC node_tools.helper_funcs.net_id_handler +256: DEBUG [25480] Added network id edf70dc89a76e79a to net_q
2020-06-11 02:16:44 UTC schedule.Job.run +537: INFO [25480] Running job Job(interval=1, unit=seconds, do=run_net_cmd, args=(['/usr/lib/fpnd/fpn0-setup.sh'],), kwargs={})
2020-06-11 02:16:46 UTC node_tools.network_funcs.do_net_cmd +302: INFO [25480] net cmd fpn0-setup.sh result: Checking iptables binary...
Checking kernel rp_filter setting...
  RP needs garlic filter...
Checking network...
  Found edf70dc89ac63d90
Using FPN0 ID: edf70dc89ac63d90
Checking for FPN routing table...
  Inserting routing table...
Checking FPN network settings...
 "allowGlobal": true,

Found these devices and parameters:
  FPN interface: ztevw4x5ik
  FPN address: 172.16.1.6
  FPN gateway: 172.16.1.5
  FPN network id: edf70dc89ac63d90

  INET interface: eth0
  INET address: 192.168.0.158

Success
2020-06-11 02:16:46 UTC node_tools.network_funcs.run_net_cmd +268: DEBUG [25480] run net cmd ['/usr/lib/fpnd/fpn0-setup.sh'] returned tuple: (True, b'Checking iptables binary...\nChecking kernel rp_filter setting...\n 
 RP needs garlic filter...\nChecking network...\n  Found edf70dc89ac63d90\nUsing FPN0 ID: edf70dc89ac63d90\nChecking for FPN routing table...\n  Inserting routing table...\nChecking FPN network settings...\n "allowGlob
al": true,\n\nFound these devices and parameters:\n  FPN interface: ztevw4x5ik\n  FPN address: 172.16.1.6\n  FPN gateway: 172.16.1.5\n  FPN network id: edf70dc89ac63d90\n\n  INET interface: eth0\n  INET address: 192.16
8.0.158\n\nSuccess\n', 0)
2020-06-11 02:16:46 UTC node_tools.sched_funcs.wrapper +97: DEBUG [25480] JOB: Job(interval=1, unit=seconds, do=run_net_cmd, args=(['/usr/lib/fpnd/fpn0-setup.sh'],), kwargs={}) claims success: (True, b'Checking iptable
s binary...\nChecking kernel rp_filter setting...\n  RP needs garlic filter...\nChecking network...\n  Found edf70dc89ac63d90\nUsing FPN0 ID: edf70dc89ac63d90\nChecking for FPN routing table...\n  Inserting routing tab
le...\nChecking FPN network settings...\n "allowGlobal": true,\n\nFound these devices and parameters:\n  FPN interface: ztevw4x5ik\n  FPN address: 172.16.1.6\n  FPN gateway: 172.16.1.5\n  FPN network id: edf70dc89ac63d
90\n\n  INET interface: eth0\n  INET address: 192.168.0.158\n\nSuccess\n', 0)
2020-06-11 02:16:46 UTC schedule.Job.run +537: INFO [25480] Running job Job(interval=1, unit=seconds, do=run_net_cmd, args=(['/usr/lib/fpnd/fpn1-setup.sh'],), kwargs={})
2020-06-11 02:16:46 UTC node_tools.network_funcs.do_net_cmd +308: ERROR [25480] net cmd fpn1-setup.sh msg: Checking iptables binary...
FPN networks found, parsing network IDs...
Checking network...
  No gateway found
Checking network...
  Found edf70dc89a76e79a
Using FPN1 ID: edf70dc89a76e79a
Found these devices and parameters:
  FPN SRC interface: ztevwxwlya
  FPN SRC address: 172.16.1.17
  FPN SRC network: 169.254.0.0/16
172.16.1.16/30
  FPN SRC network id: edf70dc89a76e79a

  INET interface: eth0
  INET address: 192.168.0.158
  INET gateway: 192.168.0.254
Allow forwarding for FPN source traffic
net.ipv4.ip_forward = 1
iptables v1.6.1: host/network `169.254.0.0/16
172.16.1.16' not found
Try `iptables -h' or 'iptables --help' for more information.
iptables v1.6.1: host/network `169.254.0.0/16
172.16.1.16' not found
Try `iptables -h' or 'iptables --help' for more information.
iptables v1.6.1: host/network `169.254.0.0/16
172.16.1.16' not found
Try `iptables -h' or 'iptables --help' for more information.
iptables v1.6.1: host/network `169.254.0.0/16
172.16.1.16' not found
Try `iptables -h' or 'iptables --help' for more information.
iptables v1.6.1: host/network `169.254.0.0/16
172.16.1.16' not found
Try `iptables -h' or 'iptables --help' for more information.

5 warnings/errors
2020-06-11 02:16:46 UTC node_tools.network_funcs.run_net_cmd +268: DEBUG [25480] run net cmd ['/usr/lib/fpnd/fpn1-setup.sh'] returned tuple: (False, b'', 1)