CI: Fix IPv6 on runner, broken since ~ two weeks

If IPv6 is advertised, for example via /etc/hosts, but in fact not working, this might break specs.