Test more versions of Python

It would be nice to have the CI run on all the currently supported python versions, on a single OS, no need to test all the versions on Fedora/OSX/TempleOS/Gentoo/Arch/…

Unfortunately, my attempts so far haven't really been conclusive.