Double build on pull requests

[vegardb]

It seems as if having a pull request open triggers a double build of everything, via github actions