API token auth when remote authentication is enabled?

[Syl4r-v]

So we added shibboleth login with apache to netbox and it seems to work fine except the API. It seems that also with API you need username addition to token to get authenticated. Is there no option so that via the API, only token would be sufficient? Also the Ansible Netbox inventory module can't pass anything other that the token so it too cannot be used when remote auth is enabled.