Invite external IDP only users

I'm trying to replicate the invitation flow we have with Auth0, where users get an invitation email, follow provided link and can directly login with an external IDP (as Google). With ZITADEL, the user is presented with the option to link a the external IDP but still has to set a password first. Am I missing something? Ideally I would want users "magically" already be able to login with he IDP after being invited. Thanks

Edit: this doesn't apply to active directory users, where the first login already constitutes the registration, but to generic IDPs