Have you set a FIDO2 pin? onlykey-cli set-pin
onlykey-cli set-pin
ssh-with-fido2-how-to-set-up-which-pin-code
@donquijote wrote a good HowTo