Yellow LED and unresponsive for a while after use as SSH-key

As the title says, the Onlykey LED turns yellow, and it becomes completely unresponsive for 20-30 seconds after having been used for SSH authentication via onlykey-agent.

This only happens after a successful login, with correct confirmation code. Is this intentional behavior, and if so, is there a way to reduce this timeout? I often need to enter a root password pretty much immediately after logging in. What I do know is physically unplug the Onlykey after login, then re-insert it and type my PIN. It’s annoying, but way faster than waiting for the LED to turn green, and functionality to return to normal.

Yes, with the next version of firmware and onlykey-agent this will be fixed