I Just tryed v5.3.5 and this works correctly now. I am still having the issue reported here Unable to load OnlyKey app bootloader on Qubes OS - #11 by RustyFish but the firmware currently on it is beta 8.
Anyways the App works correctly now in debian-11 qubes template which is awesome.