I’m using Debian 12 like you.
Did you flash your OS with a bit accurate flashing tool? At first I had login problem with BalenaEtcher and transfered to Win32DiskImager.
I thought you meant ethernet connection when you said serial connection. Hadn’t you enabled sshd before enabling npu?