Is the rotary-encoder driver supported in kernel for AML-X905S-CC? An example of the overlay or some details what it should contain would be nice for other tinkerers as well I think.
https://www.kernel.org/doc/html/latest/input/devices/rotary-encoder.html
You can also just manually parse the GPIO values in userspace and then compute the status of the rotary encoder without much difficulty.