SPI and u-boot tweaks on Le Potato Buildroot

I think this is what you need to flash the bootloader: