[PATCH v5.4.y v5.10.y] spi: Fix deadlock when adding SPI controllers on SPI buses