[PATCH 6.1 592/772] spi: mpc52xx: Add cancel_work_sync before module remove