[PATCH 5.4 249/321] spi: mpc52xx: Add cancel_work_sync before module remove