[PATCH 6.1 453/611] spmi: Add a check for remove callback when removing a SPMI driver