[PATCH 5.4 308/403] memstick: Fix deadlock by moving removing flag earlier