[PATCH 6.1 040/259] ASoC: rt5640: Revert "Fix sleep in atomic context"