[PATCH 5.4 124/187] extcon: adc-jack: Cleanup wakeup source only if it was enabled