[PATCH 5.10 052/599] pinctrl: samsung: drop pin banks references on error paths