[PATCH 5.10 059/116] gpio: aggregator: Fix calling into sleeping GPIO controllers