[PATCH v2 1/2] gpio: em: remove the gpiochip before removing the irq domain