[PATCH 5.4 290/320] net/fsl: xgmac_mdio: Fix incorrect iounmap when removing module