[PATCH AUTOSEL 6.1 18/19] serial: 8250: Reinit port->pm on port specific driver unbind