[PATCH 6.1 23/31] serial: sc16is7xx: fix bug when first setting GPIO direction