[PATCH 6.4 25/32] serial: sc16is7xx: fix bug when first setting GPIO direction