[PATCH 5.15 20/28] serial: sc16is7xx: fix bug when first setting GPIO direction