[PATCH v6 3/7] serial: core: fix sanitizing check for RTS settings