[PATCH 6.1 35/88] usb: gadget: u_serial: Fix race condition in TTY wakeup