[PATCH 6.3 143/160] soundwire: stream: Add missing clear of alloc_slave_rt