[PATCH 6.1 120/132] soundwire: stream: Add missing clear of alloc_slave_rt