[PATCH 6.12 110/423] remoteproc: qcom_q6v5_pas: Make single-PD handling more robust