[PATCH 6.6 067/268] remoteproc: qcom_q6v5_pas: Make single-PD handling more robust