[PATCH 5.10 145/227] remoteproc: qcom_q6v5_pas: Make single-PD handling more robust