[PATCH 5.15 07/10] xfs: don't assert fail on perag references on teardown