[PATCH 5.4 108/155] RDMA/core: Ensure security pkey modify is not lost