[PATCH 6.1 119/183] iavf: Fix out-of-bounds when setting channels on remove