Whole thing including the rail?
If you are removing the whole thing with the rail, it might need rubber grommet to patch the whole in the roof.
I once removed roof rack from 97 Disco I and bought 2" rubber grommet and plugged the hole for the rack on the roof.