New England captain Rio Ferdinand has withdrawn his appeal against a four-game ban given to him following a clash with Hull City striker Craig Fagen last month.