"Total and utter rubbish", that's how the former Commons speaker John Bercow has described accusations he "brutalised" staff.