Brexit: Senior Tory suggests vote could be delayed