Pound loses ground on fading hopes for cross-party Brexit deal