Muslim leaders to boycott meeting with Prime Minister