The PM's decision to back his chief aide's lockdown trip to Durham has sparked fears that the government's coronavirus message will be undermined.
Some Tory backbenchers have called for Dominic Cummings to resign to ensure public confidence in future measures.
The row comes as plans to further ease lockdown restrictions will be discussed at a cabinet meeting later.
Education Secretary Gavin Williamson has said Mr Cummings "at no stage broke the law or broke the rules".
Speaking on BBC Radio 4's Today programme, Mr Williamson said that everyone, "whether they are anywhere in the country or working in No 10", was expected to abide by the law.
"That's what the prime minister expects, that's the assurance that he asked for, that is the assurance that he got."
Criticism of Boris Johnson's decision to take no action over Mr Cummings' 260-mile trip to his parents' home has come from all quarters.
At least 16 Tory backbenchers have now spoken out against the political adviser, while senior Church of England bishops and scientists advising ministers on the pandemic have strongly criticised the government's handling of the row.
Scotland's First Minister Nicola Sturgeon warned the consequences of Boris Johnson's decision could be "serious", and acting Lib Dem leader Sir Ed Davey said it undermined the prime minister's authority on the coronavirus crisis.
Labour has called for an inquiry.
Mr Johnson has defended Mr Cummings, saying he believed his senior aide had "no alternative" but to make the journey from London at the end of March for childcare "when both he and his wife were about to be incapacitated by coronavirus".
At Sunday's daily briefing, the prime minister also confirmed the phased reopening of England's primary schools will begin on 1 June.
The prime minister is this week expected to set out details of plans to ease restrictions, which will reportedly include information about the reopening of some non-essential shops in June.
Boris Johnson failed to close down Cummings story
If Boris Johnson's decision to appear at Sunday's press conference was an attempt to close down the story about Dominic Cummings' behaviour during the lockdown by handling it himself, it failed completely.
It certainly was not an attempt to give the public the full information.
Instead, the prime minister refused to answer the questions that remain about the specifics of his adviser's visit or visits, to the north east of England while his team was telling the public again and again and again that they had to "stay at home".
Conservative backbencher David Warburton, MP for Somerton and Frome, said Mr Cummings was "damaging the government and the country that he's supposed to be serving".
Speaking on BBC Breakfast, Mr Warburton said: "We've not been offered the chance to interpret the rules, that's really not how it works otherwise there would be complete chaos."
The MP, who said his own father had died alone as a result of the coronavirus lockdown, said "people have made sacrifices" and "in those sacrifices there really hasn't been the choice to use instinct".
He added: "We've been tasked with following regulations laid down by the government."
Another Tory MP, Jason McCartney, said in a Facebook post that while it was important for people to show compassion during the crisis, Mr Cummings had to go because the "perceived hypocrisy of the rule makers potentially threatens the success of any future measures" under a second wave of coronavirus.
Theresa Villiers, a Tory MP and former cabinet minister, said she understood the row makes Mr Cummings' position "difficult", but she said: "I hope that he is able to stay because he's a highly effective adviser to the prime minister."
Meanwhile, some of the scientists that advise ministers were concerned the prime minister's decision to back Mr Cummings would undermine the message on controlling the virus, with one warning that "more people are going to die".
Stephen Reicher, a professor of social psychology who has advised the government on behavioural science during the pandemic, said the prime minister's backing of Mr Cummings made him feel "dismay".
He said trust was vital to maintaining public health measures. "You can't have trust if people have a sense of them and us," he told the BBC.
Speaking on ITV's Good Morning Britain, Prof Reicher - a member of the scientific pandemic influenza group on behaviours (SPI-B) - said research showed that the reason people observed lockdown was not for themselves but for the community.
"If you give the impression there's one rule for them and one rule for us you fatally undermine that sense of 'we're all in this together' and you undermine adherence to the forms of behaviour which have got us through this crisis," he said.
"The real issue here is that because of these actions, because of undermining trust in the government, because of undermining adherence to the rules that we all need to follow, people are going to die."
Two other members of SPI-B, which feeds into the Sage scientific advisory group, have backed Prof Reicher's comments - University College of London professors Robert West and Susan Michie.
It comes as the Bishop of Bristol, the Right Reverend Vivienne Faull, has accused the prime minister of having "no respect for people", while the Bishop of Leeds, the Right Reverend Nick Baines, said Mr Johnson was treating people "as mugs".
Earlier, Ms Sturgeon told BBC Breakfast that the prime minister was "putting his political interest ahead of the public interest".
"When trust in a public health message and public health advice is as important as it is right now the consequences could be very serious," Scotland's First Minister said.
And acting Lib Dem leader Sir Ed told the programme that the prime minister should sack Mr Cummings "so the government has more credibility in what it says about public health".
"The instruction the prime minister gave us all to stay at home has been breached by his top adviser and that's what you can't get away from in this story, its pretty simple," he said.
Labour leader Sir Keir Starmer said he would have sacked Mr Cummings if he were prime minister.
Former chief constable of Durham Police, Mark Barton, said the prime minister's decision has "now made it exponentially tougher for all those on the frontline enforcing the lockdown".
"We're in the middle of a national emergency and the people who make the rules can't break the rules otherwise we're going to have chaos," he said.
The prime minister said he held "extensive" discussions on Sunday with Mr Cummings, who he said "followed the instincts of every father and every parent - and I do not mark him down for that".
The Observer and Sunday Mirror reported two further allegations of lockdown breaches by his aide, although Mr Johnson called "some" of the claims "palpably false".
One report alleges that a witness saw Mr Cummings in Barnard Castle, more than 25 miles from Durham, where he had been self-isolating, on 12 April.
Ministers to publicly support Mr Cummings include the Health Secretary Matt Hancock and Cabinet Office Minister Michael Gove.
Meanwhile, in a statement posted on Twitter, Amanda Hopgood, leader of the Liberal Democrats on Durham County Council, said "a number of local residents have reported seeing Dominic Cummings on several occasions in April and May" and that she has referred the matter to Durham Police.
It comes as an investigation has been launched into a tweet posted on the official UK Civil Service Twitter account, which asked "Can you imagine having to work with these truth twisters?"
The since-deleted message appeared shortly after Mr Johnson's daily news briefing.