That is the view of pundit and former Manchester United star Phil Neville.
The Italian boss admitted his side were no longer in the battle for the Premier League title after being beaten 1-0 by West Ham in the day's early kick-off.
But Conte also claimed his players were tired after a hectic fixture list of late.
Chelsea won the league last year after having the advantage of no Champions League football.
But Neville thinks Conte's excuses this term aren't valid.
"In terms of fixtures they had it easier last year with no Champions League," he said on Match of the Day.
Chelsea player ratings v West Ham
Chelsea FC
“I think he needs to get on with it”
Phil Neville
"But he's talking too much about tiredness and the fixture list.
"He's moaning about having matches after the Champions League."
When asked by presenter Gary Lineker whether Conte may be sending a message to owner Roman Abramovich over his lack of investment in the summer, Neville agreed.
But the pundit still didn't feel any sympathy for the Blues boss.
Getty
BBC
"He probably is [making a point] about the size of his squad," he added.
"And that he didn't bring in the players he wanted in the summer.
"But I think if your manager is talking about tiredness then it does affect your team.
"I think he needs to get on with it."
Chelsea find themselves 11 points behind league leaders Manchester City, who could extend their lead at the top after their visit to Old Trafford this afternoon.