Federal liberals not to blame for Victoria loss: Frydenberg