Meghan Markle is making Prince Harry \'miserable and glum\'