Karnataka Speaker KR Ramesh Kumar has been under pressure since resignations started earlier this month