They say the agency will be less relevant if it leaves Washington\, D.C