The IRS alone hemorrhaged more than 31,000 employees as of January in President Trump's government cuts, according to the agency's inspector general.