Text Analytics Forum 2018Nov 07 - 08, 2018 Washington, DC Learn more
Listen to ourGlobal Public Sector SVP speak as part of The Human Factor In Machine Learning at the Text Analytics Forum.
Thursday, November 8: 3:00 p.m. – 3:45 p.m.
Triage First, Analysis Second
A U.S. intelligence community researcher recently declared, “Analytics is my second priority.” We have long passed the point where even “medium data” projects exceed the capacity of human analysts to actually read the corpus. Yet “human in the loop” is essential to ensuring quality in machine analytics. Thus his, and our, first priority becomes effective triage: determining which text warrants human attention, which should be condensed by automated means, and which may actually best be disregarded as valueless or actively malign. We model the text analytic process as a success of tiered steps, each with accuracy rates. While we classically think of text analytic accuracy in favorable terms as “precision and recall,” their inverses are “false negative and false positive.” We explore how initial steps with high-volume, automated processing can best tune their accuracy trade-offs to optimize the latter, human-moderated steps.