Text as Data: A New Framework for Machine Learning and the Social Sciences

A guide for using computational text analysis to learn about the social world

From social media posts and text messages to digital government documents and archives, researchers are bombarded with a deluge of text reflecting the social world. This textual data offers unprecedented insights into fundamental questions in the social sciences, humanities, and industry. Meanwhile new machine learning tools are rapidly transforming the way science and business are conducted. Text as Data encapsulates a worldview of how to combine new sources of data, machine learning tools, and social science research design to develop and evaluate new insights.

Text as Data is organized around the core tasks in research projects using text--representation, discovery, measurement, prediction, and causal inference. The authors present a sequential, iterative, and inductive approach to research design. Each research task is complete with real-world applications, example methods, and a distinct style of task-focused research.

Bridging many divides--computer science and social science, the qualitative and the quantitative, and industry and academe--Text as Data is an ideal resource for anyone wanting to analyze large collections of text in their work in this era when data is abundant, computation is cheap, but the enduring challenges of social science remain.

• Overview of how to use text as data
• Research design for a world of data deluge
• Examples from across the social sciences and industry