Brandon Klein Brandon understands that better teams are fundamental to all of our success. As a global thought leader, ushering in the 'Future of Work' revolution, he paves the way using data + design to accelerate the Collaboration Revolution. Brandon is the Co-Founder of the software start-up, Collaboration.Ai and an active member of The Value Web, a non-profit committed to changing the way decisions are made to better impact our world. Dec 17

Why so Similar?: Identifying Semantic Organizing Processes in Large Textual Corpora by Drew Margolin, Yu-Ru Lin, David Lazer :: SSRN

This paper introduces the concept of semantic organizing processes as a means of inferring theoretically meaningful behavior from the observation of raw text. Semantic organizing processes are mechanisms by which a set of authors come to produce texts that are similar in some observable, quantifiable way. We introduce three broad semantic organizing processes -- authors sharing subject matter, authors sharing goals, and authors sharing sources -- and argue that each of these processes will lead to texts that tend to share n-grams at different lengths: short n-grams for shared subject matter, moderate length n-grams for shared goals, and long n-grams for shared sources. To test these hypotheses, we develop a novel n-gram extraction technique to capture text similarity based on n-grams of different lengths. We then apply our technique to a corpus where the author attributes are observable: the public statements of the Members of the U.S. Congress. Our results support the hypothesis that these three processes are reflected in distinct kinds of textual similarity. This article presents the first empirical finding that different social processes are detectable through the structure of overlapping textual features. The finding has important implications for modeling text and understanding underlying social processes.

 

education, peoplescience, research, Collaboration Article, collaborative web link

Brandon Klein Brandon understands that better teams are fundamental to all of our success. As a global thought leader, ushering in the 'Future of Work' revolution, he paves the way using data + design to accelerate the Collaboration Revolution. Brandon is the Co-Founder of the software start-up, Collaboration.Ai and an active member of The Value Web, a non-profit committed to changing the way decisions are made to better impact our world.