Proxying for unobservable variables with internet document-frequency

Albert Saiz, Uri Simonsohn

Producció científica: Article en revista indexadaArticleAvaluat per experts

37 Cites (Scopus)


The internet contains billions of documents. We show that document frequencies in large decentralized textual databases can capture the cross-sectional variation in the occurrence frequencies of social phenomena. We characterize the econometric conditions under which such proxying is likely. We also propose using recently-introduced internet search volume indexes as proxies for fundamental locational traits, and discuss their advantages and limitations. We then successfully proxy for a number of economic and demographic variables in US cities and states. We further obtain document-frequency measures of corruption by country and US state and replicate the econometric results of previous research studying its covariates. Finally, we provide the first measure of corruption in American cities. Poverty, population size, service-sector orientation, and ethnic fragmentation are shown to predict higher levels of corruption in urban America.

Idioma originalAnglès
Pàgines (de-a)137-165
Nombre de pàgines29
RevistaJournal of the European Economic Association
Estat de la publicacióPublicada - de febr. 2013
Publicat externament


Navegar pels temes de recerca de 'Proxying for unobservable variables with internet document-frequency'. Junts formen un fingerprint únic.

Com citar-ho