Tweet-SCAN: An event discovery technique for geo-located tweets

Joan Capdevila, Jesús Cerquides, J. Nin, Jordi Torres

Research output: Indexed journal article Articlepeer-review

18 Citations (Scopus)

Abstract

Twitter has become one of the most popular Location-based Social Networks (LBSNs) that bridges physical and virtual worlds. Tweets, 140-character-long messages, are aimed to give answer to the What's happening? question. Occurrences and events in the real life (such as political protests, music concerts, natural disasters or terrorist acts) are usually reported through geo-located tweets by users on site. Uncovering event-related tweets from the rest is a challenging problem that necessarily requires exploiting different tweet features. With that in mind, we propose Tweet-SCAN, a novel event discovery technique based on the popular density-based clustering algorithm called DBSCAN. Tweet-SCAN takes into account four main features from a tweet, namely content, time, location and user to group together event-related tweets. The proposed technique models textual content through a probabilistic topic model called Hierarchical Dirichlet Process and introduces Jensen–Shannon distance for the task of neighborhood identification in the textual dimension. As a matter of fact, we show Tweet-SCAN performance in two real data sets of geo-located tweets posted during Barcelona local festivities in 2014 and 2015, for which some of the events were identified by domain experts beforehand. Through these tagged data sets, we are able to assess Tweet-SCAN capabilities to discover events, justify using a textual component and highlight the effects of several parameters.

Original languageEnglish
Pages (from-to)58-68
Number of pages11
JournalPattern Recognition Letters
Volume93
DOIs
Publication statusPublished - 1 Jul 2017
Externally publishedYes

Keywords

  • DBSCAN
  • Event discovery
  • Hierarchical Dirichlet Process (HDP)
  • Probabilistic topic models
  • Twitter
  • Unsupervised learning

Fingerprint

Dive into the research topics of 'Tweet-SCAN: An event discovery technique for geo-located tweets'. Together they form a unique fingerprint.

Cite this