Altmetric

Real-time community detection in full social networks on a laptop

File Description SizeFormat 
journal.pone.0188702.pdfPublished version13.87 MBAdobe PDFView/Open
Title: Real-time community detection in full social networks on a laptop
Authors: Chamberlain, B
Levy-Kramer, J
Humby, C
Deisenroth, MP
Item Type: Journal Article
Abstract: For a broad range of research and practical applications it is important to understand the allegiances, communities and structure of key players in society. One promising direction towards extracting this information is to exploit the rich relational data in digital social networks (the social graph). As global social networks (e.g., Facebook and Twitter) are very large, most approaches make use of distributed computing systems for this purpose. Distributing graph processing requires solving many difficult engineering problems, which has lead some researchers to look at single-machine solutions that are faster and easier to maintain. In this article, we present an approach for analyzing full social networks on a standard laptop, allowing for interactive exploration of the communities in the locality of a set of user specified query vertices. The key idea is that the aggregate actions of large numbers of users can be compressed into a data structure that encapsulates the edge weights between vertices in a derived graph. Local communities can be constructed by selecting vertices that are connected to the query vertices with high edge weights in the derived graph. This compression is robust to noise and allows for interactive queries of local communities in real-time, which we define to be less than the average human reaction time of 0.25s. We achieve single-machine real-time performance by compressing the neighborhood of each vertex using minhash signatures and facilitate rapid queries through Locality Sensitive Hashing. These techniques reduce query times from hours using industrial desktop machines operating on the full graph to milliseconds on standard laptops. Our method allows exploration of strongly associated regions (i.e., communities) of large graphs in real-time on a laptop. It has been deployed in software that is actively used by social network analysts and offers another channel for media owners to monetize their data, helping them to continue to provide free services that are valued by billions of people globally.
Issue Date: 17-Jan-2018
Date of Acceptance: 1-Dec-2017
URI: http://hdl.handle.net/10044/1/56397
DOI: https://dx.doi.org/10.1371/journal.pone.0188702
ISSN: 1932-6203
Publisher: Public Library of Science (PLoS)
Journal / Book Title: PLoS ONE
Volume: 13
Issue: 1
Copyright Statement: © 2018 Chamberlain et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Keywords: MD Multidisciplinary
General Science & Technology
Publication Status: Published
Open Access location: http://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0188702&type=printable
Article Number: e0188702
Appears in Collections:Computing



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Creative Commons