Titelangaben
Mayer, Christian ; Tariq, Muhammad Adnan ; Mayer, Ruben ; Rothermel, Kurt:
GrapH : Traffic-aware graph processing.
In: IEEE Transactions on Parallel and Distributed Systems.
Bd. 29
(2018)
Heft 6
.
- S. 1289-1302.
ISSN 1558-2183
DOI: https://doi.org/10.1109/TPDS.2018.2794989
Abstract
Distributed graph processing systems such as Pregel, PowerGraph, or GraphX gained popularity due to their superior performance of data analytics on graph-structured data. These systems employ partitioning algorithms to parallelize graph analytics while minimizing inter-partition communication. Recent partitioning algorithms, however, unrealistically assume a uniform and constant amount of data exchanged between graph vertices (i.e., uniform vertex traffic) and homogeneous network costs between workers hosting the graph partitions. This leads to suboptimal partitioning decisions and inefficient graph processing. To this end, we developed Grapes, the first graph processing system using vertex-cut graph partitioning that considers both, diverse vertex traffic and heterogeneous network costs. The main idea is to avoid frequent communication over expensive network links using an adaptive edge migration strategy. Our evaluations show an improvement of 10 percent in graph processing latency and 60 percent in communication costs compared to state-of-the-art partitioning approaches.
Weitere Angaben
Publikationsform: | Artikel in einer Zeitschrift |
---|---|
Begutachteter Beitrag: | Ja |
Institutionen der Universität: | Fakultäten Fakultäten > Fakultät für Mathematik, Physik und Informatik Fakultäten > Fakultät für Mathematik, Physik und Informatik > Institut für Informatik > Lehrstuhl Data Systems Fakultäten > Fakultät für Mathematik, Physik und Informatik > Institut für Informatik > Lehrstuhl Data Systems > Lehrstuhl Data Systems - Univ.-Prof. Dr. Ruben Mayer Fakultäten > Fakultät für Mathematik, Physik und Informatik > Institut für Informatik |
Titel an der UBT entstanden: | Nein |
Themengebiete aus DDC: | 000 Informatik,Informationswissenschaft, allgemeine Werke > 004 Informatik |
Eingestellt am: | 24 Apr 2023 13:30 |
Letzte Änderung: | 05 Feb 2024 07:26 |
URI: | https://eref.uni-bayreuth.de/id/eprint/76029 |