跳到主要导航 跳到搜索 跳到主要内容

Asynchronous Dual Free Stochastic Dual Coordinate Ascent for Distributed Data Mining

  • Zhouyuan Huo*
  • , Xue Jiang
  • , Heng Huang
  • *此作品的通讯作者
  • University of Pittsburgh
  • JDcom

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

3 引用 (Scopus)

摘要

The primal-dual distributed computational methods have broad large-scale data mining applications. Previous primal-dual distributed methods are not applicable when the dual formulation is not available, e.g. the sum-of-non-convex objectives. Moreover, these algorithms and theoretical analysis are based on the fundamental assumption that the computing speeds of multiple machines in a cluster are similar. However, the straggler problem is an unavoidable practical issue in the distributed system because of the existence of slow machines. Therefore, the total computational time of the distributed optimization methods is highly dependent on the slowest machine. In this paper, we address these two issues by proposing novel distributed asynchronous dual free stochastic dual coordinate ascent algorithm for distributed data mining. Our method does not need the dual formulation of the target problem in the computation. We tackle the straggler problem through asynchronous communication and the negative effect of slow machines is significantly alleviated. We also analyze the convergence rate of our method and prove the linear convergence rate even if the individual functions in objective are non-convex. Experiments on both convex and non-convex loss functions are used to validate our statements.
源语言英语
主期刊名2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM)
出版商Institute of Electrical and Electronics Engineers Inc.
页167-176
页数10
ISBN(电子版)978-1-5386-9159-5
ISBN(印刷版)0769517544, 0769527019, 0769530192, 9780769527024, 9780769530185, 9780769530192, 9780769542560, 9781665423984, 9781665450997, 9781728183169
DOI
出版状态已出版 - 17 11月 2018

丛书

姓名IEEE International Conference on Data Mining
ISSN(印刷版)1550-4786

收录

  • CPCI-S
  • EI
  • Scopus

学术指纹

探究 'Asynchronous Dual Free Stochastic Dual Coordinate Ascent for Distributed Data Mining' 的科研主题。它们共同构成独一无二的学术指纹。

引用此