Phocas: dimensional Byzantine-resilient stochastic gradient descent

📝 Original Info

• Title: Phocas: dimensional Byzantine-resilient stochastic gradient descent
• ArXiv ID: 1805.09682
• Date: 2018-05-25
• Authors: Cong Xie, Oluwasanmi Koyejo, Indranil Gupta

📝 Abstract

We propose a novel robust aggregation rule for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the workers in the parameter server~(PS) architecture. We prove the Byzantine resilience of the proposed aggregation rules. Empirical analysis shows that the proposed techniques outperform current approaches for realistic use cases and Byzantine attack scenarios.

📄 Full Content

Reference