Distributed Deep Neural Network Training with Important Gradient Filtering, Delayed Update and Static Filtering
Abstract
References
Index Terms
- Distributed Deep Neural Network Training with Important Gradient Filtering, Delayed Update and Static Filtering
Recommendations
Sign Based Derivative Filtering for Stochastic Gradient Descent
Artificial Neural Networks and Machine Learning – ICANN 2019: Deep LearningAbstractWe study the performance of stochastic gradient descent (SGD) in deep neural network (DNN) models. We show that during a single training epoch the signs of the partial derivatives of the loss with respect to a single parameter are distributed ...
Corpus Analysis Using Relaxed Conjugate Gradient Neural Network Training Algorithm
AbstractCorpus analysis is one of the most powerful methods in text mining, data discovery, and finding relationships among documents. In linguistics, a corpus (plural corpora) is a large and structured set of texts which should to be classified by ...
Regularized Gradient Kernel Anisotropic Diffusion for Better Image Filtering
CRV '12: Proceedings of the 2012 Ninth Conference on Computer and Robot VisionThis paper proposes an extension to anisotropic diffusion filtering for a better preservation of semantically meaningful structures such as edges in an image in its smoothing/denoising process. The problem of separation of the gradients due to edges and ...
Comments
Information & Contributors
Information
Published In

In-Cooperation
- Shanghai Jiao Tong University: Shanghai Jiao Tong University
- The Hong Kong Polytechnic: The Hong Kong Polytechnic University
- University of Malaya: University of Malaya
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 60Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in