Optimizing Deep Network for Image Classification with Hyper Parameter Tuning
Munmi Gogoi1, Shahin Ara Begum2
1Munmi Gogoi, Department of Computer Science, Assam University, Silchar,Assam, India.
2Shahin Ara Begum*, Department of Computer Science, Assam University, Silchar, Assam, India.
Manuscript received on November 22, 2019. | Revised Manuscript received on December 15, 2019. | Manuscript published on December 30, 2019. | PP: 2264-2269 | Volume-9 Issue-2, December, 2019. | Retrieval Number: B3515129219/2019©BEIESP | DOI: 10.35940/ijeat.B3515.129219
Open Access | Ethics and Policies | Cite | Mendeley
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: The deep network model comprises of several processing layers and deep learning techniques help us in representing data with diverse levels of abstraction. Based on the practical importance and the efficiency of machine learning, optimization of deep models are carried out relating to the objective functions and its parameters for a particular problem. The present work focuses on an empirical analysis of the performance of stochastic optimization methods with regard to hyperparameters for the deep Convolution Neural Network (CNN) and to understand the rate of convergence of the optimization methods in high dimensional parameter spaces. Experimentation has been carried out in deep CNN model with different optimization methods viz. SGD, AdaGard, AdaDelta and Adam. The empirical results are evaluated using benchmark CIFAR10 and CIFAR100 datasets. The optimal values of the hyperparameters obtained demonstrates that the optimizer Adam shows the best results compared to other methods viz. SGD, AdaGard, and AdaDelta over the considered datasets. Further, it is noted that classification accuracy can be increased by choosing the best optimization techniques with hyperparameter tuning to get the optimal configuration of the deep CNN model.
Keywords: Optimization techniques, CNN, hyperparameter.