A Hybrid Optimization Algorithm for Learning Deep Models
- سال انتشار: 1397
- محل انتشار: مجله پیشرفت در تحقیقات کامپیوتری، دوره: 9، شماره: 4
- کد COI اختصاصی: JR_JACR-9-4_004
- زبان مقاله: انگلیسی
- تعداد مشاهده: 390
نویسندگان
Department of Computer Engineering, Rasht Branch, Islamic Azad University, Rasht, Iran
Department of Computer Engineering, Faculty of Engineering, University of Guilan, Rasht, Iran
Department of Computer Engineering, Rasht Branch, Islamic Azad University, Rasht, Iran
چکیده
Deep learning is one of the subsets of machine learning that is widely used in Artificial Intelligence (AI) field such as natural language processing and machine vision. The learning algorithms require optimization in multiple aspects. Generally, model-based inferences need to solve an optimized problem. In deep learning, the most important problem that can be solved by optimization is neural network training, but training a neural network can involve thousands of computers for months. In the present study, basic optimization algorithms in deep learning were evaluated. First, a performance criterion was defined based on a training dataset, which makes an objective function along with an adjustment phrase. In the optimization process, a performance criterion provides the least value for objective function. Finally, in the present study, in order to evaluate the performance of different optimization algorithms, recent algorithms for training neural networks were compared for the segmentation of brain images. The results showed that the proposed hybrid optimization algorithm performed better than the other tested methods because of its hierarchical and deeper extraction.کلیدواژه ها
Deep Learning, Optimization Algorithms, Stochastic Gradient Descent, Momentum, Nestrove, Adamاطلاعات بیشتر در مورد COI
COI مخفف عبارت CIVILICA Object Identifier به معنی شناسه سیویلیکا برای اسناد است. COI کدی است که مطابق محل انتشار، به مقالات کنفرانسها و ژورنالهای داخل کشور به هنگام نمایه سازی بر روی پایگاه استنادی سیویلیکا اختصاص می یابد.
کد COI به مفهوم کد ملی اسناد نمایه شده در سیویلیکا است و کدی یکتا و ثابت است و به همین دلیل همواره قابلیت استناد و پیگیری دارد.