Edge-Optimized Incremental Learning in Deep Neural Networks for Human-Centric Applications

Prof. Tsung-Han Tsai, Department of Electrical Engineering, National Central University, TW

Abstract

Incremental learning techniques aim to increase the capability of Deep Neural Network (DNN) model to add new classes in the pre-trained model. However, DNNs suffer from catastrophic forgetting during the incremental learning process. Existing incremental learning techniques try to reduce the effect of catastrophic forgetting by either using previous samples of data while adding new classes in the model or designing complex model architectures. This leads to high design complexity and memory requirements, which make incremental learning impossible to implement on the edge devices, which have limited memory and computation resources. The application of incremental learning is very extensive, particularly in machine vision tasks such as object recognition, gesture recognition, and human pose estimation.

Contact information

http://www.ee.ncu.edu.tw/~han [1]

Email: hanee [dot] ncu [dot] edu [dot] tw