A Memristor Based Deep Learning Classification Model for Object Detection

Main Article Content

Article Sidebar

Published Sep 24, 2021
RAVIKUMAR K. I ILIGER

Abstract

A neural network's weight matrix is worked on via a number of training procedures. All weights will be changed simultaneously if neural networks are embedded in hardware. Neural networks that use CMOS technology, however, struggle with the weight-updating phase. Back propagation is a computationally intensive technique, but is nevertheless widely used in neural networks. However, it is much more difficult to implement at the circuit level due to the derived activation function and error back propagation. Memristor-based synaptic weight is regarded one of the essential components of parallel distributed processing, and it is believed to be on the same axis as neuromorphic computation. Despite this, however, the physical characteristics of memristors, such as material-related physics, have not yet been fully developed. Memristors are only one of several developments underway in the field of artificial intelligence (AI) in which CMOS-based Graphics Processing Unit, Field Programmable Gate Array, and Application Specific Integrated Circuit chips are being created for rapid computing. The use of memristor crossbar arrays to speed calculations is a potential method for implementing algorithms in deep neural networks in a more efficient manner. Initially, however, demonstrations have been constrained to simulations or small-scale issues, mainly owing to material and technology limitations that limit the size of memristor crossbar arrays that can be safely designed to remain stable is the objective of the work. The artificial intelligence consumes more data, noise generation from laptops, processor and memory bus’s performance will degrade while using for the training purpose, heating of the processor and other components, more CPU processing cycle are consumed and training time increases when the existing memory is employed for training the model. To address this problem the memristor can be employed as it not having any rotating motor for storing memory hence there will be no noise or heating effects. Before implementing the memristor based memory at circuit level the performance need to be simulated hence the proposed system simulates the memristor based neural network. The memristor-based neural network takes full use of the benefits of memristive devices, such as their low power consumption, high integration density, and great network recognition capacity. Designed the Neuromorphic network with nine layers of classification is used to classify binary images into 10 categories in this demonstration. Using the MNIST data set, the performance of the architecture is validated, and the impact of device yield and resistance fluctuations under various neuron configurations on network performance is also investigated. The findings indicate that the nine-layer network has an accuracy of about 98 percent in digits recognition. The simulation was carried out using, MemTorch, an open-source framework for customised large-scale memristive DL applications. The restive random access memory (Memristor based memory) is implemented using the memtorch in python3.7 scripting language. The results prove that, the same accuracy can be achieved while employing the existing memory device by considering the training time of less than a minute. Finally, a neuromorphic memristor based predicator is implemented and results show that it can be readily applied to the real time environment.

 

How to Cite

ILIGER, R. K. I. (2021). A Memristor Based Deep Learning Classification Model for Object Detection. SPAST Abstracts, 1(01). Retrieved from https://spast.org/techrep/article/view/1167
Abstract 223 |

Article Details

References
[1] Alexander Yu. Morozov, Karine K. Abgaryan, Dmitry L. Reviznikov, Mathematical model of a neuromorphic network based on memristive elements, Chaos, Solitons & Fractals, 10.1016/j.chaos.2020.110548, 143, (110548), (2021).
[2] Shimul Kanti Nath, Sanjoy Kumar Nandi, Thomas Ratcliff, Robert Glen Elliman, Engineering the Threshold Switching Response of Nb 2 O 5 -Based Memristors by Ti Doping , ACS Applied Materials & Interfaces, 10.1021/acsami.0c19544, 13, 2, (2845-2852), (2021).
[3] Yanan Zhong, Jianshi Tang, Xinyi Li, Bin Gao, He Qian, Huaqiang Wu, Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing, Nature Communications, 10.1038/s41467-020-20692-1, 12, 1, (2021).
[4] Jia Chen, Jiancong Li, Yi Li, Xiangshui Miao, Multiply accumulate operations in memristor crossbar arrays for analog computing, Journal of Semiconductors, 10.1088/1674-4926/42/1/013104, 42, 1, (013104), (2021).
[5] Shaoxi Wang, Zhejia Zhang, Yuxuan Xiong, Xiangqi Dong, Jian Sha, Xiaochen Bai, Wei Li, Yue Yin, Yucheng Wang, Low power consumption photoelectric coupling perovskite memristor with adjustable threshold voltage, Nanotechnology, 10.1088/1361-6528/ac0667, 32, 37, (375201), (2021).
[6] Carina Pareja-Rivera, Diego Morett, Denisse Barreiro-Argüelles, Paul Olalde-Velasco, Diego Solis-Ibarra, Lead-free halide perovskites, beyond solar cells and LEDs, Journal of Physics: Energy, 10.1088/2515-7655/ac01bf, 3, 3, (032014), (2021).
[7] Youn Jae Jeon, Haoqun An, Youngjin Kim, Young Pyo Jeon, Tae Whan Kim, Highly reliable memristive devices with synaptic behavior via facilitating ion transport of the zeolitic imidazolate framework-8 embedded into a polyvinylpyrrolidone polymer matrix, Applied Surface Science, 10.1016/j.apsusc.2021.150748, (150748), (2021).
[8] Hea-Lim Park, Tae-Woo Lee, Organic and perovskite memristors for neuromorphic computing, Organic Electronics, 10.1016/j.orgel.2021.106301, (106301), (2021).
[9] Jing-Nan Huang, He-Ming Huang, Yu Xiao, Tong Wang, Xin Guo, Memristive devices based on Cu-doped NbO films with large self-rectifying ratio, Solid State Ionics, 10.1016/j.ssi.2021.115732, 369, (115732), (2021).
[10] Giacomo Pedretti, Piergiulio Mannocci, Can Li, Zhong Sun, John Paul Strachan, Daniele Ielmini, Redundancy and Analog Slicing for Precise In-Memory Machine Learning—Part II: Applications and Benchmark, IEEE Transactions on Electron Devices, 10.1109/TED.2021.3095430, 68, 9, (4379-4383), (2021).
[11] Valerio Milo, Artem Glukhov, Eduardo Perez, Cristian Zambelli, Nicola Lepri, Mamathamba Kalishettyhalli Mahadevaiah, Emilio Perez-Bosch Quesada, Piero Olivo, Christian Wenger, Daniele Ielmini, Accurate Program/Verify Schemes of Resistive Switching Memory (RRAM) for In-Memory Neural Network Circuits, IEEE Transactions on Electron Devices, 10.1109/TED.2021.3089995, 68, 8, (3832-3837), (2021).
[12] Alexander N. BUSYGIN, Andrey N. BOBYLEV, Alexey A. GUBIN, Alexander D. PISAREV, Sergey Yu. UDOVICHENKO, NUMERICAL SIMULATION AND EXPERIMENTAL STUDY OF A HARDWARE PULSE NEURAL NETWORK WITH MEMRISTOR SYNAPSES, Tyumen State University Herald. Physical and Mathematical Modeling. Oil, Gas, Energy, 10.21684/2411-7978-2021-7-2-223-235, 7, 2, (223-235), (2021).
[13] Christos Volos, Viet-Thanh Pham, Hector Nistazakis, The fourth circuit element was found: a brief history, Mem-elements for Neuromorphic Circuits with Artificial Intelligence Applications, 10.1016/B978-0-12-821184-7.00009-8, (3-15), (2021).
[14] Summary of the Principles and Related Applications of Memristors, Applied Physics, 10.12677/APP.2021.116037, 11, 06, (311-318), (2021).
[15] Orchi Hassan, Supriyo Datta, Kerem Y. Camsari, Quantitative Evaluation of Hardware Binary Stochastic Neurons, Physical Review Applied, 10.1103/PhysRevApplied.15.064046, 15, 6, (2021).
[16] Kai Ding, Dhruv Fomra, Alexander V. Kvit, Hadis Morkoç, Nathaniel Kinsey, Ümit Özgür, Vitaliy Avrutin, A Platform for Complementary Metal‐Oxide‐Semiconductor Compatible Plasmonics: High Plasmonic Quality Titanium Nitride Thin Films on Si (001) with a MgO Interlayer, Advanced Photonics Research, 10.1002/adpr.202000210, 2, 7, (2021).
[17] Wiley Online Library
[18] Bo Kyung Park, In Chul Um, Sang M. Han, Sang Eon Han, Electrospinning to Surpass White Natural Silk in Sunlight Rejection for Radiative Cooling, Advanced Photonics Research, 10.1002/adpr.202100008, 2, 6, (2021).
[19] Wiley Online Library
[20] Shailendra K. Chaubey, Gokul M. A, Diptabrata Paul, Sunny Tiwari, Atikur Rahman, G. V. Pavan Kumar, Directional Emission from Tungsten Disulfide Monolayer Coupled to Plasmonic Nanowire‐on‐Mirror Cavity, Advanced Photonics Research, 10.1002/adpr.202100002, 2, 6, (2021).
[21] Wiley Online Library
[22] Yangho Jeong, Hyunjoon Lee, Da Gil Ryu, Seong Ho Cho, Gawon Lee, Sangbum Kim, Seyoung Kim, Yun Seog Lee, Elucidating Ionic Programming Dynamics of Metal‐Oxide Electrochemical Memory for Neuromorphic Computing, Advanced Electronic Materials, 10.1002/aelm.202100185, 7, 8, (2021).
[23] D. Ielmini, Z. Wang, Y. Liu, Brain-inspired computing via memory device physics, APL Materials, 10.1063/5.0047641, 9, 5, (050702), (2021).
[24] Yuhui He, Makusu Tsutsui, Yue Zhou, Xiang-Shui Miao, Solid-state nanopore systems: from materials to applications, NPG Asia Materials, 10.1038/s41427-021-00313-z, 13, 1, (2021).
[25] Devi, M. Sasikala, and R. Sukumar. "Metaheuristic Based Noise Identification and Image Denoising Using Adaptive Block Selection Based Filtering." Circuits and Systems 7.9 (2016): 2729-2751.
[26] Soman, Rajashree, and R. Sukumar. "Secure Storage and Sharing of Visitor Images Generated by Smart Entrance on Public Cloud." International Journal of Digital Crime and Forensics (IJDCF) 13.5 (2021): 65-77.
Section
GE1- Electronics