Open Access Open Access  Restricted Access Subscription Access

REINFORCEMENT LEARNING BASED ANTI-COLLISION ALGORITHM FOR RFID SYSTEMS

Murukesan Loganathan, Thennarasan Sabapathy, Mohamed Elobaid Elshaikh, Mohamed Nasrun Osman, Rosemizi Abd Rahim, Muzammil Jusoh, Mohd Ilman Jais, Badlishah Ahmad

Abstract


Efficient collision arbitration protocol facilitates fast tag identification in radio frequency identification (RFID) systems. EPCGlobal-Class1-Generation2 (EPC-C1G2) protocol is the current standard for collision arbitration in commercial RFID systems. However, the main drawback of this protocol is that it requires excessive message exchanges between tags and the reader for its operation. This wastes energy of the already resource-constrained RFID readers. Hence, in this work, reinforcement learning based anti-collision protocol (RL-DFSA) is proposed to address the energy efficient collision arbitration problem in the RFID system. The proposed algorithm continuously learns and adapts to the changes in the environment by devising an optimal policy. The proposed RL-DFSA was evaluated through extensive simulations and compared with the variants of EPC-C1G2 algorithms that are currently being used in the commercial readers. Based on the results, it is concluded that RL-DFSA performs equal or better than EPC-C1G2 protocol in delay, throughput and time system efficiency when simulated for sparse and dense environments while requiring one order of magnitude lesser control message exchanges between the reader and the tags.

Keywords


collision avoidance; dynamic frame-slotted Aloha; EPC-C1G2; reinforcement learning; Q-learning.

Full Text:

PDF

References


K. Finkenzeller, RFID Handbook: Fundamentals and Applications in Contactless Smart Cards, Radio Frequency Identification and near-Field Communication, Third Edition. Wiley, 2010.

R. Want, “Enabling ubiquitous sensing with RFID,” Computer (Long. Beach. Calif)., vol. 37, no. 4, pp. 84–86, 2004.

S. Ahson, RFID Handbook: Applications, Technology, Security, and Privacy. 2008.

D.J. Deng and H.W. Tsao, “Optimal dynamic framed slotted ALOHA based anti-collision algorithm for RFID systems,” Wirel. Pers. Commun., vol. 59, no. 1, pp. 109–122, 2011.

C.H. Liao, T.K. Woo, C.C. Chen, and I.J. Su, “A novel grouping slotted Aloha scheme to enhance throughput performance for wireless networks,” Wirel. Pers. Commun., vol. 96, no. 1, pp. 1229–1243, 2017.

Y.I. Joo, D.H. Seo, and J.W. Kim, “An efficient anti-collision protocol for fast identification of RFID tags,” Wirel. Pers. Commun., vol. 77, no. 1, pp. 767–775, 2014.

Y. Chu, P.D. Mitchell, and D. Grace, “ALOHA and Q-Learning based medium access control for wireless sensor networks,” Proceedings of the 2012 Int. Symp. Wirel. Commun. Syst., 2012, pp. 511–515.

F.C. Schoute, “Dynamic frame length ALOHA,” IEEE Trans. Commun., vol. 31, no. 4, pp. 565–568, 1983.

EPCglobal, Specification for RFID Air Interface EPC TM Radio-Frequency Identity Protocols Class-1 Generation-2 UHF RFID, 2008.

S. Dhakal and S. Shin, “Precise-optimal frame length based collision reduction schemes for frame slotted Aloha RFID systems,” KSII Trans. Internet Inf. Syst., vol. 8, no. 1, pp. 165–182, 2014.

C. Floerkemeier, “Transmission control scheme for fast RFID object identification,” Proceedings of the Fourth Annual IEEE International Conference on Pervasive Comput. Commun. Work. PerCom Work. 2006, vol. 2006, pp. 457–462, 2006.

M.V. Bueno-Delgado and J. Vales-Alonso, “On the optimal frame-length configuration on real passive RFID systems,” J. Netw. Comput. Appl., vol. 34, no. 3, pp. 864–876, 2011.

B. Zhen, M. Kobayashi, and M. Shimizu, “Framed ALOHA for multiple RFID objects identification,” IEICE Trans. Commun., vol. E88–B, no. 3, pp. 991–999, 2005.

J.B. Eom and T.J. Lee, “Accurate tag estimation for dynamic framed-slotted ALOHA in RFID systems,” IEEE Commun. Lett., vol. 14, no. 1, pp. 60–62, 2010.

W.T. Chen, “A fast anticollision algorithm for the EPCglobal UHF class-1 generation-2 RFID standard,” IEEE Commun. Lett., vol. 18, no. 9, pp. 1519–1522, 2014.

G. Shaheen, RFID Tag Identification Protocol Implementing Threshold-Based Dynamic Framed Slotted Aloha Policy, Carleton University, 2010.

L. Matignon, G.J. Laurent, and N. Le Fort-Piat, “Reward function and initial values: Better choices for accelerated goal-directed reinforcement learning,” Artif. Neural Networks - ICANN 2006, Pt 1, vol. 4131, pp. 840–849, 2006.

L. Zhenzhen and E. Itamar, “RL-MAC: A QoS-aware reinforcement learning based MAC protocol for wireless sensor networks,” Int. J. Sens. Networks, vol. 1, no. 3, pp. 117–124, 2006.

K.-L.A. Yau, H.G. Goh, D. Chieng, and K.H. Kwong, “Application of reinforcement learning to wireless sensor networks: models and algorithms,” Computing, vol. 97, no. 11. pp. 1045-1075, 2015.

GAORFID, “Android Based UHF Gen 2 RFID Handheld Data Terminal 246029.” pp. 1–3, 2018.

Rapidradio, “UHF Handheld Reader RRUHFHH2.” pp. 1–2, 2018.

M. Ghavamzadeh, H. J. Kappen, M. G. Azar, and R. Munos, “Speedy Q-Learning,” Adv. Neural Inf. Process. Syst., pp. 2411–2419, 2011.

P. Šolić, J. Radić, and N. Rožić, “Energy efficient tag estimation method for ALOHA-Based RFID Systems,” IEEE Sens. J., vol. 14, no. 10, pp. 3637–3647, 2014.

P. Šolić, M. Šarić, and M. Stella, “RFID reader-tag communication throughput analysis using Gen2 Q-algorithm frame adaptation scheme,” Int. J. Circuits, Syst. Signal Process., vol. 8, pp. 233-239, 2014.

J. Wang, D. Wang, Y. Zhao, and T. Korhonen, “Fast anti-collision algorithms in RFID systems,” Proceedings of the Int. Conf. Mob. Ubiquitous Comput. Syst. Serv. Technol. UBICOMM 2007, pp. 75–80, 2007.

D. Klair, K. W. Chin, and R. Raad, “On the energy consumption of pure and slotted Aloha based RFID anti-collision protocols,” Comput. Commun., vol. 32, no. 5, pp. 961–973, 2009.


Refbacks

  • There are currently no refbacks.