Organization of FPGA-based Devices in Distributed Systems
DOI:
https://doi.org/10.47839/ijc.22.3.3231Keywords:
FPGA, Kubernetes, k8s, CRD, custom resource definition, distributed systemsAbstract
The article proposes using Kubernetes (k8s) as a tool for managing FPGA-based devices in a distributed system. This can help automate programming, monitoring, and controlling the state of devices, and also optimize resource usage, ensure high availability and reliability, and provide security and privacy for data processed by specialized processors. The article provides a practical example of integrating an FPGA-based device into a Kubernetes cluster. It will help to scale, maintain and monitor distributed systems with millions of devices and manage such big systems from one place by using Kubernetes API. Also, it will help to integrate other third-party tools into the system, which makes it to possible to extend the systems. As a future work, the proposed approach can help integrate FPGA and its real-time reconfiguration tool into a distributed system, making it possible to control FPGA on different IoT devices. Overall, using k8s to manage FPGA-based devices can provide significant advantages in such fields as telecommunications, information technology, automation, navigation, and energy. However, the implementation may require specialized skills and experience.
References
W. Wolf, FPGA-Based System Design, Prentice-Hall PTR, USA, 2004, 576 p.
P. Käsgen, M. Messelka and M. Weinhardt, “HiPReP: High-performance reconfigurable processor – Architecture and compiler,” Proceedings of the 2021 IEEE 31st International Conference on Field-Programmable Logic and Applications (FPL), Dresden, Germany, 2021, pp. 380-381, https://doi.org/10.1109/fpl53798.2021.00074
C. Zhao, C. Xiao and Y. Liu, “A real-time reconfigurable edge computing system in industrial Internet of Things based on FPGA," Proceedings of the 2021 IEEE 16th Conference on Industrial Electronics and Applications (ICIEA), Chengdu, China, 2021, pp. 480-485. https://doi.org/10.1109/iciea51954.2021.9516225
A. Melnyk and V. Melnyk, “Remote synthesis of computer devices for FPGA-based IoT nodes,” Proceedings of the 2020 IEEE 10th International Conference on Advanced Computer Information Technologies (ACIT), Deggendorf, Germany, 2020, pp. 254-259, https://doi.org/10.1109/acit49673.2020.9208882
A. Melnyk and V. Melnyk, “Specialized processors automatic design tools – The basis of self-configurable computer and cyber-physical systems,” Proceedings of the 2019 IEEE International Conference on Advanced Trends in Information Theory (ATIT), Kyiv, Ukraine, 2019, pp. 326-331. https://doi.org/10.1109/atit49449.2019.9030481
A. Melnyk, V. Melnyk and A. Kit, “UNIX-like operating system extension for real-time FPGA-based SCCS support,” Proceedings of the 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), Bucharest, Romania, 2017, pp. 20-25, https://doi.org/10.1109/idaacs.2017.8095042
F. P. Mahimai Don Bosco, E. Chitra, and S. Ryan Ebenezer, “A survey of low-latency IoT system using FPGA accelerator,” Journal of Physics: Conference Series, vol. 1964, no. 6, p. 062014, 2021, https://doi.org/10.1088/1742-6596/1964/6/062014
A. Shrivastava, D. Haripriya, Y. D. Borole, A. Nanoty, C. Singh, and D. Chauhan, “High performance FPGA based secured hardware model for IoT devices,” International Journal of System Assurance Engineering and Management, vol. 13, no. S1, pp. 736–741, 2022, https://doi.org/10.1007/s13198-021-01605-x
“Overview,” Kubernetes. [Online]. Available at: https://kubernetes.io/docs/concepts/overview/
V. Medel, R. Tolosana-Calasanz, J. Á. Bañares, U. Arronategui, and O. F. Rana, “Characterising resource management performance in Kubernetes,” Computers & Electrical Engineering, vol. 68, pp. 286–297, 2018, https://doi.org/10.1016/j.compeleceng.2018.03.041
Z. Kang, K. An, A. Gokhale and P. Pazandak, “A comprehensive performance evaluation of different Kubernetes CNI plugins for edge-based and containerized publish/subscribe applications,” Proceedings of the 2021 IEEE International Conference on Cloud Engineering (IC2E), San Francisco, CA, USA, 2021, pp. 31-42, https://doi.org/10.1109/ic2e52221.2021.00017
J. Bartlett, “Getting started with Kubernetes,” Cloud Native Applications with Docker and Kubernetes, pp. 53–60, 2022, [Online]. Available at: https://doi.org/10.1007/978-1-4842-8876-4_6
N. Sabharwal and S. Kasiviswanathan, “Submit, orchestrate, and monitor jobs on a Kubernetes cluster,” Workload Automation Using HWA, pp. 139–144, 2022, https://doi.org/10.1007/978-1-4842-8885-6_9
R. Levensalor, “Give your edge an adrenaline boost: Using Kubernetes to orchestrate FPGAs and GPU,” CableLabs, Jan. 28, 2020. [Online]. Available at: https://www.cablelabs.com/blog/edge-adrenaline-boost-kubernetes-orchestrate-fpgas-gpu
V. Medel, R. Tolosana-Calasanz, J. Á. Bañares, U. Arronategui, and O. F. Rana, “Characterising resource management performance in Kubernetes,” Computers & Electrical Engineering, vol. 68, pp. 286–297, 2018, https://doi.org/10.1016/j.compeleceng.2018.03.041
“Overview of Cloud Native Security,” Kubernetes. [Online]. Available at: https://kubernetes.io/docs/concepts/security/overview/
X. Long, B. Liu, F. Jiang, Q. Zhang, and X. Zhi, “FPGA virtualization deployment based on Docker container technology,” Proceedings of the 2020 IEEE 5th International Conference on Mechanical, Control and Computer Engineering (ICMCCE), Harbin, China, 2020, pp. 473-476, https://doi.org/10.1109/icmcce51767.2020.00109
C. Bobda et al., “The future of FPGA acceleration in datacenters and the cloud,” ACM Transactions on Reconfigurable Technology and Systems, vol. 15, no. 3, pp. 1–42, 2022, https://doi.org/10.1145/3506713
J. Hoozemans, J. Peltenburg, F. Nonnemacher, A. Hadnagy, Z. Al-Ars, and H. P. Hofstee, “FPGA acceleration for big data analytics: Challenges and opportunities,” IEEE Circuits and Systems Magazine, vol. 21, no. 2, pp. 30–47, 2021, https://doi.org/10.1109/mcas.2021.3071608
V. Laxmi, C. S. Adiga, and S. V. Harish, “FPGA based reconfigurable computing systems: A new design approach – A review,” Advanced Materials Research, vol. 403–408, pp. 4272–4278, 2011, https://doi.org/10.4028/www.scientific.net/amr.403-408.4272
G. Stitt, F. Vahid, and S. Nematbakhsh, “Energy savings and speedups from partitioning critical software loops to hardware in embedded systems,” ACM Transactions on Embedded Computing Systems, vol. 3, no. 1, pp. 218–232, 2004, https://doi.org/10.1145/972627.972637
Z. Wang, S. Zhang, B. He, and W. Zhang, “Melia: A MapReduce framework on OpenCL-based FPGAs,” IEEE Transactions on Parallel and Distributed Systems, vol. 27, no. 12, pp. 3547–3560, 2016, https://doi.org/10.1109/tpds.2016.2537805
I. Bravo, P. Jiménez, M. Mazo, J. L. Lázaro, and E. Martín, “Architecture based on FPGA’s for real-time image processing,” Reconfigurable Computing: Architectures and Applications, 2006, pp. 152–157, https://doi.org/10.1007/11802839_21
W. Chen et al., “FPGA-based parallel implementation of SURF algorithm,” Proceedings of the 2016 IEEE 22nd International Conference on Parallel and Distributed Systems (ICPADS), Wuhan, China, 2016, pp. 308-315, https://doi.org/10.1109/icpads.2016.0049
“What is AWS IoT? - AWS IoT Core. [Online]. Available at: https://docs.aws.amazon.com/iot/latest/developerguide/what-is-aws-iot.html
“Custom Resources,” Kubernetes. [Online]. Available at: https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/
“Extend the Kubernetes API with CustomResourceDefinitions,” Kubernetes. [Online]. Available at: https://kubernetes.io/docs/tasks/extend-kubernetes/custom-resources/custom-resource-definitions/
“Operator pattern,” Kubernetes. [Online]. Available at: https://kubernetes.io/docs/concepts/extend-kubernetes/operator/
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
