OntoChatGPT Information System: Ontology-Driven Structured Prompts for ChatGPT Meta-Learning

Authors

  • Oleksandr Palagin
  • Vladislav Kaverinskiy
  • Anna Litvin
  • Kyrylo Malakhov

DOI:

https://doi.org/10.47839/ijc.22.2.3086

Keywords:

ontology engineering, prompt engineering, prompt-based learning, meta-learning, ChatGPT, OntoChatGPT, chatbot, transdisciplinary research, ontology-driven information system, composite service

Abstract

This research presents a comprehensive methodology for utilizing an ontology-driven structured prompts system in interplay with ChatGPT, a widely used large language model (LLM). The study develops formal models, both information and functional, and establishes the methodological foundations for integrating ontology-driven prompts with ChatGPT’s meta-learning capabilities. The resulting productive triad comprises the methodological foundations, advanced information technology, and the OntoChatGPT system, which collectively enhance the effectiveness and performance of chatbot systems. The implementation of this technology is demonstrated using the Ukrainian language within the domain of rehabilitation. By applying the proposed methodology, the OntoChatGPT system effectively extracts entities from contexts, classifies them, and generates relevant responses. The study highlights the versatility of the methodology, emphasizing its applicability not only to ChatGPT but also to other chatbot systems based on LLMs, such as Google’s Bard utilizing the PaLM 2 LLM. The underlying principles of meta-learning, structured prompts, and ontology-driven information retrieval form the core of the proposed methodology, enabling their adaptation and utilization in various LLM-based systems. This versatile approach opens up new possibilities for NLP and dialogue systems, empowering developers to enhance the performance and functionality of chatbot systems across different domains and languages.

References

OpenAI, “Models - OpenAI API,” OpenAI Platform, Jun. 01, 2023. [Online]. Available at: https://platform.openai.com/docs/models/overview.

OpenAI, “Introducing ChatGPT,” Introducing ChatGPT, Nov. 30, 2022. [Online]. available at: https://openai.com/blog/chatgpt (accessed Jun. 01, 2023).

OpenAI, “GPT-4 Technical Report,” arXiv, Mar. 27, 2023. doi: 10.48550/arXiv.2303.08774.

GPT-4 Developer Livestream, (Mar. 14, 2023). Accessed: Jun. 01, 2023. [Online Video]. Available at: https://www.youtube.com/watch?v=outcGtbnMuQ

O. V. Palagin, K. S. Malakhov, V. Yu. Velychko, and T. V. Semykopna, “Hybrid e-rehabilitation services: SMART-system for remote support of rehabilitation activities and services,” Int J Telerehab, no. Special Issue: Research Status Report – Ukraine, May 2022, https://doi.org/10.5195/ijt.2022.6480.

OpenAI, “OpenAI API Reference,” OpenAI Platform, Jun. 01, 2023. [Online]. Available at: https://platform.openai.com/docs/api-reference.

JushBJJ, “JushBJJ/Mr.-Ranedeer-AI-Tutor: A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.,” GitHub, Jun. 01, 2023. [Online]. Available at: https://github.com/JushBJJ/Mr.-Ranedeer-AI-Tutor (accessed Jun. 01, 2023).

{Structured} Prompt, “Structured JSON Prompts are even better in GPT-4.,” {Structured} Prompt. [Online]. Available at: https://structuredprompt.com/structured-json-prompts-are-even-better-in-chatgpt-4/.

GPT 4 is Smarter than You Think: Introducing SmartGPT. [Online Video]. Available at: https://www.youtube.com/watch?v=wVzuvf9D9BU

JushBJJ, “Mr. Ranedeer,” JushBJJ’s Substack, May 24, 2023. [Online]. Available at: https://jushbjj.substack.com/p/mr-ranedeer (accessed Jun. 01, 2023).

K. Hebenstreit, R. Praas, L. P. Kiesewetter, and M. Samwald, “An automatically discovered chain-of-thought prompt generalizes to novel models and datasets,” arXiv, May 04, 2023. doi: 10.48550/arXiv.2305.02897.

T. Kojima, S. S. Gu, M. Reid, Y. Matsuo, and Y. Iwasawa, “Large language models are zero-shot reasoners,” arXiv, Jan. 29, 2023. doi: 10.48550/arXiv.2205.11916.

J. Wei et al., “Chain-of-thought prompting elicits reasoning in large language models,” arXiv, Jan. 10, 2023. doi: 10.48550/arXiv.2201.11903.

S. Wiegreffe, J. Hessel, S. Swayamdipta, M. Riedl, and Y. Choi, “Reframing human - AI collaboration for generating free-text explanations,” arXiv, May 04, 2022. https://doi.org/10.18653/v1/2022.naacl-main.47.

OpenAI, “ChatGPT plugins,” OpenAI blog, Mar. 23, 2023. [Online]. Available at: https://openai.com/blog/chatgpt-plugins.

OpenAI, “OpenAI plugins API,” OpenAI Platform, Jun. 01, 2023. [Online]. Available at: https://platform.openai.com/docs/plugins/introduction (accessed Jun. 01, 2023).

S. Panda and N. Kaur, “Revolutionizing language processing in libraries with SheetGPT: an integration of Google Sheet and ChatGPT plugin,” Library Hi Tech News, 2023, https://doi.org/10.1108/LHTN-03-2023-0051 .

S. R. Moghaddam and C. J. Honey, “Boosting theory-of-mind performance in large language models via prompting,” arXiv, Apr. 26, 2023. doi: 10.48550/arXiv.2304.11490.

D. Hendrycks et al., “Measuring massive multitask language understanding,” arXiv, Jan. 12, 2021. doi: 10.48550/arXiv.2009.03300.

L. C. Magister, J. Mallinson, J. Adamek, E. Malmi, and A. Severyn, “Teaching small language models to reason,” arXiv, Jun. 01, 2023. doi: 10.48550/arXiv.2212.08410.

Y. Zhou et al., “Large language models are human-level prompt engineers,” arXiv, Mar. 10, 2023. doi: 10.48550/arXiv.2211.01910.

A. Quamar, F. Özcan, D. Miller, R. J. Moore, R. Niehus, and J. Kreulen, “Conversational BI: an ontology-driven conversation system for business intelligence applications,” Proc. VLDB Endow, vol. 13, no. 12, pp. 3369–3381, 2020, https://doi.org/10.14778/3415478.3415557.

A. V. Palagin, “Architecture of ontology-controlled computer systems,” Cybern Syst Anal, vol. 42, no. 2, pp. 254–264, 2006, https://doi.org/10.1007/s10559-006-0061-z.

M. V. Bossche, P. Ross, I. MacLarty, B. V. Nuffelen, and N. Pelov, “Ontology driven software engineering for real life applications,” Proceedings of the 3rd Intl. Workshop on Semantic Web Enabled Software Engineering, 2007. [Online]. Available at: https://www.semanticscholar.org/paper/Ontology-Driven-Software-Engineering-for-Real-Life-Bossche-Ross/aabbe8ecd227bd931b44da8cea2aa8d2d1f76519

A. A. Litvin, V. Yu. Velychko, and V. V. Kaverynskyi, “Tree-based semantic analysis method for natural language phrase to formal query conversion,” RIC, vol. 57, no. 2, pp. 105–113, 2021, https://doi.org/10.15588/1607-3274-2021-2-11.

O. V. Palagin, V. Y. Velychko, K. S. Malakhov, and O. S. Shchurov, “Distributional semantic modeling: A revised technique to train term/word vector space models applying the ontology-related approach,” in CEUR Workshop Proceedings, Kyiv, Ukraine: CEUR-WS, Sep. 2020, pp. 342–353. [Online]. Available at: http://ceur-ws.org/Vol-2866/ceur_342-352palagin34.pdf

B. DuCharme, Learning SPARQL: querying and updating with SPARQL 1.1, Second edition. Sebastopol, CA: O’Reilly Media, 2013.

P. Ochieng, “PAROT: Translating natural language to SPARQL,” Expert Systems with Applications: X, vol. 5, p. 100024, 2020, https://doi.org/10.1016/j.eswax.2020.100024.

S. Shaik, P. Kanakam, S. Mahaboob Hussain, D. Suryanarayana, “Transforming natural language query to SPARQL for Semantic Information Retrieval,” International Journal of Engineering Trends and Technology - IJETT, vol. 41, no. 7, pp.; 347-350, 2016. https://doi.org/10.14445/22315381/IJETT-V41P263.

J. Lehmann and L. Bühmann, “AutoSPARQL: Let users query your knowledge base,” The Semantic Web: Research and Applications, G. Antoniou, M. Grobelnik, E. Simperl, B. Parsia, D. Plexousakis, P. De Leenheer, and J. Pan, Eds., in Lecture Notes in Computer Science. Berlin, Heidelberg: Springer, 2011, pp. 63–79. https://doi.org/10.1007/978-3-642-21034-1_5.

O. V. Palagin, V. Yu. Velychko, K. S. Malakhov, and O. S. Shchurov, “Research and development workstation environment: The new class of current research information systems,” in CEUR Workshop Proceedings, Kyiv, Ukraine: CEUR-WS, May 2018, pp. 255–269. [Online]. Available at: http://ceur-ws.org/Vol-2139/255-269.pdf

C. Petrie, A. Hochstein, and M. Genesereth, “Semantics for smart services,” in The Science of Service Systems, H. Demirkan, J. C. Spohrer, and V. Krishna, Eds., in Service Science: Research and Innovations in the Service Economy. Boston, MA: Springer US, 2011, pp. 91–105. https://doi.org/10.1007/978-1-4419-8270-4_6.

C. J. Petrie, Web Service Composition. Cham: Springer International Publishing, 2016. https://doi.org/10.1007/978-3-319-32833-1.

L. H. Etzkorn, Introduction to Middleware: Web Services, Object Components, and Cloud Computing, 1st ed. Boca Raton: Chapman and Hall/CRC, 2017. https://doi.org/10.4324/9781315118673.

S. Bhowmik, Cloud Computing, Cambridge, United Kingdom: Cambridge University Press, 2017.

Biomedical Informatics Research Group, “WebProtégé,” [Online]. Available at: https://webprotege.stanford.edu/

The Apache Software Foundation, “Apache Jena,” [Online]. Available at: https://jena.apache.org/index.html.

O. Curé and G. Blin, RDF database systems: triples storage and SPARQL query processing, First edition. Amsterdam ; Boston: Morgan Kaufmann, 2015.

OpenAI, “OpenAI API Playground,” OpenAI Platform, 2023, [Online]. Available at: https://platform.openai.com/playground.

Arysin, “LanguageTool API NLP UK” Corpus of modern Ukrainian language, 2023. [Online]. Available at: https://github.com/brown-uk/nlp_uk

B. Savani, “Bhadresh-savani/distilbert-base-uncased-emotion Hugging Face,” Huggingface. [Online]. Available at: https://huggingface.co/bhadresh-savani/distilbert-base-uncased-emotion.

M. Richards and N. Ford, Fundamentals of Software Architecture: an Engineering Approach, First edition. Sebastopol, CA: O’Reilly Media, Inc, 2020.

W. Reisig, “The Basic Concepts,” in Understanding Petri Nets: Modeling Techniques, Analysis Methods, Case Studies, W. Reisig, Ed., Berlin, Heidelberg: Springer, 2013, pp. 13–24. https://doi.org/10.1007/978-3-642-33278-4_2.

“White book on physical and rehabilitation medicine (PRM) in Europe,” European Journal of Physical and Rehabilitation Medicine, vol. 54, no. 2, pp. 156–165, 2018, https://doi.org/10.23736/S1973-9087.18.05144-4.

O. Vladymyrov, Ed., “White book on physical and rehabilitation medicine in Europe,” Ukrainian Journal of Physical and Rehabilitation Medicine, vol. 2, no. 2, 2018, (in Ukrainian) [Online]. Available at: https://www.dropbox.com/s/izsi4did76gc6y0/WB-2018-3rd-Edition-UA-fin.pdf?dl=0

WHO, “International classification of functioning, disability and health (ICF).” [Online]. Available at: https://www.who.int/standards/classifications/international-classification-of-functioning-disability-and-health

“ICF,” Ministry of Healthcare of Ukraine, (in Ukrainian), [Online]. Available at: http://moz.gov.ua/mkf.

K. S. Malakhov, “Letter to the editor – Update from Ukraine: Development of the cloud-based platform for patient-centered telerehabilitation of oncology patients with mathematical-related modeling,” Int J Telerehab, vol. 15, no. 1, 2023, https://doi.org/10.5195/ijt.2023.6562.

Downloads

Published

2023-07-02

How to Cite

Palagin, O., Kaverinskiy, V., Litvin, A., & Malakhov, K. (2023). OntoChatGPT Information System: Ontology-Driven Structured Prompts for ChatGPT Meta-Learning. International Journal of Computing, 22(2), 170-183. https://doi.org/10.47839/ijc.22.2.3086

Issue

Section

Articles