MOTIVATION OF PARTICIPANTS IN CROWDSOURCING PLATFORMS USING INTELLIGENT AGENTS
DOI:
https://doi.org/10.47839/ijc.19.1.1696Keywords:
http, //computingonline.net/computing/editor/submissionEditing/1697Abstract
Crowdsourcing is a model where individuals or organizations receive services from a large group of Internet users including ideas, finances, completing a complex task, etc. Several crowdsourcing websites have failed due to lack of user participation; hence, the success of crowdsourcing platforms is manifested by the mass of user participation. However, an issue of motivating users to participate in crowdsourcing platform stays challenging. We have proposed a new approach, i.e., reinforcement learning-based gamification method to motivate users. Gamification has been a practical approach to engaging users in many fields, but still, it needs an improvement in the Crowdsourcing platform. In this paper, the gamification approach is strengthened by a reinforcement learning algorithm. We have created an intelligent agent using the Reinforcement learning algorithm (Q-learning). This agent suggests an optimal action plan that yields maximum reward points to the users for their active participation in the Crowdsourcing application. Also, its performance is compared with the SARSA algorithm (On- policy learning), which is another Reinforcement learning algorithm.References
Z. Zeng, J. Tang, T. Wang, “Motivation mechanism of gamification in crowdsourcing projects,” International Journal of Crowd Science, vol. 1, issue 1, pp. 71-82, 2017.
N. Kaufmann, T. Schulze, D. Veit, “More than fun and money. Worker motivation in crowdsourcing – A study on mechanical Turk,” Proceedings of the Americas Conference on Information Systems (AMCIS), Detroit, Michigan, 4-8 August 2011, pp. 1-11.
J. Nielsen, “The 90-9-1 rule for participation in social media and online communities,” in: N/Ng Nilsen Normal Group Articles, Oct 8, 2006.
J. Goncalves, S. Hosio, D. Ferreira, V. Kostakos, “Game of words, tagging places through crowdsourcing on public displays,” Proceedings of Designing Interactive systems (DIS), Vancouver, BC, Canada, 21-25 June 2014, pp. 705-714.
D. Difallah, E. Filatova, P. Ipeirotis, “Demographics and dynamics of mechanical Turk workers,” Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining WSDM’2018, USA, February 5–9, 2018, pp.135-143.
R. M. Ryan, E.L. Deci, “Intrinsic and extrinsic motivations: Classic definition and new directions,” Contemporary Educational Psychology, vol. 25, issue 1, pp. 54-67, 2000.
J. Rogstadius, V. Kostakos, A. Kittur, B. Smus, J. Laredo and M. Vukovic, “An assessment of intrinsic and extrinsic motivation on task performance in crowdsourcing markets,” Proceedings of the Fifth International Conference on Weblogs and Social Media, Barcelona, Catalonia, Spain, July 17-21, 2011, pp. 321-328.
D.C. Brabham, “Crowdsourcing as a model for problem solving: An introduction and cases Convergence,” The International Journal of Research into New Media Technologies, vol. 14, issue 1, pp. 75-90, 2008.
Yu Zhang, Michaela Vander Schaar, “Reputation-based incentive protocols in crowdsourcing applications,” Proceedings of the IEEE INFOCOM, 2012, pp. 2140-2148.
B. A. Hennessey, “The social psychology of creativity,” Scandinavian Journal of Educational Research, vol. 47, issue 3, pp. 253-271, 2010.
A. Etzoni, Modern Organizations, Eaglewood Cliffs, NJ-Prentice Hall, 1964, 120 p.
R. S. Alsawaier, “The effect of gamification on motivation and engagement,” International Journal of Information and Learning Technology, vol. 35, issue1, pp. 56-79, 2018.
O. Feyisetan, E. Simperl, M.V. Kleek, N. Shadbolt, “Improving paid micro tasks through gamification and adaptive furtherance incentives,” Proceedings of the 24th International Conference on World Wide Web, Florence, Italy, May18-22, 2015, pp. 333-343.
C. Fickhoff, C.G. Harris, A.P de Vries and S. Padmini, “Quality through flow and immersion gamifying crowdsourced relevance assessments,” Proceedings of the 35th international ACM SIGIR Conference on Research and Development in Information Retrieval, Portland, Oregon, 2012, pp. 871-880.
A. Bowser, D.L. Hansen, Y. He, C. Boston, M. Reid, L. Gunnell, J. Preece, “Using gamification to inspire new citizen science volunteers,” Proceedings of the International Conference on Gamified Design, Research and Applications, Toronto, Ontario, Canada, October 2-4, 2013, pp. 18-25.
R. Smith, L.A. Kilty, “Crowdsourcing and gamification of enterprise meeting software quality,” Proceedings of the 7th International Conference on Utility and Cloud Computing (UCC), London, 2014, pp. 611-613.
R. Snijders, F. Dalpiaz, M. Hosseini, A. Shahri, R. Ali, “Crowd-centric requirements engineering,” Proceedings of the IEEE/ACM 7th International Conference on Utility and Cloud Computing, London, 8-11 Dec 2014, pp. 614-615.
S. Malatini, L.C. Klopfenstein and A. Bogliolo, “Gamification for crowdsourced data collection in mobile usability field studies,” Proceedings of the 12th Biannual Conference on Italian, Italy, Sep 18-20, 2017, pp. 1-10.
P. Ipeirotis and E. Gabrilovich, “Quizz: targeted crowdsourcing with a billion (potential) users,” Proceedings of the 23rd International Conference on World Wide Web (WWW), Seoul, Korea, 2014, pp. 143-154.
B. Morschheuser, J. Hamari, J. Koivisto, “Gamification in crowdsourcing: a review, system sciences (HICSS),” Proceedings of the 49th Hawaii International Conference, Kauai, Hawaii, USA, 2016, pp. 4375-4384.
J. Brito, V. Vieira and A. Duran, “Towards a framework for gamification design on crowdsourcing systems: The G.A.M.E. approach,” Proceedings of the 12th International Conference on Information Technology – New Generations, Las Vegas, NV, 2015, pp. 445-450.
T. Xie, J. Bishop, R. Nigel Horspool, N. Tillman, J. de Halleux, “Crowd sourcing code and process via code hunt,” Proceedings of the Crowdsourcing in Software Engineering, Florence, Italy, May 16-24, 2015, pp.15-16.
Z. Hu, Y. Liang, J. Zhang, Z. Li, and Y. Liu, “Inference aided reinforcement learning for incentive mechanism design in crowdsourcing,” Proceedings of the 32nd International Conference on Neural Information Processing System, Canada, Dec 2018, pp. 5512-5522.
L. Cui, X. Zhao, L. Liu, H. Yu, Yu. Miao, “Complex crowdsourcing task allocation strategies employing supervised and reinforcement learning,” International Journal of Crowd Science, vol. 1, pp. 146-160, 2017.
R. Qiao, S. Yan and B. Shen, “A reinforcement learning solution to cold-start problem in software crowdsourcing recommendations,” Proceedings of the IEEE International Conference on Progress in Informatics and Computing (PIC), Suzhou, China, 2018, pp. 8-14.
J. Thangarajah, K. Tuyls, C. Jonker, S. Marsella, “Optimal testing for crowd workers,” Proceedings of the 15th International Conference on Autonomous Agents and Multi Agent Systems, Singapore, May 2016, pp. 966-974.
N. Siddique, P. Dhakan, I, Rano, K. Kasmarik, “A review of the relationship between novelty, intrinsic motivation and reinforcement learning,” Journal of Behavioral Robotics, vol. 8, pp. 58-69, 2017.
E. L. Thorndike, “Laws and hypotheses for behavior,” in E. L. Thorndike, Animal Intelligence, Darien, CT: Hafner Publishing Co, 1970, pp. 241-281.
P. Redgrave, K. Gurney, “The short-latency dopamine signal: A role in discovering novel actions,” Nature Review, Neuroscience, vol. 7, pp. 967-975, 2006.
P.Y. Oudeyer, F. Kaplan, “What is intrinsic motivation? A typology of computational approaches,” Frontiers in Neuro Robotics, vol. 1, issue 6, pp. 1-14, 2007.
M. Schembri, M. Mirolli, G. Baldassarre, “Evolving internal reinforcers for an intrinsically motivated reinforcement-learning robot,” Proceedings of the 6th IEEE International Conference on Development and Learning, 2007, pp. 282-287.
J. Schmidhuber, “Formal theory of creativity, fun, and intrinsic motivation (1990–2010),” IEEE Transactions on Autonomous Mental Development, vol. 2, no. 3, pp. 230-247, Sept. 2010.
P.Y. Oudeyer, F. Kaplan, V. V. Hafner, “Intrinsic motivation systems for autonomous mental development,” IEEE Trans. Evolutionary Computation, Vol. 11, issue 2, pp. 265-286, 2007.
S. Deterding, D. Dixon, R. Khaled, L. Nacke, “From game design elements to gamefulness: Defining gamification,” Proceedings of the 15th International Academic Mind Trek Conference: Envisioning Future Media Environments, Tampere, Finland, Sep. 28-30, 2011, pp. 9-15.
K. Werbach, D. Hunter, For the Win: How Game Thinking Can Revolutionize Your Business, Philadelphia: Persus Distribution Services, 2012.
C.C. White, D.J. White, “Markov decision processes,” European Journal of Operational Research, vol. 39, issue 1, pp. 1-16, 1989.
V. Heidrich-Meisner, M. Lauer, C. Igel, M. Riedmiller, “Reinforcement learning in a nutshell,” Proceedings of European Symposium on Artificial Neural Networks, Bruges, Belgium, April 25-27, 2007, pp. 277-288.
J.C.H Watkins, “Technical note: Qlearning,” Machine Learning, vol. 8, pp. 279-292, 1992.
V. Kuleshov, D. Precup, “Algorithm for the multi armed bandit problem,” Journal of Machine Learning Research, vol. 1, pp. 1-48, 2000.
H. Lima, Y. Kuroe, “Swarm reinforcement learning algorithms based on Sarsa method,” Proceedings of the SICE Annual Conference, Tokyo, 2008, pp. 2045-2049.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
