Simulation-Based Modeling and Evaluation of Incentive Schemes in Crowdsourcing Environments

Abstract. Conventional incentive mechanisms were designed for business environments involving static business processes and a limited number of actors. They are not easily applicable to crowdsourcing and other social computing platforms, characterized by dynamic collaboration patterns and high numbers of actors, because the effects of incentives in these environments are often unforeseen and more costly than in a well-controlled environment of a traditional company.

In this paper we investigate how to design and calibrate incentive schemes for crowdsourcing processes by simulating joint effects of a combination of different participation and incentive mechanisms applied to a working crowd. More specifically, we present a simulation model of incentive schemes and evaluate it on a relevant real-world scenario. We show how the model is used to simulate different compositions of incentive mechanisms and model parameters, and how these choices influence the costs on the system provider side and the number of malicious workers.

Keywords: rewards, incentives, crowdsourcing, social computing, collective adaptive systems.


Citation: Ognjen Scekic, Christoph Dorn, Schahram Dustdar, “Simulation-Based Modeling and Evaluation of Incentive Schemes in Crowdsourcing Environments”, 21st International Conference on Cooperative Information Systems (CoopIS’13), September 11-13, 2013, Graz, Austria.


About P. Andreadis

Pre-Doctoral Research Assistant in AI and Social Computation @ University of Edinburgh.

Leave a Reply