Worker ranking determination in crowdsourcing platforms using aggregation functions

David Sánchez-Charles, Jordi Nin, Marc Solé, Victor Muntés-Mulero

Producció científica: Capítol de llibreContribució a congrés/conferènciaAvaluat per experts

13 Cites (Scopus)

Resum

The increasing adoption of crowdsourcing for commercial and industrial purposes rises the need for creating sophisticated mechanisms in crowd-based digital platforms for efficient worker management. One of the main challenges in this area is worker motivation and skill set control and its impact on the output quality. The quality delivered by the workers in the crowd depends on different aspects such as their skills, experience, commitment, etc. The lack of generic and detailed proposals to incentive workers and the need for creating ad-hoc solutions depending on the domain make it difficult to evaluate the best rewarding functions in each scenario. In this paper, we make a step further in this direction and propose the use of aggregation functions to evaluate the professional skills of crowd-workers based on the quality of their past tasks. Additionally, we present a real industrial crowdsourcing solution for software localisation in which the proposed solutions are put into practice with real text translations quality measures.

Idioma originalAnglès
Títol de la publicacióProceedings of the 2014 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE
EditorInstitute of Electrical and Electronics Engineers Inc.
Pàgines1801-1808
Nombre de pàgines8
ISBN (electrònic)9781479920723
DOIs
Estat de la publicacióPublicada - 4 de set. 2014
Publicat externament
Esdeveniment2014 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE 2014 - Beijing, China
Durada: 6 de jul. 201411 de jul. 2014

Sèrie de publicacions

NomIEEE International Conference on Fuzzy Systems
ISSN (imprès)1098-7584

Conferència

Conferència2014 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE 2014
País/TerritoriChina
CiutatBeijing
Període6/07/1411/07/14

Fingerprint

Navegar pels temes de recerca de 'Worker ranking determination in crowdsourcing platforms using aggregation functions'. Junts formen un fingerprint únic.

Com citar-ho