Display options
Cite
Long C, Hua G, Kapoor A. A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing. Int J Comput Vis. 2015;116(2):136-160doi: 10.1007/s11263-015-0834-9.
Long, C., Hua, G., & Kapoor, A. (2016). A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing. International journal of computer vision, 116(2), 136-160. https://doi.org/10.1007/s11263-015-0834-9
Long, Chengjiang, et al. "A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing." International journal of computer vision vol. 116,2 (2016): 136-160. doi: https://doi.org/10.1007/s11263-015-0834-9
Long C, Hua G, Kapoor A. A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing. Int J Comput Vis. 2016 Jan 01;116(2):136-160. doi: 10.1007/s11263-015-0834-9. Epub 2015 Jun 11. PMID: 26924892; PMCID: PMC4764303.
Copy Download .nbib Format: NLM
Share it on

Int J Comput Vis. 2016 Jan 01;116(2):136-160. doi: 10.1007/s11263-015-0834-9. Epub 2015 Jun 11.

A Joint Gaussian Process Model for Active Visual Recognition with Expertise Estimation in Crowdsourcing.

International journal of computer vision

Chengjiang Long, Gang Hua, Ashish Kapoor

Affiliations

  1. Stevens Institute of Technology, Hoboken, NJ 07030, USA.
  2. Microsoft Research, Redmond, WA 98052, USA.

PMID: 26924892 PMCID: PMC4764303 DOI: 10.1007/s11263-015-0834-9

Abstract

We present a noise resilient probabilistic model for active learning of a Gaussian process classifier from crowds, i.e., a set of noisy labelers. It explicitly models both the overall label noise and the expertise level of each individual labeler with two levels of flip models. Expectation propagation is adopted for efficient approximate Bayesian inference of our probabilistic model for classification, based on which, a generalized EM algorithm is derived to estimate both the global label noise and the expertise of each individual labeler. The probabilistic nature of our model immediately allows the adoption of the prediction entropy for active selection of data samples to be labeled, and active selection of high quality labelers based on their estimated expertise to label the data. We apply the proposed model for four visual recognition tasks, i.e., object category recognition, multi-modal activity recognition, gender recognition, and fine-grained classification, on four datasets with real crowd-sourced labels from the Amazon Mechanical Turk. The experiments clearly demonstrate the efficacy of the proposed model. In addition, we extend the proposed model with the Predictive Active Set Selection Method to speed up the active learning system, whose efficacy is verified by conducting experiments on the first three datasets. The results show our extended model can not only preserve a higher accuracy, but also achieve a higher efficiency.

Keywords: Active learning; Crowdsourcing; Gaussian process classifiers

References

  1. Neural Comput. 2000 Nov;12(11):2655-84 - PubMed
  2. IEEE Trans Pattern Anal Mach Intell. 2006 Dec;28(12):1948-59 - PubMed
  3. IEEE Trans Neural Netw. 2000;11(6):1458-64 - PubMed
  4. IEEE Trans Pattern Anal Mach Intell. 2012 Oct;34(10):1978-91 - PubMed

Publication Types

Grant support