Statistics Seminar Series with Sewoong Oh

Hosted by Department of Statistics

Graham Wallas Room, 5th floor Old Building


Sewoong Oh

Sewoong Oh

Assistant Professor

The first seminar in the MT 2017 Statistics Seminar Series will be with Sewooog Oh who is an Assistant Professor at University of Illinois at Urbana-Champaign. You can find details of Sewoong's talk below.

Achieving budget-optimality with adaptive schemes in crowdsourcing

Crowdsourcing platforms provide marketplaces where task requesters can pay to get labels on their data. Such markets have emerged recently as popular venues for collecting annotations that are crucial in training machine learning models in various applications. However, as jobs are tedious and payments are low, errors are common in such crowdsourced labels. A common strategy to overcome such noise in the answers is to add redundancy by getting multiple answers for each task and aggregating them using some methods such as majority voting. For such a system, there is a fundamental question of interest: how can we maximize the accuracy given a fixed budget on how many responses we can collect on the crowdsourcing system. We characterize this fundamental trade-off between the budget (how many answers the requester can collect in total) and the accuracy in the estimated labels. In particular, we ask whether adaptive task assignment schemes lead to a more efficient trade-off between the accuracy and the budget. 

Adaptive schemes, where tasks are assigned adaptively based on the data collected thus far, are widely used in practical crowdsourcing systems to efficiently use a given fixed budget. However, existing theoretical analyses of crowdsourcing systems suggest that the gain of adaptive task assignments is minimal. To bridge this gap, we investigate this question under a strictly more general probabilistic model, which has been recently introduced to model practical crowdsourced annotations. Under this generalized Dawid-Skene model, we characterize the fundamental trade-off between budget and accuracy. I will present a novel adaptive task assignment scheme that matches this fundamental limit. This allows us to quantify the fundamental gap between adaptive and non-adaptive schemes, by comparing the trade-off with the one for non-adaptive schemes. 

Take a look at Sewoong's personal webpage

Twitter and Facebook

You can get immediate notification on the availability of an event podcast by following LSE public lectures and events on Twitter, which will also inform you about the posting of transcripts and videos, the announcement of new events and other important event updates. Event updates and other information about what's happening at LSE can be found on LSE's Facebook page.

WIFI Access

LSE has now introduced wireless for guests and visitors in association with 'The Cloud', also in use at many other locations across the UK. If you are on campus visiting for the day or attending a conference or event, you can connect your device to wireless. See more information and create an account at Join the Cloud.

Visitors from other participating institutions are encouraged to use eduroam. If you are having trouble connecting to eduroam, please contact your home institution for assistance.
The Cloud is only intended for guest and visitor access to wifi. Existing LSE staff and students are encouraged to use eduroam instead.


From time to time there are changes to event details so we strongly recommend checking back on this listing on the day of the event if you plan to attend.

How can I attend? Add to calendar
This event is free to attend and no booking is necessary.  Any questions about this event please email Penelope Smith via


LSE Statistics StatsDeptLSE

Welcome to our new #Stats students! The LSE Welcome Guide shows everything you need to know about being #partofLSE


Reply Retweet Favorite

LSE Statistics StatsDeptLSE

RT @lynyrdsmyth: What is the probability #irma ventures west of all yellow lines? Never crosses I75? Misses the Fla-Geo boarder? This good…

2 weeks ago

Reply Retweet Favorite

You have succesfully subscribed
Email entered is invalid, please try again.
An error occured while subscribing, please try again.

Sign up for events news