Without It, There Would Be No ImageNet... Now It's Gone
Amazon is shutting down its crowdsourcing platform, Mechanical Turk (MTurk), on September 30th, ending a 21-year run. Launched in 2005, MTurk connected businesses with a global online workforce to perform small, repetitive tasks—known as Human Intelligence Tasks (HITs)—that were easy for humans but difficult for computers at the time. At its peak, it hosted over 500,000 workers worldwide.
MTurk played a pivotal, though often unseen, role in the rise of modern AI. Its most famous contribution was to the creation of the ImageNet dataset. In the late 2000s, researcher Fei-Fei Li and her team faced the monumental challenge of manually sorting and labeling millions of internet images to build a large-scale visual database for training AI. They turned to MTurk, distributing the work to nearly 50,000 workers from 167 countries. This "human-in-the-loop" effort made the massive ImageNet project feasible.
ImageNet, in turn, became the foundational benchmark for the 2012 ImageNet Large Scale Visual Recognition Challenge. The victory of Geoffrey Hinton and his students' deep convolutional neural network, AlexNet, on this dataset dramatically demonstrated the power of deep learning, catalyzing the AI revolution that followed.
Now, MTurk is closing. The platform has declined as the very AI it helped build has become capable of automating the simple tasks it once provided. Furthermore, the AI industry's data needs have evolved, shifting towards more specialized expertise for model tuning and evaluation, served by newer platforms. Ironically, some studies suggest MTurk workers themselves began using AI tools like ChatGPT to complete tasks, adding a layer of automation to the "artificial artificial intelligence" service. The shutdown marks the end of an era where human effort, distributed globally via the internet, laid the crucial groundwork for the intelligent machines of today.
marsbit13m ago