1 / 73

CAPTCHA, THE ESP GAME, AND OTHER STUFF

LUIS VON AHN. CAPTCHA, THE ESP GAME, AND OTHER STUFF. CARNEGIE MELLON UNIVERSITY. CAPTCHA. A PROGRAM THAT CAN TELL WHETHER ITS USER IS A HUMAN OR A COMPUTER. CAPTCHA. A PROGRAM THAT CAN GENERATE AND GRADE TESTS THAT:. A. MOST HUMANS CAN PASS B. CURRENT COMPUTER PROGRAMS CANNOT PASS.

vartan
Download Presentation

CAPTCHA, THE ESP GAME, AND OTHER STUFF

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LUIS VON AHN CAPTCHA, THE ESP GAME, AND OTHER STUFF CARNEGIE MELLON UNIVERSITY

  2. CAPTCHA A PROGRAM THAT CAN TELL WHETHER ITS USER IS A HUMAN OR A COMPUTER

  3. CAPTCHA A PROGRAM THAT CAN GENERATE AND GRADE TESTS THAT: A. MOST HUMANS CAN PASS B. CURRENT COMPUTER PROGRAMS CANNOT PASS

  4. PICKS RANDOM STRING OF LETTERS RENDERS IT INTOA DISTORTED IMAGE oamg EXAMPLE

  5. …AND GENERATES A TEST: TYPE THE CHARACTERS THAT APPEAR IN THE IMAGE

  6. P STANDS FOR PUBLIC ALL CODE AND DATA USED BY A CAPTCHA SHOULD BE PUBLICLY AVAILABLE

  7. COMPLETELY AUTOMATED PUBLIC TURING TEST TO TELL COMPUTERS AND HUMANS APART

  8. UTILIZING THE POWER OF HUMAN CYCLES CAPTCHA APPLICATIONS EXAMPLES DIRTY HACKS THE ESP GAME OTHER STUFF

  9. APPLICATIONS OF CAPTCHAS

  10. QUICKVOTE Which is the best Computer Science Grad School in the US? Berkeley MIT CMU Princeton Cornell Stanford vote (FROM WWW.SLASHDOT.ORG)

  11. APPLICATIONS FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02)

  12. APPLICATIONS FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02)

  13. APPLICATIONS FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02)

  14. APPLICATIONS FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02)

  15. EXAMPLES OF CAPTCHAS

  16. PIX WHAT ARE THESE PICTURES OF?

  17. PIX WHAT ARE THESE PICTURES OF? THE IMAGES NEED TO BE RANDOMLY DISTORTED

  18. PIX WHAT ARE THESE PICTURES OF? THE IMAGES NEED TO BE RANDOMLY DISTORTED

  19. PIX WHAT ARE THESE PICTURES OF? THE IMAGES NEED TO BE RANDOMLY DISTORTED

  20. WHAT ARE THESE PICTURES OF?

  21. BONGO VISUAL ANALOGY PROBLEMS (BONGARD 1951)

  22. SOUND-BASED CAPTCHA HUMANS ARE BETTER THAN COMPUTERS AT UNDERSTANDING SPOKEN LANGUAGE

  23. OPEN PROBLEM CREATE A CAPTCHA BASED ON LANGUAGE UNDERSTANDING

  24. DIRTY HACKS

  25. CAPTCHA SWEAT SHOPS SPAM COMPANIES HIRE HUMANS TO SOLVE CAPTCHAS ALL DAY LONG $2.50 PER HOUR FOR EACH HUMAN 720 CAPTCHAS PER HOUR PER HUMAN 1/3 CENT PER ACCOUNT

  26. Free Nude Photos > NEXT

  27. Free Nude Photos Type the word in the box if you want to see the next picture

  28. UTILIZING THE POWER OF HUMAN CYCLES CAPTCHA APPLICATIONS EXAMPLES DIRTY HACKS THE ESP GAME OTHER STUFF

  29. MARTHA STEWART FLOWERS SUPER EVIL LABELING IMAGES WITH WORDS STILL AN OPEN PROBLEM

  30. USES FILENAMES AND HTML TEXT IMAGE SEARCH ON THE WEB

  31. REASON: MOST IMAGES DON’T HAVE PROPER CAPTIONS ACCESSIBILITY LESS THAN 10% OF THE WEB IS ACCESSIBLE TO THE VISUALLY IMPAIRED

  32. DESIDERATA A METHOD THAT CAN LABEL ALL IMAGES ON THE WEB FAST AND CHEAP

  33. USING HUMANS CLEVERLY THE ESP GAME COULD LABEL ALL IMAGES ON THE WEB IN 30 DAYS! THE ESP GAME

  34. THE ESP GAME TWO-PLAYER ONLINE GAME PARTNERS DON’T KNOW EACH OTHER AND CAN’T COMMUNICATE OBJECT OF THE GAME: TYPE THE SAME WORD THE ONLY THING IN COMMON IS AN IMAGE

  35. GUESSING: CAR GUESSING: BOY GUESSING: CAR GUESSING: HAT GUESSING: KID SUCCESS! YOU AGREE ON CAR SUCCESS! YOU AGREE ON CAR THE ESP GAME PLAYER 1 PLAYER 2

  36. © 2004 Carnegie Mellon University, all rights reserved. Patent Pending.

  37. THE ESP GAME IS FUN 4.1 MILLION LABELS WITH 23,000 PLAYERS THERE ARE MANY PEOPLE THAT PLAY OVER 20 HOURS A WEEK

  38. LABELING THE ENTIRE WEB 5000 PEOPLE PLAYING SIMULTANEOUSLY CAN LABEL ALL IMAGES ON GOOGLE IN 30 DAYS! INDIVIDUAL GAMES IN YAHOO! AND MSN AVERAGE OVER 5,000 PLAYERS AT A TIME

  39. A FEW MILLION LABELS CAN IMPROVE IMAGE SEARCH CAN BE USED TO IMPROVE COMPUTER VISION

  40. WE EMULATE PARTNER BY PLAYING PRE- RECORDED MOVES SINGLE PLAYER GAME A SINGLE PERSON CAN PLAY WITH PRE-RECORDED ACTIONS AS THEIR PARTNER (0:12) CAR (0:15) HAT (0:21) KID (0:08) BOY (0:23) CAR NOTICE THAT THIS DOESN’T STOP THE LABELING PROCESS! WHEN 2 PEOPLE PLAY, WE RECORD EVERY ACTION WITH TIMING INFORMATION

  41. WHAT ABOUT CHEATING? IF A PAIR PLAYS TOO FAST, WE DON’T RECORD THE WORDS THEY AGREE ON

  42. WE GIVE PLAYERS TEST IMAGES FOR WHICH WE KNOW ALL THE COMMON LABELS: WE ONLY STORE A PLAYER’S GUESSES IF THEY SUCCESSFULLY LABEL THE TEST IMAGES WHAT ABOUT CHEATING?

  43. SEARCH RESULTS

  44. BEACHCHAIRSSEAPEOPLEMAN WOMANPLANTOCEAN TALKINGWATERPORCH SAMPLE LABELS

  45. SADDAM MR. WILSON MAN FACE MOUSTACHE COMING SOON: MEET YOUR SOUL MATE THROUGH THE GAME! BUSH PRESIDENT DUMB YUCK YUCK SAMPLE LABELS

  46. WHY DO PEOPLE LIKE THE ESP GAME?

  47. “ THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. ON THE OTHER HAND, THE TWO OF YOU ARE BRINGING YOUR MINDS TOGETHER IN A WAY THAT LOVERS WOULD ENVY. THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ” THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS.

  48. “ ” IT’S FAST-PACED “ ” HELPS ME LEARN ENGLISH “ ” STRANGELY ADDICTIVE “ IT’S SO MUCH FUN TRYNG TO GUESS WHAT OTHERS THINK. YOU HAVE TO STEP OUTSIDE OF YOURSELF TO MATCH ”

More Related