Professional Documents
Culture Documents
Dulingo Quora
Dulingo Quora
I'm pretty happy that the data shows Duolingo is effective, but I'd say we can be way more effective,
and we'll continue working on the product until we run out of energy :)
We know personalized one-to-one tutors produce significantly better outcomes than classroom
lectures. One of the most famous results in educational psychology is “Bloom’s 2 Sigma Problem,”
which shows that the average student tutored one-to-one performs two standard deviations better than
students who learn via conventional classroom methods – that is, they perform better than 98% of the
students in the control class! And this makes sense: teachers typically aim the lecture at some sort of
“median student,” which means that those above the median are not learning very efficiently, and those
below are often confused.
Instead of making crappy recordings of something known to be suboptimal, we should be scaling and
automating the best known teaching method: one-to-one tutors. This is what we’re trying to do with
Duolingo by attributing the following 3 characteristics to our teaching method:
- Active, not passive. Instead of falling asleep while listening to a monotone lecture, Duolingo users
learn by doing. Daydreaming is impossible in a context where you’re required to interact to move
forward.
- Personalized. Because users learn by answering exercises every step of the way, we get a signal
about how well they’re learning. For example, we can tell if somebody always messes up verb
conjugations in the past tense, if they can read but not understand the spoken language, or even if
every time they see the word for “chicken” they take an extra 500 milliseconds to answer. We use
all of this information (from more than 6 billion exercises per month) to generate unique lessons
for each user.
- Fun. Duolingo was designed to feel like a game from the very start. Students have to pass levels
in order to unlock new skills, they can earn virtual currency to “buy” virtual goods, etc. MOOCs
typically have horrible retention rates, whereas Duolingo doesn’t, and it’s largely because people
like playing games.
Even though Duolingo only teaches one subject (foreign languages), it has more active users than all
the major MOOC platforms combined – and they teach hundreds of subjects!
10. What are Luis Von Ahn's future plans for Duolingo? In the short term, we’re working on a really cool
way to teach conversation in other languages. I can’t mention too many details, but we’re very excited
about it.
We’re also working on bringing Duolingo to schools. We’ve met a number of inspiring teachers
looking to make a difference in their students’ lives and have seen the effect that Duolingo can have
as a classroom tool. We created Duolingo for Schools last year and already 100,000 classrooms are
using it – without any paid marketing, just word of mouth. The feedback we’ve gotten is inspiring,
and we’re developing progressively more tools to help teachers reach their goals.
In the longer term, we want everybody to have access to all types of education of the highest quality.
We started with languages, but we won’t stop there.
The educational system throughout the world is pretty broken. For example, in my country, Guatemala,
only 24% of the people who graduate from high school have the required reading and writing level,
and only 7% have the required math level. On top of that only about 60% of the people actually
graduate high school. And even in countries like the US, after learning math five days a week for
almost twelve years, the most advanced thing most high school graduates can do is to add fractions.
We think we can help by developing intelligent apps that teach the most important subjects: reading
and writing, math, physics, etc. What’s particularly exciting is that for the first time in history, we can
observe how millions of people learn and improve based on this data – this was impossible until very
recently. So while there are conflicting theories about how to teach something better – what to
introduce first, how to broach a particular topic, etc. – we can actually test these theories at a large
scale and help people learn more information in less time. And just as importantly, for the first time
we can offer access to education in a medium that can reach billions of people at relatively little cost
(smartphones).
11. Why did Duolingo move from translation to certification for monetizing?
Initially, our business model was based on crowdsourcing. Companies such as Buzzfeed and CNN
uploaded news stories that users then had the option of translating as a way to strengthen the skills
they learned on Duolingo. We would then return the translated documents to e.g. CNN, and they’d
pay us for having translated their content (here’s my TED talk (
http://www.ted.com/talks/luis_von_ahn_massive_scale_online_collaboration?language=en ) on this
idea).
It was very clever, but since then, we’ve decided not to scale the translations business further. The
main reason is that our aim is to be an education, not a translations company, and we realized that if
we kept going in the direction we were going in, we’d eventually morph into a translations company
because that’s where the funds were coming from.
Therefore, we decided to develop a profitable product that was far more in line with our mission:
English language certification. During the first couple of years of Duolingo, thousands of users wrote
to us saying they were thankful for the opportunity to learn English for free, but that to prove that they
speak English they had to take a standardized test like the TOEFL or IELTS. These tests are required
to be accepted to universities, or to get jobs at international corporations in non-English-speaking
countries. The tests are unfortunately extremely expensive (about $200-$250, or the equivalent of a
month's salary in many developing countries) and require commuting to inconvenient locations (for
testing centers), as well as waiting for weeks or months for results.
We launched the Duolingo Test Center in response to this, a way for anyone to certify language
proficiency from anywhere, and for only $20. The test only takes 20 minutes and is available on the
web, Android, and iOS. To prevent cheating, since we don’t require people to go to a testing center,
the Duolingo test is remotely proctored – we record the test taking experience by accessing the device's
camera, microphone and screen during the test.
The Duolingo English Test is increasingly accepted by prestigious universities and companies around
the world, including some departments of Harvard, Carnegie Mellon, the Max Planck Institute in
Germany, and Uber (for drivers in other countries to prove they can speak English).
12. What made Luis Von Ahn start Duolingo?
The whole thing started as an academic project at Carnegie Mellon between me and my PhD student
Severin Hacker. I had just sold my second company to Google, and we both wanted to work on
something related to education. Education is very general, so we decided to concentrate on one kind
that is in huge demand everywhere (except the US): language education.
It turns out there are over 1.2 billion people learning a new language around the world. Now, the
majority of these people, like 800 million of them, are learning English, and don’t have very much
money. In fact, the reason they are learning a language is to be able to get a better job, or a job at all.
The majority are not learning French because they want to get ready for a trip to Paris over the summer.
They’re learning a language to get a job at a call center.
Here’s the crazy part about this. There’s a huge number of people that want to learn English, and most
of them can’t pay, but the ways to learn a new language typically require them paying, because
somebody has to make money. It’s either that you learn a language in middle or high school, which
means you're pretty wealthy because you go to a school that offers foreign languages; or you learn it
in college or adult classes, in which case you’re also pretty wealthy because you can pay for those; or
you buy some sort of software like Rosetta Stone or Open English, in which case you have $1,000 to
spare.
So, the largest part of the market was not being addressed because there was no great way to make
money from them. Most people who wanted to learn a language couldn't really afford the best ways
of doing it. We wanted to have a way to teach people languages for free. But not just free.
We wanted to have the best quality of language education, and offer it for free.
13. What are Duolingo's potential competitors according to Luis Von Ahn?
There are a number of language learning apps, but none that I am particularly worried about. Last time
we checked, we had about 10x more active users than our biggest competitor. But it’s not just because
we’re much bigger in terms of users that I’m not worried about them. Most of our competitors (Rosetta
Stone, etc.) have turned into marketing companies by now. Their business model is to charge users a
lot of money for their software, and because they charge so much, they also have to spend a lot on
marketing and advertising to acquire users. At that point, if you have a dollar to spend, it’s much better
to spend it on marketing than on making a better product. So, most of these companies spend 80% of
their budget on marketing and are usually not improving their product very much.
My main worry is a competitor we haven’t yet heard about, that somehow figures out how to truly
teach better than us. This is why we have a team whose sole purpose is to come up with the app that
will disrupt Duolingo in terms of language learning.
14. What was Duolingo's initial marketing strategy?
Before we launched, we had a pretty cool splash page where people could sign up to be invited to the
private beta. The splash page had a very clear message: unlike other language-learning software that
costs hundreds of dollars, Duolingo would be 100% free and therefore accessible to everybody.
At around that time I gave a TED talk about the Duolingo idea, which was viewed by over a million
people. This got more than 300,000 people to sign up for our private beta.
After our public launch in 2012, our main marketing approaches have been word of mouth and PR.
By now, we’ve been written up in virtually every major newspaper in the world.
Another challenge was being able to offer more than just a handful of languages with such a small
team. The answer was creating the Duolingo Language Incubator, a platform that allows volunteers
to collaborate to create language courses online.
We also knew teachers were reluctant to adopt many technologies into the classroom because the
vast majority are not very effective, students get distracted, and some teachers fear being replaced.
Introducing Duolingo for Schools was a challenge for this reason, but the reception and feedback
have been better than we ever expected and now we’re really enjoying helping teachers engage their
students effectively.
25. Why aren't there more rare languages on Duolingo? We have limited resources in terms of people
and time so we are forced to prioritize – and there are many languages out there! Unfortunately, not
that many people want to learn rare languages, as important as they may be. We do teach Esperanto,
Catalán, Irish, and soon Welsh and Yiddish.
26. What is your vision for an ideal language learning experience? A one-to-one human tutor that
understands you, your learning patterns and needs, and that you can access anywhere and at any
time.
27. Is it possible that Duolingo adds video clips of real native speakers for speaking exercises? Does
Duolingo intend to diversify the exercises? Yes, this is a strong possibility. We discuss different ideas
and features regularly at Duolingo and have a long list of things to test. This is one of them :)
28. Is it possible to get the progress bar back in Duolingo? It may come back at some point. We do A/B
tests and usually choose whatever helps keep people motivated to learn more, or whatever helps
people acquire more knowledge in less time. Sometimes results are counterintuitive but our
decisions are rarely based on opinion.
29. What does Luis Von Ahn have in mind after Duolingo? Potentially in parallel? One day, when Duolingo
has taken over all of education worldwide, my plan is to start brainwashing children into working for
me for free. After that I should be set.
30. What would Luis Von Ahn recommend smaller language sites who find it difficult to compete with
his free offer? Work on something else. Resistance is futile. :)
31. How did Luis Von Ahn get to product market fit with Duolingo? Did he run experiments? What were
his early market discoveries?
Before we launched, we tested Duolingo with random people outside of our office. The first test we
did was awful, but we kept going. We made changes based on every stranger that had trouble, and
by the time we had done about 25 tests, it was pretty good. After we launched, we have A/B tested
hundreds of features in order to increase user engagement. We don’t do much market research
(thought we probably should!).
32. What has been one of your greatest teaching experiences?
I really enjoyed teaching 15-251, “Great Theoretical ideas in Computer Science.” It was usually taken
by 200 students every semester, and was usually the hard class they’d ever taken in their lives. As
such, I enjoyed being machiavelically evil. Here’s an actual student evaluation that captures what the
class was like:
When you dedicate so much time, and so much of your grade, to a single class, working on a single
assignment, all to appease some diabolically cruel professor, you stop thinking clearly. You become
paranoid. Von Ahn has become something like Big Brother among us students. We are wary of doing
anything which might even slightly contradict the rules. We are --sometimes literally -- constantly
looking over our shoulders with paranoid delusions that Von Ahn could be lurking behind every
proverbial corner. This may be the image that Von Ahn wants to convey, and it may be necessary to
*control* the behavior of his students and ensure that they do not cheat; but I was always taught
that it is often ethically superior to be *respected* rather than *feared*; though it is probably
pragmatically superior on Von Ahn's part to be *both* respected and feared. I do respect him. But
Jesus do I fear him.