Duolingo, primarily known for its language-learning app, is expanding into the hardware space with an electronic piano for those taking its music course. The company is also rolling out OpenAI-powered video calls to all iOS Duolingo Max subscribers and is adding more game-like "adventures" with new virtual settings to explore.
Duolingo is launching its e-piano with Loog, a musical instrument manufacturer that produces keyboards and guitars for kids. It will cost $249 and can be purchased on Duolingo's website.
The learning company is also now launching its Video Calls feature, which was beta-tested this year with some paying Duolingo Max users. Video Calls consist of a chat with the 2D Duolingo character "Lily," who has purple hair and a big personality. These conversations can be about just about anything and don't follow any strict lesson plan. Instead, they're a chance for language learners to have spontaneous conversations in real-time to improve their language production and listening skills.
Lily is essentially a fine-tuned version of ChatGPT. The chats use OpenAI's tech to power these conversations in English, French, or Spanish. Lily can remember what you've said before, as well, so you shouldn't have to repeat yourself too much when you reunite. She should be able to remember what you've said for the past few sessions, according to Zan Gilani, product manager at Duolingo.
"We tried a bunch of things in the past," Gilani tells PCMag in an interview. "With large language models, we can finally give you an experience where you can simulate a real-world conversation and actually get better because it's ultimately a muscle that you have to train."
While she's just a 2D, AI-powered character, Lily does show some basic visemes—or mouth shapes—to roughly match the words she's saying at any given time. It won't feel quite like a conversation with a real human, but it's certainly better than nothing for those looking for more real-time practice. Because Duolingo has modified its own GPT, it may feel a bit different than just talking on your own with OpenAI's chatbot.
"If she can understand what you are trying to say, she is going to roll with the punches," Gilani says of AI-powered Lily. "If we start to correct your mistakes too much in real-time, that part of your brain that is correcting yourself—that monitoring part—starts to get really active. And it takes away from just the active communication."
Duolingo's also adding more content in case you've gotten bored with its gamified, incremental learning model where you can earn XP and climb its leaderboard. Its "Adventures" are basically top-down, 2D room-like environments with interactive characters. These new settings include existing Duolingo characters, like Oscar and Lily, who will help train you up for real-world situations like ordering coffee at a cafe or getting your passport checked while traveling.
"We have some experiences which are a bit more game-like and entertaining in that way, and some which are more directly learning-oriented. But overall, we always think there is a way to do both," Gilani says. "And they don't have to contradict each other."