Amazon rolled out AI-powered video recaps back in November, to help with the fact that “sometimes we need a refresher before jumping back in” to our favorite shows. That’s especially true of any series that has a long hiatus between seasons. This “first-of-its-kind feature” was said to mark a “groundbreaking application of generative AI for streaming,” according to Gérard Medioni, vice president of technology at Prime Video. Well, apparently, it has been applied to the latest season of the hit series based on a massive video game “Fallout,” summarizing the plot of season one. It didn’t work out so well.
Everyone is already talking about “Fallout’s” upcoming season, but some of the discourse has turned sour because of that AI recap. The voice that dubbed over the replay is monotone, robotic and very obviously AI, which would be an egregious oversight on its own. However, during the recap, it also spews incorrect information, like saying certain scenes take place in 1950’s America. Which, the scene is retro-themed, sure, but the show’s timeline actually takes place in 2077. It also makes a pretty glaring mistake regarding the conclusion of the season. There’s no need to spoil it for those who haven’t watched season one yet, but if you are going by the recap alone, you’re going to be a bit confused.
Anyway, it looks like the AI recap is down for now. It originally appeared under the “Fallout” series details page when you select the second season, but it’s gone. Hopefully for good, but more than likely, it will return. Amazon did write an entire blog about its rollout demonstrating “Prime Video’s ongoing commitment to innovation and making the viewing experience more accessible and enjoyable for customers.”
How is the AI recap supposed to work?
In Amazon’s original post on the tech, it made clear that creating a recap is a “multistep process,” even for the generative AI. First, the tech is supposed to analyze a season’s “key plot points and character arcs” so that it “deeply understands the most pivotal moments.” Amazon also wants the recap to “resonate with viewers” as they get ready to watch new seasons of their favorite shows.
After analyzing, the AI finds “the most compelling clips,” and then applies audio effects, snippets of dialogue, and music, stitching them together with AI-generated narration to “deliver a theatrical-quality visual recap.” It might’ve worked for “Fallout” if the voice was a bit more enthusiastic and the details were actually correct. Amazon also used the AI-powered video recaps for other shows like “Tom Clancy’s Jack Ryan,” “Upload,” “Bosch,” and “The Rig.”
It’s part of a wider push to introduce AI solutions, including a new AI-powered dubbing feature for movies and shows that Amazon is testing. Viewers were also really unhappy with the AI dubbing, so it’s not the most well-received feature on Prime Video at this time.
