I recently watched Last Samurai Standing from Netflix I think, which I actually thought was pretty good, but I noticed the English dub seemed to use some kind of AI to make the character mouth movements match the English dub words.

At first it wasnt too noticeable, and I thought they had maybe filmed in English. But there was a lot of things that seemed like maybe they had some native Japanese people on the team because English speakers would have either not known about it or would feel culturally compelled to change it. Then at some point I noticed it, the mouths moving unnaturally. I think it was a close up of someone talking, but once I noticed it, it was pretty distracting.

I honestly like the idea though. It might actually be a legitimate use case for “AI,” as some people are distracted when character mouth movements don’t match the words they say, but in this case I think it is still too early for deployment. It was done well enough to pass on people that can’t see very well, but it was pretty distracting for me once I noticed it. It would be too much work to try and film all the actors saying languages they likely don’t understand to try and composite. Is it mandatory? No, but it would be nice for people that get distracted by mismatched audio.