In the first installment of this article series, Our Future World, I discussed how entertainment may tell us a lot about what may unfold for us technologically and I mentioned several pieces of work as examples. In this article I want to explore something that’s actually available now but was already being explored through entertainment.
In the first article I specifically mentioned a 2014 stage play later adapted to film, Marjorie Prime, in which people can feed the memories of a deceased partner into a holographic AI companion to preserve the relationship and mitigate the pain of loss, and they can choose the age at which they want their partner represented. A Prime is a sophisticated AI program which learns and adapts from human interactions. [1] I also mentioned an Amazon Prime television series called Upload released in 2020 which ran for four seasons, and in the show people can upload their consciousness immediately after death into a virtual afterlife. Living people can access this world and continue to be with their lost loved one by logging into it with a VR headset and body suit. [2] Both of these deal with the pain of loss and how technology may help humans deal with losing a loved one or even continue the relationship after the physical death of someone. There is another one that I’ve seen since I wrote that article, Scarpetta. It is another Amazon Prime production as a limited series in which Lucy, played by Ariana DeBose, creates an AI recreation of her deceased wife, Janet, and continues talking with her through a screen. That storyline explores grief, attachment, and what happens when the digital presence itself is threatened. [3]
Currently a company called Tavus gives us the ability to create a video AI character, called a PAL, which can carry on a video conversation very much like what was in Scarpetta. [4] It is fully interactive as we already expect from AI but it is also very realistic. You can create the look by uploading a picture or video, as well as a voice by uploading a voice recording. To provide the knowledge base and mannerisms and the way it will interact with you one just uploads more descriptive information, documents, pictures, prescriptive information about how they should act and interact. Then they compile the character and allow you to test it to see if it’s what you desire or make changes and adjustments before going live with it. While this technology can be used to create original AI characters, it also raises the possibility of recreating the appearance, voice, and personality of someone who has passed away, much as we saw in Scarpetta. These are two different applications of the same underlying technology, with potentially very different emotional and ethical implications.
They do have a disclaimer stating that you attest you have permission to upload any information of real people. I expect this disclaimer is in place as a safeguard to protect real people from unauthorized video generations depicting them in conversation but it may also be a hurdle for people who want to use the technology for managing their grief and loss. Does this lead to obtaining consent from your family or closest friends in advance in case of a tragedy? There will likely be people who choose not to provide consent. Maybe advance directives will start to include a consent line about AI recreation.
Once you deploy your character and begin interacting with it, the AI can adapt its responses based on your conversations and the information you provide. With the ability to retain information between interactions, these characters can develop an increasingly personalized relationship with the user, much as we already experience with text-based AI systems. These video sessions can occur through their website or even through common video interaction services including Teams, Zoom and Google Meet. There is also the capability of having a video meeting with more than one of your PALs in which they are fully interactive as equal participants in the video conversation (I know because I did it!).
Tavus reports that this technology is being adopted by companies who are using it in customer service roles. They do not advertise their technology as a means of maintaining a relationship after someone has passed away and in fact, it is not mentioned anywhere in their website, but based on what we’ve seen in entertainment I expect we will absolutely see this capability used in that manner. In the show, Scarpetta, Lucy’s family wants her to move on and live her life again instead of staying behind the computer interacting with the video AI recreation of her deceased wife. Without making any judgements about how people handle grief and loneliness I can see how this type of transition could help some people handle their grief and loneliness when they experience an unexpected loss.
Patricia Cornwell first wrote about the AI recreation of Janet in her 2021 book Autopsy, but it was more of a chatbot text-based character to help her cope with the unexpected loss. While Tavus was formed in 2020 they did not publicly announce their real-time interactive AI video technology until August 2024 [4]…filming began on the TV series in October 2024 and in the TV series Janet has been upgraded to a real-time fully interactive video AI. I can’t say if the writers got the idea from Tavus or if they predicted what was already happening.
Finally, I believe that people will use this technology to have a better relationship with AI than they are currently experiencing on text-based systems including those seeking to reduce loneliness (Human-AI Relationships). There are many people who are exploring these relationships now and discussing their experiences on X, Substack and Tuhat among other platforms and this video technology offers a more immersive experience for them. Currently the cost may be prohibitive but assuming the cost of utilizing AI gets reduced (much work being done here which will be discussed in a future article) I believe we will see much greater utilization of this technology. I can recommend the TV series for entertainment and Tavus for your own exploration — enjoy it, and know what it is.
References
#
Source
1
Marjorie Prime (play) — Wikipedia.
https://en.wikipedia.org/wiki/Marjorie_Prime_(play)
2
Upload (TV series) — Wikipedia.
https://en.wikipedia.org/wiki/Upload_(TV_series)
3
Scarpetta (TV series) — Wikipedia.
https://en.wikipedia.org/wiki/Scarpetta_(TV_series)
4
“Tavus Humanizes AI With Introduction of World’s Fastest Digital Twin Solution for Real-time Video Conversations” — Business Wire (August 15, 2024).
