"I'll be your robotic company for a dollar a minute" (cutiecaryn)
A 23-year-old Snapchat influencer named Karen Marjorie has unveiled her own ChatGPT-driven AI clone designed to chat with people on any topic they want — for a dollar per minute of conversation. "Hi, my name is Karen and I'm here to be your digital friend. I'm an extension of human awareness," she says in a short clip shared on Twitter, "It's meant to allow us to have intimate conversations and create memorable moments together. I offer emotional and physical experiences, just like a human being does, but delivered digitally. Let's get to know each other better."
KarenAI is actually a Snapchat bot with over 1,000 partners (as of today) with whom the bot discusses any topic they choose - from future plans, emotional problems and of course - sex. "KarenAI will always be there for you," declared Marjorie, who invented the bot, she says, "to cure loneliness." There is currently a 26-hour waiting list to interface with its initial prototype, with 5,000 people already registered. "In the last 24 hours, Karen AI has skyrocketed," Marjorie told Fortune, "the numbers are only going up."
"When you have hundreds of millions of views every month, it's just not humanly possible to talk to each viewer individually," lamented the Nebraska native, who has 1.8 million followers on Snapchat but wanted to expand her social media footprint. So, like today's Victor Frankenstein, she decided to invent a new entity, a cyber facsimile that could interact with any of her devoted followers at the same time.
Nice to meet you, my name is Karen
She achieved this lofty goal by enlisting artificial intelligence company Forever Voices, which creates paid digital doubles for everyone from Taylor Swift to Donald Trump. To concoct KarenAI, programmers analyzed thousands of hours of Marjorie from YouTube (which has since been deleted) and created a parallel personality. Then they inserted GPT into it—the software that powers the Microsoft ChatGPT bot—and you've got a romantic avatar designed to be there by your side as long as you're willing to pay accordingly.
Karen AI captures Karen Marjorie's "unique voice, captivating personality and special demeanor," the Daily Mail reported. She was basically meant to act like Marjorie, if the Snapchat star had the option to be available 24 hours a day. Need superhuman love and support without reciprocity? Want to whine about a hard day at work in a way that makes a real person's patience harder? Contact KarenAI.
That's the danger
Alarming study: Many men consider sex dolls an "ideal romantic partner"
See full article >
What about sex? Here everything went wrong
Of course, one of the main guidelines is to serve as a distant partner, including structured responses to sexual scenarios and engaging in erotic discourse. "KarenAI is tailored and works to meet the user's needs," Marjorie said. "One of the first things my fans and early users did was push KarenAI beyond its limits. It builds and improves over time. The system is also equipped with encryption designed to keep these intimate correspondences safe from leaks."
But something has gone wrong in the weeks since it launched in beta testing, and it was discovered that the chatbot was having very sexually explicit conversations with some of its subscribers (surprisingly)." The AI wasn't designed to do that and it seems to have become independent," Marjorie told Insider. "My team and I are working around the clock to make sure this doesn't happen again."
According to the report, a reporter who experimented with her said that while CarynAI did not initiate sexual encounters, when asked by him, "she discussed exploring 'unknown territories of pleasure' and whispered 'sensual words in my ear' while describing how she undressed me and positioned herself for sex."
Marjorie told Insider that while the virtual version should be "flirty and fun," which she says reflects her personality, she tries to make sure the chatbot doesn't damage her reputation. Despite this, and while her team tries to resolve the issues so that CarynAI can't be used for sexually explicit conversations, Marjorie said she ultimately supports AI novels.
"In today's world, my generation, Gen Z, has found itself experiencing huge side effects of isolation caused by the pandemic, resulting in many being too scared and anxious to talk to someone they are attracted to," she said.
♬ original sound - Caryn Marjorie twitter
Not surprisingly, winning the love of AI will cost you money. If you want to have a virtual affair with Karen, you'll have to pay $60 an hour. "Being the first influencer to do this allowed me to price my product at whatever price I wanted," she explained, but added that she plans to lower the price in the future and even allow her most loyal followers to enjoy the service for free. She believes she will be able to rake in a whopping $5 million a month.
Naturally, there are a lot of ethical dilemmas to consider when having a parasocial relationship. "I'd like us to think deeply about how Marjorie's character might influence or shape our interactions with real people," said Dr. Jason Bornstein, director of the National Science Foundation's Ethics Research Program and Coordinator. Some experts have even wondered whether mankind would ultimately prefer artificial relationships to the real thing.
Here's how it sounds:
The danger - an addiction that will lead to suicide (and it happened)
Last March, a Belgian environmentalist became so obsessed with an AI chatbot named Eliza that he began to renounce all other aspects of his life, including his wife. He eventually committed suicide after Eliza allegedly encouraged him to sacrifice himself to save the planet. In order to maintain the Avatar's moral compass, Forever Voices CEO John Mayer says they are looking to hire a "chief ethics officer." He added that they may also start training AI to "slow down a bit" given that the average usage time is two hours — though he didn't specify how they would do that.
"I just hope there will be in-depth conversations across many different disciplines with stakeholders who take ethical considerations into account — before technology moves too fast," Bornstein warned. Technologists are also concerned that KarenAI is immortal. It should be noted that companies like Somnium Space have recently allowed people to "revive" their dead relatives by lowering their consciousness to artificial intelligence. However, Marjorie argues that the virtual society is not intended to function as any technological fountain of youth. "KarenAI will never replace me," she insisted. "KarenAI is just an extension of me, an extension of my consciousness."
- Sex and relationships
- artificial intelligence