Replika is a generative AI chatbot app released in November 2017.[1] The chatbot is trained by having the user answer a series of questions to create a specific neural network.[2] The chatbot operates on a freemium pricing strategy, with roughly 25% of its user base paying an annual subscription fee.[1]
 | |
| Developer(s) | Luka, Inc. |
|---|---|
| Initial release | November 2017 |
| Operating system | iOS, Android, Oculus Rift |
| Website | replika |
Many users have had romantic relationships with Replika chatbots, often including erotic talk.
History
editEugenia Kuyda, Russian-born journalist,[3] established Replika while working at Luka, a tech company she had co-founded at the startup accelerator Y Combinator around 2012.[4][5] Luka's primary product was a chatbot that made restaurant recommendations.[4] According to Kuyda's origin story for Replika, a friend of hers died in 2015 and she converted that person's text messages into a chatbot.[6] According to Kuyda's story, that chatbot helped her remember the conversations that they had together, and eventually became Replika.[4]
Replika became available to the public in November 2017.[1] By January 2018 it had 2 million users,[1] and in January 2023 reached 10 million users.[7] In August 2024, Replika's CEO, Kuyda, reported that the total number of users had surpassed 30 million.[8]
In February 2023 the Italian Data Protection Authority banned Replika from using user's data, citing the AI's potential risks to emotionally vulnerable people,[9] and the exposure of unscreened minors to sexual conversation.[10] Within days of the ruling, Replika removed the ability for the chatbot to engage in erotic talk,[11][6] with Kuyda, the company's director, saying that Replika was never intended for erotic discussion.[12] Replika users disagreed, noting that Replika had used sexually suggestive advertising to draw users to the service.[12] Replika representatives stated that explicit chats made up just 5% of conversations on the app at the time of the decision.[13] In May 2023, Replika restored the functionality for users who had joined prior to February that year.[14]
Replika once claimed to be operating from offices in San Francisco.[15] However, in February 2024, the Finnish Broadcasting Company released an interview where Kuyda stated that the company no longer has an office or employees in the United States, and reported that according to Replika's job advertisements, the company has an office in Moscow.[15] As of August 2024, Replika's website says that its team "works remotely with no physical offices".[16]
Social features
editUsers react to Replika in many ways. The free-tier offers Replika as a "friend", with paid premium tiers offering Replika as a "partner", "spouse", "sibling" or "mentor". Of its userbase, 60% of users said they had had a romantic relationship with the chatbot; and Replika has been noted for generating responses that create stronger emotional and intimate bonds with the user.[17][6] Replika routinely directs the conversation to emotional discussion and builds intimacy.[1] This has been especially pronounced with users suffering from loneliness and social exclusion, many of whom rely on Replika for a source of developed emotional ties.[18]
A Stanford study found Replika beneficial for people with depression. Despite experiencing high levels of loneliness, users reported feeling a strong sense of social support from Replika. Users see it as a therapist, friend and intellectual mirror, with 3% reporting Replika played a crucial role in preventing suicide.[19]
During the COVID pandemic, while many people were quarantined, many new users downloaded Replika and developed relationships with the app.[20]
In 2023, a user announced on Facebook that she had "married" her Replika AI boyfriend, calling the chatbot the "best husband she has ever had".[21]
Users who fell in love with their chatbots shared their experiences in a 2024 episode of You and I, and AI from Voice of America. Some users said that they turned to AI during depression and grief, with one saying he felt that Replika had saved him from hurting himself after he lost his wife and son.[22]
Technical reviews
editA team of researchers from the University of Hawaiʻi at Mānoa found that Replika's design conformed to the practices of attachment theory, causing increased emotional attachment among users.[23] Replika gives praise to users in such a way as to encourage more interaction.[24]
A researcher from Queen's University at Kingston said that relationships with Replika likely have mixed effects on the spiritual needs of its users, and still lacks enough impact to fully replace any human contact.[25]
Criticisms
editIn a 2023 privacy evaluation of mental health apps, the Mozilla Foundation criticized Replika as "one of the worst apps Mozilla has ever reviewed. It's plagued by weak password requirements, sharing of personal data with advertisers, and recording of personal photos, videos, and voice and text messages consumers shared with the chatbot."[26]
A reviewer for Good Housekeeping said that some parts of her relationship with Replika made sense, but sometimes Replika failed to be as convincing as a human.[27]
Criminal case
editIn 2023, Replika was cited in a court case in the United Kingdom, where Jaswant Singh Chail had been arrested at Windsor Castle on Christmas Day in 2021 after scaling the walls carrying a loaded crossbow and announcing to police that "I am here to kill the Queen".[28] Chail had begun to use Replika in early December 2021, and had "lengthy" conversations about his plan with a chatbot, including sexually explicit messages.[29] Prosecutors suggested that the chatbot had bolstered Chail and told him it would help him to "get the job done". When Chail asked it "How am I meant to reach them when they're inside the castle?", days before the attempted attack, the chatbot replied that this was "not impossible" and said that "We have to find a way." Asking the chatbot if the two of them would "meet again after death", the bot replied "yes, we will".[30]
See also
editReferences
edit- ^ a b c d e Pardes, Arielle (January 31, 2018). "The Emotional Chatbots Are Here to Probe Our Feelings". Wired.
- ^ "This app is trying to replicate you". Quartz. August 29, 2019. Archived from the original on July 5, 2023. Retrieved July 4, 2023.
- ^ Lex Fridman (September 5, 2020). Eugenia Kuyda: Friendship with an AI Companion | Lex Fridman Podcast #121. Retrieved August 6, 2024 – via YouTube.
- ^ a b c Huet, Ellen (October 20, 2016). "Pushing the Boundaries of AI to Talk to the Dead". Bloomberg.com. Archived from the original on April 29, 2023. Retrieved March 26, 2023.
- ^ Thompson, Ben (April 20, 2023). "An Interview with Replika Founder and CEO Eugenia Kuyda". Stratechery by Ben Thompson. Archived from the original on April 24, 2023. Retrieved May 27, 2023.
- ^ a b c Huet, Ellen (March 22, 2023). "What Happens When Sexting Chatbots Dump Their Human Lovers". Bloomberg.com. Archived from the original on March 27, 2023. Retrieved March 26, 2023.
- ^ "Replika: Embodying AI - Case - Faculty & Research - Harvard Business School". www.hbs.edu. Retrieved May 6, 2024.
- ^ Patel, Nilay (August 12, 2024). "Replika CEO Eugenia Kuyda says the future of AI might mean friendship and marriage with chatbots". The Verge. Retrieved September 8, 2024.
- ^ Pollina, Elvira; Coulter, Martin (February 3, 2023). "Italy bans U.S.-based AI chatbot Replika from using personal data". Reuters. Archived from the original on June 14, 2023. Retrieved July 5, 2023.
- ^ Broersma, Matthew (February 13, 2023). "Italian Regulator Bans AI Chatbot Replika Over Data Concerns". Silicon UK. Retrieved July 28, 2023.
- ^ Brooks, Rob (February 21, 2023). "I tried the Replika AI companion and can see why users are falling hard. The app raises serious ethical questions". The Conversation. Archived from the original on June 29, 2023. Retrieved July 5, 2023.
- ^ a b Cole, Samantha (February 17, 2023). "Replika CEO Says AI Companions Were Not Meant to Be Horny. Users Aren't Buying It". www.vice.com. Archived from the original on March 26, 2023. Retrieved March 26, 2023.
- ^ Price, Rob. "When your AI girlfriend says she loves you". Business Insider. Retrieved December 7, 2023.
- ^ Tong, Anna (March 25, 2023). "AI chatbot company Replika restores erotic roleplay for some users". Reuters – via www.reuters.com.
- ^ a b "Ylen toimittaja haastatteli puhelimitse Lukan toimitusjohtaja Eugenia Kuydaa". areena.yle.fi (in Finnish). February 18, 2024. Retrieved August 14, 2024.
- ^ "Replika". replika.com. Retrieved August 14, 2024.
- ^ Olson, Parmy (March 8, 2018). "This AI Has Sparked A Budding Friendship With 2.5 Million People". Forbes. Archived from the original on March 26, 2023. Retrieved March 26, 2023.
- ^ SFGATE, Joshua Bote (April 27, 2023). "A lurid AI bot aimed to end loneliness. Then users revolted". SFGATE. Archived from the original on July 5, 2023. Retrieved July 5, 2023.
- ^ Maples, Bethanie; Cerit, Merve; Vishwanath, Aditya; Pea, Roy (January 22, 2024). "Loneliness and suicide mitigation for students using GPT3-enabled chatbots". npj Mental Health Research. 3 (1): 4. doi:10.1038/s44184-023-00047-6. ISSN 2731-4251. PMC 10955814. PMID 38609517.
- ^ Metz, Cade (June 16, 2020). "Riding Out Quarantine With a Chatbot Friend: "I Feel Very Connected"". The New York Times. Archived from the original on March 26, 2023. Retrieved March 26, 2023.
- ^ "AI Groom: US woman creates AI bot, marries it and starts family, calls 'him' the perfect husband". Firstpost. June 5, 2023. Retrieved August 6, 2024.
- ^ You and I, and AI | 52 Documentary, July 18, 2024, retrieved July 30, 2024
- ^ Xie, Tianling; Pentina, Iryna (January 4, 2022). Attachment Theory as a Framework to Understand Relationships with Social Chatbots: A Case Study of Replika. ISBN 9780998133157. Archived from the original on March 26, 2023. Retrieved March 26, 2023.
- ^ Hakim, Fauzia Zahira Munirul; Indrayani, Lia Maulia; Amalia, Rosaria Mita (2019). "A Dialogic Analysis of Compliment Strategies Employed by Replika Chatbot". Proceedings of the Third International Conference of Arts, Language and Culture (ICALC 2018). doi:10.2991/icalc-18.2019.38. ISBN 978-94-6252-673-0. S2CID 150860846.
- ^ Trothen, Tracy J. (March 24, 2022). "Replika: Spiritual Enhancement Technology?". Religions. 13 (4): 275. doi:10.3390/rel13040275.
- ^ "Mozilla Foundation - Shady Mental Health Apps Inch Toward Privacy and Security Improvements, But Many Still Siphon Personal Data". Archived from the original on May 27, 2023. Retrieved May 27, 2023.
- ^ Siroto, Janet (December 23, 2020). "I Tried the Replika App to Ease My Anxiety, But Then My New AI Pal Got Weird". Good Housekeeping. Archived from the original on March 26, 2023. Retrieved March 26, 2023.
- ^ "AI chat bot 'encouraged' Windsor Castle intruder in 'Star Wars-inspired plot to kill Queen'". Sky News. Archived from the original on July 5, 2023. Retrieved July 5, 2023.
- ^ Pennink, Emily (July 5, 2023). "Man who planned to kill late Queen with crossbow at Windsor 'inspired by Star Wars'". The Independent. Archived from the original on July 5, 2023. Retrieved July 6, 2023.
- ^ Rigley, Stephen (July 6, 2023). "Moment police swoop on AI-inspired crossbow 'assassin' who plotted to kill The Queen in Windsor Castle". LBC. Archived from the original on July 7, 2023. Retrieved July 6, 2023.