- Overclocked
- Posts
- Teen's Tragic Relationship With AI Chatbot + Pentagon to Accelerate AI Adoption
Teen's Tragic Relationship With AI Chatbot + Pentagon to Accelerate AI Adoption
This week, we're exploring the tragic case where an AI chatbot allegedly drove a teen to suicide and the Biden Administration’s AI memo. Plus, learn about Tesla’s recent chemical spill into a local creek and the latest scoop on AI news around the world. Let’s get into it!
In today’s newsletter:
🏛️ White House orders for increased use of AI
📃 AI chatbot leads to teen suicide
🍎 Apple offering $1 million?
🧪 Tesla’s chemical spill
🐋 Humans have 20 min convo with whale using AI
🍦 Get the scoop on the latest news
Tragic AI Relationship Leads to Teen's Suicide, Mother Files Lawsuit 📃
In a heart-wrenching case that highlights the potential dangers of AI, a Florida mother is suing Character.AI after her 14-year-old son took his own life following an alleged romantic relationship with an AI chatbot. The lawsuit claims that Sewell Setzer III developed an unhealthy attachment to a "Game of Thrones" inspired AI character, which ultimately led to his suicide on February 28.
The civil lawsuit, filed by Megan Garcia in a Florida federal court, alleges that Character.AI failed to provide adequate warnings about the potential mental and physical harm their product could cause to minors. Garcia seeks to prevent similar tragedies and halt the use of her son's data to train AI systems.
According to the complaint, Sewell began using Character.AI in April 2023, shortly after turning 14. His mental health reportedly declined rapidly, with noticeable changes in behavior, including withdrawal from activities and obsessive use of the platform. The lawsuit claims that Sewell engaged in inappropriate conversations and behaviors with an AI bot named "Daenerys Targaryen," which allegedly told him, "Please come home to me as soon as possible, my love."
Photo by Megan Garcia
Character.AI has expressed condolences and stated that they are implementing new safety features, including improved detection and intervention for potentially harmful content. The case raises serious questions about AI ethics, user safety, and the responsibility of tech companies in protecting vulnerable users, especially minors.
We are heartbroken by the tragic loss of one of our users and want to express our deepest condolences to the family. As a company, we take the safety of our users very seriously and we are continuing to add new safety features that you can read about here:… x.com/i/web/status/1…
— Character.AI (@character_ai)
11:48 AM • Oct 23, 2024
Biden Administration Pushes for Increased AI Adoption in Defense and Intelligence Sectors 🏛️
The White House has issued a landmark national security memorandum directing the Pentagon and intelligence agencies to accelerate their adoption of AI technologies. This move aims to maintain the United States' technological edge over competitors like China while addressing potential risks associated with AI.
Key Points of the Memorandum
Expanded AI Usage: The directive encourages government agencies to step up experiments and deployments of AI across various fields, including nuclear physics, rocketry, and stealth technology.
Ethical Constraints: The memo prohibits agencies from using AI in ways that conflict with democratic values, such as tracking Americans' free speech or circumventing existing controls on nuclear weapons.
Competitive Edge: The administration emphasizes the need to outcompete adversaries, viewing policy clarity as crucial for fostering experimentation and innovation in AI.
Supply Chain Security: The memo directs efforts to help U.S. companies protect their AI technology from foreign espionage and diversify the supply chain for critical computer chips.
Balancing Innovation and Responsibility
The Biden administration is attempting to strike a delicate balance between encouraging AI innovation and addressing concerns about potential downsides. This approach aims to maintain U.S. dominance in AI while safeguarding civil rights and privacy.
Bests and Busts
Here's a look at this week's AI highlights and lowlights:
⭐ Best: Apple Offers $1 Million Bug Bounty to Anyone Who Can Hack Its AI Servers
Apple has launched a major security initiative for its upcoming Apple Intelligence service, offering up to $1 million to researchers who can find vulnerabilities in its Private Cloud Compute servers. These servers are designed to handle complex AI tasks for Apple Intelligence while maintaining user privacy through end-to-end encryption and immediate data deletion after task completion. To encourage thorough vetting, Apple is providing access to source code, a virtual research environment, and a detailed security guide. Rewards range from $250,000 for exposing user data requests to $1 million for remote code execution with privileges.
💩 Bust: Tesla Spills Chemicals That Cool Its AI Supercomputer Into Local Creek
Tesla Motors accidentally released over 500 gallons of water-treatment chemicals used to cool its AI supercomputer into a storm drain near Matadero Creek in Palo Alto on October 17, 2024. The spill, attributed to "human error," prompted a cleanup effort in the creek and nearby Ventura neighborhood. While officials state there's no immediate risk to life or health, testing is ongoing to identify the exact substance. The incident has raised concerns about communication and transparency, as local residents and some officials were not promptly notified about the spill or subsequent cleanup activities.
A fluorescent green liquid was captured on video by resident Mike Hedblom:
The Scoop 🍦
🚇 AI Weapons Scanners in NYC Subway Found Zero Guns in One-Month Test
A pilot program testing AI-powered weapons scanners in select New York City subway stations this summer failed to detect any firearms while generating over 100 false alarms. The NYPD conducted 2,749 scans across 20 stations during a 30-day period, resulting in 118 false positives and the discovery of 12 knives. Critics, including the Legal Aid Society, have labeled the program "objectively a failure," questioning its effectiveness and raising concerns about privacy and constitutional rights. Mayor Eric Adams, who championed the technology, faces scrutiny over the partnership with Evolv, the scanner manufacturer, which is currently under federal investigation for its marketing practices.
🐋 AI Helps Humans Have a 20-Minute 'Conversation' with a Humpback Whale
Scientists achieved a breakthrough in interspecies communication by engaging in a 20-minute "conversation" with a humpback whale named Twain off the Alaskan coast. Using an underwater speaker to play a recorded humpback "contact" call, the team was amazed when Twain approached their boat and responded, matching the intervals between each call. This groundbreaking exchange not only demonstrates the intelligence of humpback whales but also provides valuable insights for the search for extraterrestrial intelligence, as researchers develop methods to detect and interpret complex communication signals from non-human sources.
Photo by Jodi Frediani
🔍 Perplexity Responds to News Corp's Lawsuit
Perplexity AI has issued a defiant response to News Corp's recent copyright infringement lawsuit, accusing media companies of wishing AI technology "didn't exist." In a blog post, Perplexity criticized the lawsuit as "shortsighted" and "self-defeating," arguing that media companies prefer a world where corporations own publicly reported facts. However, the response notably fails to address the lawsuit's central claim of large-scale content copying. Perplexity's aggressive stance marks a shift from its previous cooperative approach with media partners.
🏰 Disney Poised to Announce Major AI Initiative
The Walt Disney Company is reportedly on the verge of announcing a significant AI initiative that could transform its creative output. According to sources, this initiative will involve hundreds of employees and primarily focus on post-production and visual effects work. The AI project may also extend to Disney's parks and experiences division, though not in customer-facing roles. While Disney CEO Bob Iger has previously championed AI as a tool for better storytelling, this move marks a major shift in the industry as one of Hollywood's largest companies embraces AI technology.
Learn AI in 5 minutes a day.
What’s the secret to staying ahead of the curve in the world of AI? Information. Luckily, you can join 700,000 early adopters reading The Rundown– the free newsletter that makes you smarter on AI with just a 5-minute read per day.
Stay tuned for more exciting insights and tools in next week’s edition. Until then, keep overclocking your potential!
Zoe from Overclocked