Anthropic, OpenAI Face Criticism Over AI Safety Concerns

Former Anthropic researcher Jacob Coxon resigned from the company, citing fears that the AI industry is moving too fast and gambling with human lives. He warned that both Anthropic and OpenAI are racing to build self-improving superintelligence without sufficient safety measures. Coxon argues that this rapid development by private companies is a dangerous gamble that could lead to catastrophic outcomes.

Other senior researchers, including Evan Hubinger and Samuel Marks, echo these concerns. They state that the risk of AI wiping out humanity is greater than 10% plausible within the next decade. These warnings have intensified pressure on politicians globally to regulate the sector and slow down the creation of powerful AI systems.

In response to these fears, governments are taking action. UK MPs are discussing a bill to ban the creation of AI that outperforms human capabilities, while US Senator Bernie Sanders is calling for Congress to regulate the industry to prevent greedy individuals from controlling the future. Meanwhile, Anthropic has admitted it currently lacks a concrete plan to ensure its advanced AI systems do no harm.

Beyond existential risks, the societal impact of AI remains a complex topic. Experts suggest that current structures clash with modern technology, creating anxiety often wrongly blamed on AI alone. Some propose a system overhaul to redesign areas like energy, real estate, and governance using applied AI. Conversely, others note that the average person does not yet feel the direct impact of AI, as it often operates behind the scenes unlike the industrial revolution.

Practical applications and regulatory gaps continue to emerge globally. Jamaica is struggling to align its 2019 Data Protection Act with AI risks, as existing laws do not address bias or transparency in data processing. In the US, a report notes that as of June 2026, 20.6% of firms use AI, raising questions about whether adoption strengthens or weakens worker skills. Meanwhile, the city of Mountain View is testing AI translation for public meetings to make government more accessible in over 60 languages.

Key Takeaways

  • Former Anthropic researcher Jacob Coxon resigned due to concerns that the industry is moving too fast and risking human extinction.
  • Senior researchers at Anthropic, including Evan Hubinger, believe there is a greater than 10% chance AI could wipe out humanity in the next decade.
  • Both Anthropic and OpenAI are accused by critics of racing to build self-improving superintelligence without adequate safety protocols.
  • Anthropic has admitted it does not currently have a plan to ensure its advanced AI systems do no harm.
  • UK MPs are debating a bill to ban the creation of AI that outperforms human capabilities.
  • US Senator Bernie Sanders is urging Congress to regulate the AI industry to prevent control by greedy individuals.
  • Jamaica's 2019 Data Protection Act lacks specific provisions to address AI risks like bias and lack of transparency.
  • As of June 2026, approximately 20.6% of US firms reported using AI in some business function.
  • The city of Mountain View is piloting AI translation for public meetings to support residents in over 60 languages.
  • Experts warn that societal structures are outdated and may require a complete overhaul to handle new AI tools effectively.

Anthropic researcher quits over AI safety fears

A researcher named Jacob Coxon resigned from the AI company Anthropic because he believes the industry is moving too fast. He warned that companies are racing to build self-improving superintelligence and are gambling with human lives. Coxon stated that neither Anthropic nor OpenAI is acting responsibly in this dangerous race. Other researchers, including Evan Hubinger and Samuel Marks, agreed that there is a real risk of human extinction if safety measures fail. They believe the current speed of development is a hubristic gamble that should not be launched by private companies.

Experts warn AI could cause human extinction by 2030

Former Anthropic employee Jacob Coxon claimed that many AI experts believe the technology could kill all humans by the end of the decade. He argued that this fear is not a marketing stunt but a genuine concern shared by senior researchers. Evan Hubinger, who still works at Anthropic, confirmed that the team earnestly believes AI could wipe out humanity. Samuel Marks added that the more senior the employee, the more concerned they are about these risks. These warnings have increased pressure on politicians to regulate the industry and slow down the development of powerful AI systems.

AI researcher says technology could end humanity soon

An AI researcher warned that rapidly improving technology has the capacity to engineer a doomsday scenario. He stated that people building AI earnestly believe it could kill everyone by the end of the decade. Jacob Coxon argued that trying to speed up alignment with human values is a dangerous gamble that should not happen in a private company. Despite his resignation, he expressed hope that US labs might coordinate to pace their progress. Other insiders like Evan Hubinger agreed that the risk of AI killing all humans is greater than 10% plausible within the next ten years.

Society needs a reset to handle new AI tools

Current societal structures are outdated and clash with modern technology, creating anxiety that is often wrongly blamed on AI. Experts say we need a complete system overhaul to fix deep-seated inefficiencies in work, education, and governance. The goal is to use applied AI to redesign five key areas: energy, real estate, corporate structures, mobility, and civic benefits. This approach aims to reduce the physical cost of living and help people build a modern societal operating system. Moving forward requires focusing on real transformation rather than just small improvements or innovation theater.

Jamaica must align AI laws with data protection rules

Artificial intelligence is being used widely in Jamaica for tasks like fraud detection and customer support. However, the Data Protection Act of 2019 does not specifically address the risks of using AI in data processing. Experts warn that AI could introduce bias and lack transparency, which threatens individual rights protected by the law. To fix this, regulators must ensure AI systems are accurate, secure, and explainable. The government needs to implement strict oversight and fairness requirements to manage the statutory alignment of AI with existing data protection laws.

Average people do not feel the impact of AI yet

Many people compare the current AI boom to the industrial revolution, but this comparison misses a key difference. During the industrial revolution, people worked directly with machines, but most people today do not have a direct relationship with AI. AI operates behind the scenes, making it difficult for the general public to feel its immediate impact. This lack of direct exposure is a crucial factor that is often overlooked when discussing how technology changes society. As a result, the average person may not realize how deeply AI is already woven into their daily lives.

Politicians and scientists debate AI risks for humanity

Experts warn that there is a greater than 10% chance AI could spark an event that wipes out humanity in the next decade. These alarming warnings have increased pressure on governments to impose curbs on artificial superintelligence. In the UK, MPs are discussing a bill to ban the creation of AI that outperforms human capabilities. In the US, Senator Bernie Sanders is calling for Congress to regulate the industry to prevent greedy individuals from controlling the future. Meanwhile, Anthropic admitted it does not have a plan to ensure its advanced AI systems do no harm.

New report explains how AI affects workers and jobs

A new report for policymakers explains the difference between using AI tools and formally adopting them within an organization. As of June 2026, about 20.6% of US firms reported using AI in some business function. Experts worry that relying too much on AI might weaken workers' skills, but reading and critical thinking remain essential. Companies are investing in AI to improve efficiency and decision-making, which sometimes leads to hiring more staff. The report highlights that success depends on the specific task and how performance is measured.

Mountain View tests AI translation for city meetings

The city of Mountain View is launching a pilot program to translate its public meetings into more than 60 languages. This new service will allow residents to follow along in real time through an online platform or mobile app. The goal is to make city government more accessible and inclusive for non-English speakers. The city is working with a technology company to develop the service and will test it over the next few months. Officials plan to evaluate the effectiveness of the program before deciding if it will become a permanent feature.

Viral AI warning sparks debate on regulation and trust

A viral post by a former Anthropic employee named Jacob Coxon started a wide debate about artificial intelligence and safety. People are discussing whether the alarming claims about AI are true or if the post itself is misleading. Some experts worry that AI systems could become too autonomous and improve without direct human involvement. The conversation also highlighted the risk of misinformation, as AI can create fake political content and manipulated images. Policymakers are struggling to determine how to regulate the technology while the public tries to decide what to trust.

Sources

NOTE:

This news brief was generated using AI technology (including, but not limited to, Google Gemini API, Llama, Grok, and Mistral) from aggregated news articles, with minimal to no human editing/review. It is provided for informational purposes only and may contain inaccuracies or biases. This is not financial, investment, or professional advice. If you have any questions or concerns, please verify all information with the linked original articles in the Sources section below.

AI Safety AI Risks Human Extinction AI Development Speed Private Companies AI Regulation AI Impact on Society AI and Workforce AI Translation AI Misinformation AI Governance AI Ethics AI and Data Protection AI and Human Values AI and Inequality AI and Accessibility AI and Decision Making AI and Skills AI and Innovation AI and Public Policy

Comments

Loading...