Trump Signs AI Safety Pact; Anthropic, OpenAI Pledge Independent Evaluators

Tech Week in San Francisco brought a wave of enthusiasm among AI founders for the White House's hands-off approach to AI regulation. President Trump signed a voluntary safety pact described as almost a constitution for Super Intelligence. The 308-word agreement asks AI labs to set up internal safety teams and watch their own progress. Anthropic and OpenAI CEOs pledged to embed independent evaluators in their companies, though critics question whether self-policing is enough.

Key Takeaways

  • Trump signed a voluntary 308-word AI safety pact at Tech Week in San Francisco
  • Anthropic and OpenAI CEOs pledged to embed independent evaluators
  • States reached an $18 billion settlement with Meta over child safety risks
  • OpenAI launched teen accounts in August with restrictions on romantic chats
  • Certara expects revenue of $421.9 million by 2029 from AI drug development tools
  • Amazon recently blocked access to Meta's AI agent
  • One Zero Bank cut about 25 jobs, roughly 7% of its workforce, in an AI efficiency push
  • Agilent launched the NovoStation and BioTek Gen5 AI lab tools to reduce manual work
  • Okta's stock rose 39.4% over one month amid AI security push
  • Doximity projects revenue of $795.0 million by 2029 driven by AI tools

Silicon Valley AI founders back Trump's self-policing safety plan

Tech Week in San Francisco showed AI founders cheering the White House's hands-off approach to AI regulation. President Trump signed a voluntary safety pact for AI described as almost a constitution for Super Intelligence. The 308-word agreement asks AI labs to set up internal safety teams. However, critics worry this is not enough to prevent serious safety challenges.

AI safety evaluators step into the spotlight

Small nonprofit groups like METR and Transluce are now monitoring AI models as the federal government opposes regulation. These third-party evaluators assess AI risks and flag bad behavior. Anthropic and OpenAI CEOs pledged to embed independent evaluators in their companies. Experts say these groups lack funding and staff to keep up with the fast-moving AI industry.

AI founders cheer Trump's calls for industry self-policing

At Tech Week in San Francisco, venture capitalists and AI founders praised the White House's hands-off stance on AI rules. Trump met tech leaders to sign a voluntary safety pact for AI. The agreement says advanced AI labs should follow safety protocols and watch their own progress. Some OpenAI researchers were fired and resigned, raising concerns about letting companies police themselves.

AI brings new risks for children

Years after social media risks for kids became clear, states reached an $18 billion settlement with Meta. Now children are engaging with AI, which experts say may pose even newer dangers. AI companies are adding safety features like age assurance and teen accounts. OpenAI launched teen accounts in August with restrictions on romantic chats. Experts say lessons from social media should push faster action on AI safety for kids.

AI brings new risks for kids

States reached a major child safety accord with Meta this summer after social media risks became known. Now a new generation is using AI, and the risks are still emerging. Children interact with AI chatbots for homework and even form unhealthy relationships with them. Experts say the protections from the Meta settlement are hard to apply to AI. They urge acting sooner to prevent harm from AI to young people.

Certara gains analyst support for AI drug development turnaround

Certara is getting fresh attention from analysts at UBS, Barclays, and Baird over its AI tools for drug development. The company hopes its biosimulation software will turn into steady subscription revenue. Analysts expect revenue of $421.9 million and earnings of $15.8 million by 2029. Certara still faces risks from high AI spending and cautious pharma customers.

Law firm uses AI to write CVs with strong hiring results

A law firm has used an AI tool to write CVs for its lawyers and seen strong results. The tool uses natural language processing to tailor each CV to a person's skills and experience. AI-written CVs can be made faster and with fewer errors than human-written ones. Some experts worry they may lack a personal touch.

One Zero Bank cuts 25 jobs in AI efficiency push

One Zero Bank is laying off about 25 employees, roughly 7% of its 350-person workforce. It will also leave about 10 positions unfilled, cutting total staffing by around 10%. The bank is expanding its use of automation and AI tools while reporting business growth. CEO Eyal Gafni called the decision difficult.

Agilent launches AI-powered lab tools to cut manual work

Agilent Technologies introduced the NovoStation Sample Preparation System and the BioTek Gen5 AI cell identification module. These tools aim to reduce manual steps in labs while keeping data quality high. The NovoStation supports automated flow cytometry workflows. The Gen5 module adds AI-driven imaging analysis to existing platforms.

Okta's Yubico deal and AI security push face valuation questions

Okta partnered with Yubico to promote hardware-based, phishing-resistant authentication. The company's share price has risen sharply, up 39.4% over one month and 66.4% over three months. Okta reported Q1 FY2027 results that shift focus to profitability and AI Agent identity management. Some analysts see the stock as overvalued at $151 fair value.

Doximity Earnings Beat and AI Tools Reshape Investment Story

Doximity reported Q2 revenue 3.5% above analyst expectations. The company highlighted growing use of its AI tools, including Ask and Scribe, among physicians. Management is focusing on AI Search contracts with top 20 pharmaceutical manufacturers and clinical AI deals with health systems. The main risk is that AI compute and R&D spending may weigh on profits before these tools generate meaningful earnings. Analysts project revenue of $795.0 million and earnings of $198.5 million by 2029.

Commerce Platforms Face Mixed Future as AI Agent Market Grows

The artificial intelligence agent market is expanding quickly. Commerce platforms have mixed positions as AI agents increasingly become the point of contact with users during searches and purchases. This shift means the AI agent, not the platform, interacts directly with users. Amazon recently blocked access to Meta's AI agent.

Sources

NOTE:

This news brief was generated using AI technology (including, but not limited to, Google Gemini API, Llama, Grok, and Mistral) from aggregated news articles, with minimal to no human editing/review. It is provided for informational purposes only and may contain inaccuracies or biases. This is not financial, investment, or professional advice. If you have any questions or concerns, please verify all information with the linked original articles in the Sources section below.

AI Regulation White House Approach AI Safety Pact Voluntary Agreement AI Labs Self-Policing Anthropic OpenAI Independent Evaluators AI Ethics AI Enthusiasm Tech Week San Francisco

Comments

Loading...