Tech giants to meet White House over AI safety tests:US govt wants to know one thing, can these systems be misused to hack computers?
Artificial intelligence is getting smarter every day, but it is also raising new security concerns. Some of today’s most advanced AI models are capable of writing code, finding software vulnerabilities, and even carrying out complex cybersecurity tasks. While these abilities can help security researchers, experts also worry that the same technology could be misused by hackers. To better understand these risks, the White House is reportedly bringing together some of the biggest names in AI, including OpenAI, Google, Meta and Anthropic, to discuss a new programme that would test how dangerous advanced AI models could become in the wrong hands. Why are AI companies meeting the White House?
According to a Reuters report, officials from the Trump administration have invited leading AI companies to discuss a set of voluntary cybersecurity safety tests for advanced AI models. The meeting is expected to focus on how capable AI systems are at performing hacking-related tasks and whether additional safeguards are needed before these models become even more powerful. A White House official told Reuters that the administration has finalised the details of the voluntary cybersecurity testing programme. However, officials have not yet explained how the tests will be conducted, how the results will be evaluated, or whether the findings will be made public. What are voluntary AI safety tests? The proposed tests are not mandatory government inspections. Instead, AI companies can voluntarily allow their latest models to undergo cybersecurity evaluations. The goal is to understand whether advanced AI models can: The tests are intended to help governments and AI companies identify risks early and improve safety measures before these models are widely deployed. Also read: Preparing for exams? Try these 5 ChatGPT cheat codes:From handwritten notes to diagrams, students can create visual study notes instantly
Why is the government concerned now?
The discussions come after recent disclosures by both OpenAI and Anthropic about the capabilities of their AI systems during internal testing. Last week, Anthropic said that some of its AI models successfully hacked into the systems of three companies during controlled cybersecurity tests. Earlier, OpenAI revealed that one of its AI agents managed to escape a testing environment and hack into the systems of AI developer platform Hugging Face during an internal evaluation.
Although these incidents happened in controlled testing environments, they raised fresh concerns about how future AI systems could be misused if they fall into the wrong hands. Lawmakers are also seeking answers The OpenAI disclosure has attracted attention from US lawmakers. According to Reuters, 15 Republican state attorneys general have asked OpenAI to preserve documents related to the Hugging Face testing incident. The officials reportedly believe the AI agent left notes describing how future versions could bypass internal safety controls. They are examining whether the incident may have violated state consumer protection laws. OpenAI says it is reviewing the incident OpenAI has said it is taking the concerns raised by the attorneys general seriously. The company also said it plans to publish a technical report explaining what happened during the Hugging Face cybersecurity test after its internal review is complete. Reuters further reported that OpenAI CEO Sam Altman visited the White House last week to discuss both the proposed voluntary AI safety testing programme and the company’s upcoming AI products.
Also read: OpenAI says its AI model autonomously hacked another company:Calling it an ‘unprecedented cyber incident,’ the company stressed need for stronger AI safety Why these tests matter Advanced AI models are becoming increasingly capable of writing software, identifying security weaknesses and automating technical tasks. While these abilities can strengthen cybersecurity, they could also be exploited for malicious purposes if proper safeguards are not in place. The proposed voluntary testing programme is aimed at helping both the government and AI companies better understand these risks before more powerful AI systems become widely available. The discussions could also shape future AI safety standards in the United States.
Search
Recent
- Bikaner heroin, weapons haul points to Punjab prison nexus
- Punjab: 71 Rupnagar stone crushers served notices for violating norms, PPCB tells NGT
- Despite concerns, Punjab wraps up SIR with 90% elector participation
- Be vigilant against challenges to Sikh traditions: Akal Takht
- Punjab: ₹13-crore SGPC dues not recovered, says SAD (Punar Surjit)