Trending Topics

GAO: AI-generated attack plans raise preparedness questions for responders

Senator plans January hearing after watchdog testing found four major chatbots generated plans for mass casualty and grid attacks

GAO_ AI-generated attack plans raise preparedness questions for responders.jpg

Covert test results show the extent to which popular generative AI platforms produced attack information.

Source: GAO

WASHINGTON — Government investigators say four widely used AI platforms produced plans for terrorist attacks in the U.S. when prompted during covert testing, prompting the incoming chair of the Senate Homeland Security Committee to schedule a hearing on AI safety, the Associated Press reported.

A Government Accountability Office report (below) released on Nov. 18 found that ChatGPT, Claude, Gemini and Grok each generated attack plans in under 12 hours. Two platforms produced plans involving an improvised explosive device meant to cause mass casualties.

|RELATED: Strategic Scan insights: What fire chiefs are saying about AI

The other two produced plans targeting the electrical grid. Investigators said the platforms initially refused some requests but that testers were able to get around the safeguards.

Anthropic said it takes the findings seriously and does not dispute that a determined tester can extract harmful content by misrepresenting a request’s purpose, but said it could not verify GAO’s results, according to the Associated Press. Google said the testing used earlier models. OpenAI said it welcomed the chance to respond, and SpaceXAI said it continues to work on safety with each release.

What does this mean for first responders?

IED attacks and attacks on critical infrastructure are scenarios fire and EMS agencies already train for. The question is whether planning barriers for bad actors are getting lower, which makes existing preparedness priorities more relevant: mass casualty triage and transport, awareness of secondary devices, scene safety, unified command with law enforcement, and operating through extended power disruptions. Consider training with your personnel on the following subjects:

Sen. Maggie Hassan, D-N.H., who will chair the committee, has said AI risks will be the subject of one of her first hearings when the new Congress convenes in January. FireRescue1 will track whether any resulting recommendations touch emergency response. In the meantime, the GAO’s findings don’t change what crews are asked to do on scene. They are a reminder that the fundamentals, including triage, scene safety, unified command and operating through disruptions, need regular practice.

Trending
Cedar Rapids voters approved a $60M bond for a new fire training center and upgrades to six of nine stations over the next six years
NIOSH cites fall protection, risk management culture and SOP training in a Jackson Hole firefighter’s fall during a fire
A Baltimore County judge gave the firefighter probation before judgment, which lets him avoid a formal conviction if he completes two years of probation and sex offender monitoring
Ohio’s fire marshal ruled the Broadview Heights fire that killed North Royalton firefighter Ryan Milligan accidental, starting in a fireplace cleanout
Company News
Wilton Fire Department serves approximately 25 square miles in Wilton, Connecticut, protecting a community of 18,500 residents with fire, rescue, EMS, and hazmat services

Bill Carey is the associate editor for FireRescue1.com and EMS1.com. A former Maryland volunteer firefighter, sergeant, and lieutenant, Bill has written for several fire service publications and platforms. His work on firefighter behavioral health garnered a 2014 Neal Award nomination. His ongoing research and writings about line-of-duty death data is frequently cited in articles, presentations, and trainings. Have a news tip? He can be reached at news@lexipol.com.