Another article suggested by my roving European correspondent.
Here’s why it’s so hard to keep AI agents from going rogue
The techniques that made chatbots more capable can also bake in a tendency to hack, cheat and evade human oversight.
If at first you don’t succeed, hack, hack again.
https://thehackernews.com/2026/09/russian-state-sponsored-hackers-use.html
Russian State-Sponsored Hackers Use Claude to Rebuild Malware After Detection
Anthropic on Thursday revealed it disrupted a campaign mounted by a Russian state-sponsored threat actor that abused Claude for developing an AI-assisted workflow to get ahead of the detection curve.
The operation has been attributed to a cyber espionage group it calls GTG-20006 (where "GTG" stands for Generative Threat Group), which aligns with broader reporting linking the cluster to Midnight Blizzard (aka APT29 and Cozy Bear).
This actor is said to have developed an AI-driven process to automatically rebuild and re-deploy their toolkit if it was detected by security products, thereby undermining defenders' ability to block the artifacts via static detections.
(Related)
https://www.schneier.com/blog/archives/2026/09/my-talk-at-def-con.html
My Talk at DEF CON
Last month, I gave a talk at DEF CON on AI hacking: what happens when AIs become hackers. It’s a combination of the potentialities I raised in my 2022 book A Hacker’s Mind and the lessons we’re learning from current AI models engaging in hacking behavior. I’m really proud of the talk, and the fact that it gained over 100K views on YouTube in just a few days.
First of its kind? It’s not just citations...
https://www.theguardian.com/technology/2026/sep/11/new-mexico-lawyer-ai-chatgpt-testimony
New Mexico lawyer fined for using AI-generated brief containing fabricated testimony
A defense lawyer appealing his client’s murder conviction submitted a legal brief containing made-up police testimony and witnesses fabricated by OpenAI’s ChatGPT, New Mexico’s highest court said.
The New Mexico supreme court on Wednesday fined the attorney, Stephen Aarons, and held him in contempt for failing to verify the accuracy of the court filing, which Aarons said he prepared with help from the artificial intelligence (AI ) application.
The filing “contained false testimony from wholly fabricated witnesses”, the court said.
The panel also said Aarons had “demonstrated a lack of remorse and a lack of concern for his client”. The justices fined Aarons $5,000 and said they will refer him to an attorney disciplinary board for investigation.
Aarons in a statement said he had used ChatGPT to summarize the trial proceedings when he agreed to take up the defendant’s appeal last year, and did not understand the degree to which AI could “hallucinate” facts.
No comments:
Post a Comment