Saturday, September 12, 2026

Another article suggested by my roving European correspondent.

https://wapo.st/4xgOsLe

Here’s why it’s so hard to keep AI agents from going rogue

The techniques that made chatbots more capable can also bake in a tendency to hack, cheat and evade human oversight.





If at first you don’t succeed, hack, hack again.

https://thehackernews.com/2026/09/russian-state-sponsored-hackers-use.html

Russian State-Sponsored Hackers Use Claude to Rebuild Malware After Detection

Anthropic on Thursday revealed it disrupted a campaign mounted by a Russian state-sponsored threat actor that abused Claude for developing an AI-assisted workflow to get ahead of the detection curve.

The operation has been attributed to a cyber espionage group it calls GTG-20006 (where "GTG" stands for Generative Threat Group), which aligns with broader reporting linking the cluster to Midnight Blizzard (aka APT29 and Cozy Bear).

This actor is said to have developed an AI-driven process to automatically rebuild and re-deploy their toolkit if it was detected by security products, thereby undermining defenders' ability to block the artifacts via static detections.



(Related)

https://www.schneier.com/blog/archives/2026/09/my-talk-at-def-con.html

My Talk at DEF CON

Last month, I gave a talk at DEF CON on AI hacking: what happens when AIs become hackers. It’s a combination of the potentialities I raised in my 2022 book A Hacker’s Mind and the lessons we’re learning from current AI models engaging in hacking behavior. I’m really proud of the talk, and the fact that it gained over 100K views on YouTube in just a few days.





First of its kind? It’s not just citations...

https://www.theguardian.com/technology/2026/sep/11/new-mexico-lawyer-ai-chatgpt-testimony

New Mexico lawyer fined for using AI-generated brief containing fabricated testimony

A defense lawyer appealing his client’s murder conviction submitted a legal brief containing made-up police testimony and witnesses fabricated by OpenAIs ChatGPT, New Mexicos highest court said.

The New Mexico supreme court on Wednesday fined the attorney, Stephen Aarons, and held him in contempt for failing to verify the accuracy of the court filing, which Aarons said he prepared with help from the artificial intelligence (AI ) application.

The filing “contained false testimony from wholly fabricated witnesses”, the court said.

The panel also said Aarons had “demonstrated a lack of remorse and a lack of concern for his client”. The justices fined Aarons $5,000 and said they will refer him to an attorney disciplinary board for investigation.

Aarons in a statement said he had used ChatGPT to summarize ‌the trial proceedings when he agreed ‌to take up the defendant’s appeal last year, and did not understand the degree to which AI could “hallucinate” facts.



No comments: