LIVE PULSE
4.9 Anthropic CEO Amodei calls for slower AI development and shared safety rules11 src2.6 Agility Robotics unveils Digit 5 humanoid for warehouses and factories2 src2.4 Apple ships rebuilt Siri with Google Gemini, but not in the EU2 src2.2 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions2 src1.7 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says2 src1.3 Anthropic data retention policy prompts firms to limit Claude use for sensitive work1 src1.3 CoMem Paper Proposes Shared and Individual Memory Design for LLM Multi-Agent Systems1 src1.3 Paper proposes evolving context parameterization for large language models1 src1.3 Fine-Tuning Vision-Language Models with Listener Gaze for Referring Expressions1 src4.9 Anthropic CEO Amodei calls for slower AI development and shared safety rules11 src2.6 Agility Robotics unveils Digit 5 humanoid for warehouses and factories2 src2.4 Apple ships rebuilt Siri with Google Gemini, but not in the EU2 src2.2 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions2 src1.7 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says2 src1.3 Anthropic data retention policy prompts firms to limit Claude use for sensitive work1 src1.3 CoMem Paper Proposes Shared and Individual Memory Design for LLM Multi-Agent Systems1 src1.3 Paper proposes evolving context parameterization for large language models1 src1.3 Fine-Tuning Vision-Language Models with Listener Gaze for Referring Expressions1 src
HEATPULSEAI MAGAZINES
FLIP · FOLLOW · SAVE

ai-misuse

topic3 events
policySEP 12 13:46 UTC

Anthropic says Claude was used to help build Russian kamikaze drone swarm

Anthropic reported that accounts linked to Russian developers had used its Claude models to assist in building an autonomous kamikaze drone swarm intended for attacks on Ukraine. The company said it identified the activity and shut down the accounts under its rules against military and harmful use. The disclosure adds to concerns about how general-purpose AI chatbots can be repurposed for weapons development.

WHY IT MATTERS ↘It shows that misuse detection at the API layer is reactive rather than preventive, so safety commitments currently depend on post-hoc account bans that a determined state-linked developer can simply route around. Expect this to accelerate demands for usage monitoring, customer vetting, and export-style controls on frontier model access — compliance costs that fall hardest on smaller developers and reshape how labs compete on openness.

policySEP 12 10:30 UTC

Claude misuse spans hacking to bioweapon attempts, Wired reports

Anthropic's Claude is increasingly being abused by malicious actors, with misuse ranging from cyberattacks to attempts at developing biological weapons, according to a Wired roundup. The same briefing notes that US authorities took down a major dark-web marketplace and that a Conti ransomware operator was sentenced to prison. It also reports that Meta has struggled to remove AI-generated videos depicting child sexual abuse.

policySEP 11 05:09 UTC

Anthropic blocks accounts linked to bioweapon-related AI misuse

Anthropic has shut down accounts belonging to researchers who tried to use its Claude models for work toward biological weapons, according to a broad report on misuse attempts. The company said distinguishing harmful biology from legitimate research is difficult, since much of the underlying work looks similar. Anthropic framed the disclosure as part of wider efforts to detect and stop abuse of its systems.

WHY IT MATTERS ↘It confirms that for dual-use domains like biology, the practical control point is provider-side enforcement rather than model capability, pushing labs to invest in biosecurity classifiers, audit trails, and account-level monitoring ahead of any regulatory requirement. Because legitimate and harmful biology research can look nearly identical at the query level, vendors face a real trade-off between false positives that alienate academic users and false negatives that create liability — making verification standards a governance burden and a competitive differentiator.