LIVE PULSE
5.1 Anthropic CEO Amodei calls for slower AI development and shared safety rules — 11 src2.8 Agility Robotics unveils Digit 5 humanoid for warehouses and factories — 2 src2.6 Apple ships rebuilt Siri with Google Gemini, but not in the EU — 2 src2.3 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions — 2 src1.8 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns — 5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says — 2 src1.4 Anthropic data retention policy prompts firms to limit Claude use for sensitive work — 1 src1.4 Fine-Tuning Vision-Language Models with Listener Gaze for Referring Expressions — 1 src1.4 Perceptual Reality Transformer Explores What Illustrations Must Preserve — 1 src1.4 Study Analyzes Self-Reported Limitations in NLP Research — 1 src5.1 Anthropic CEO Amodei calls for slower AI development and shared safety rules — 11 src2.8 Agility Robotics unveils Digit 5 humanoid for warehouses and factories — 2 src2.6 Apple ships rebuilt Siri with Google Gemini, but not in the EU — 2 src2.3 Siri AI in macOS 27 Golden Gate: FAQ, Germany availability, privacy questions — 2 src1.8 Sam Altman says OpenAI will not go public in 2026, citing AI safety concerns — 5 src1.4 OpenAI contractors review real ChatGPT conversations to rate responses, report says — 2 src1.4 Anthropic data retention policy prompts firms to limit Claude use for sensitive work — 1 src1.4 Fine-Tuning Vision-Language Models with Listener Gaze for Referring Expressions — 1 src1.4 Perceptual Reality Transformer Explores What Illustrations Must Preserve — 1 src1.4 Study Analyzes Self-Reported Limitations in NLP Research — 1 src
HEATPULSEAI MAGAZINES
FLIP · FOLLOW · SAVE
Log inSign up

adversarial-attacks

topic9 events
papersTODAY 04:00 UTC

arXiv Paper Surveys Data Security Risks and Defenses in Large Language Models

A revised arXiv preprint reviews the data security threats that affect large language models, which underpin applications like text generation, machine translation and conversational assistants. The authors examine the vulnerabilities these systems carry and outline defensive measures along with open research directions. It is a survey-style contribution rather than a new model or product release.

llm-security/privacy/arxiv/safety
tipsYESTERDAY 16:26 UTC

Researchers Demonstrate Attacks on AI Customer Service Agents

A discussion posted to Hacker News highlights techniques for manipulating AI-powered customer service chatbots. The thread examines how these agents can be steered or exploited through crafted inputs, raising concerns about safeguards in deployed support systems. It reflects growing scrutiny of the security of autonomous agents that handle customer interactions.

agents/security/prompt-injection/safety
papersSEP 12 04:00 UTC

SMIA: Black-box Attack Targets Voice Authentication and Anti-Spoofing Systems

A new arXiv paper introduces Spectral Masking and Interpolation Attack (SMIA), a black-box adversarial method aimed at voice authentication systems and the anti-spoofing defenses that protect them. The authors note that such systems are increasingly deployed in high-security areas like banking and healthcare, where deep learning has improved accuracy but not eliminated vulnerabilities. The work is a cross-list replacement submission, meaning it revises an existing preprint.

security/adversarial-attacks/voice-authentication/research
papersSEP 10 04:00 UTC

Training-Free Edge Sanitization Method Defends Graph Neural Networks from Structural Attacks

A new arXiv paper proposes a defense for graph neural networks that strips out attacker-inserted edges from a graph's topology before inference, requiring no retraining of the model. The method relies on kernel-complexity signals to identify edges likely introduced through adversarial manipulation, and the authors support the design with theoretical guarantees. It addresses threats that target graph structure rather than node features.

graph-learning/adversarial-robustness/security/gnns
papersSEP 10 04:00 UTC

Paper evaluates adversarial training for tabular credit scoring robustness in P2P lending

Researchers have published an evaluation of how adversarial training affects the robustness of tabular machine learning credit scoring models used in peer-to-peer lending. The study tests these models against multiple attack types that simulate applicants tweaking self-reported information to influence lending decisions. The work highlights a security gap in financial ML systems that depend on user-provided inputs.

adversarial-ml/fintech/robustness/credit-scoring
papersSEP 10 04:00 UTC

Researchers Detail Agentic Group Shilling Attack Method Targeting Recommender Systems

A new arXiv paper presents a coordinated multi-agent approach for manipulating recommender systems by simulating user behavior to steer ranking outcomes. The authors report that the method can influence recommendations effectively while keeping resource costs manageable. The work highlights a security concern for platforms that depend on user-interaction data to personalize content and purchases.

agents/recommender-systems/security/research
papersSEP 10 04:00 UTC

Study Measures RAG Robustness Against Document Poisoning Attacks

A new arXiv paper examines a security weakness in retrieval-augmented generation: adversaries can inject a small number of crafted documents into the corpus a system retrieves from. The authors quantify how reliably such tampering causes a language model to repeat false statements drawn from the poisoned sources. The work underscores that grounding model outputs in retrieved text does not by itself guard against planted misinformation.

rag/security/robustness
papersSEP 10 04:00 UTC

Bit-flip attacks on vision-language-action models: vulnerability depends on action-decoding design

Researchers report the first bit-flip attack against a vision-language-action model, showing that Rowhammer-style faults can corrupt INT8 weights in deployed quantized systems. Using only a few gradient-selected bit flips, they drive the policy's closed-loop success rate down to near zero. The paper finds that a VLA model's action-decoding architecture largely determines how exposed it is to such faults.

security/safety/robotics/quantization
papersSEP 10 04:00 UTC

AgentHijack: Visual Patch Attacks on Multimodal Computer-Use Agents

A new arXiv paper introduces an end-to-end evaluation framework for testing whether a locally placed visual patch can hijack multimodal computer-use agents into executing attacker-chosen commands. Rather than stopping at model-level manipulation, the study checks whether such image-triggered injections lead to verifiable consequences in the agent's operating environment. The work adds to a growing body of research on the security risks of AI agents that control graphical interfaces.

agents/security/adversarial/benchmark