Topic

OWASP

🇷🇺Sep 24

Information Flow vs Code: The Blind Spot in AI Security

The rapid adoption of AI-generated text is creating a systemic instability in the information environment that trains large language models. As synthetic content proliferates and models consume their own outputs across generations, research shows measurable degradation in output quality even when code and tests continue to function normally. Detectors and models including Aidetector, ZeroGPT, GPTZero, Claude, ChatGPT, Grok, Gemini, DeepSeek and Meta AI produce inconsistent verdicts on the same human-written text, with some labeling classical rhetorical devices as AI markers. All tested models immediately offered to "humanize" the content, accelerating the very loop that pollutes training data. The article demonstrates that Tolstoy, Cervantes, Proust, Hemingway, Gogol and even fragments of the US Constitution have been flagged as AI-generated by current detectors. This feedback loop threatens the reliability of future AI agents that rely on external information flows rather than isolated code safeguards.

Habr•AI Security
🇷🇺Aug 7

AI Agents Given Code and API Access Can Now Assist Attackers

An AI assistant that only answers questions can make mistakes, but an AI agent with access to email, code execution, corporate APIs and internal data can make those mistakes inside production infrastructure. The difference is fundamental: once tools, credentials and internal data are connected to the model, it becomes a privileged user that may not distinguish legitimate commands from hidden instructions on a web page. OWASP lists prompt injection, sensitive data disclosure, unsafe output handling and excessive autonomy as key risks for LLM applications. MITRE ATLAS specifically describes techniques involving prompt injection, context poisoning and tool invocation by AI agents. The article examines how agents differ from chatbots, how attackers can control them through untrusted content, and why a system prompt alone cannot protect code, data and APIs. CyberED is running its free NeuroAugust series of events and materials on AI in cybersecurity, including a session on secure AI system development.

Securitylab•AI Security
🇷🇺Aug 6

Prompt Injection Emerges as Top Risk for LLM Applications in Production

Prompt injection attacks are moving from theoretical demonstrations to real-world exploits targeting AI assistants in enterprise environments. Attackers embed malicious instructions in emails, documents, and code comments that override developer rules when models process untrusted input. Incidents involving Microsoft 365 Copilot, GitHub Copilot, and Cursor have shown data exfiltration and remote code execution risks with severity scores above 9.0. The core issue stems from the lack of strict boundaries between trusted system prompts and untrusted external content fed into large language models. Defenses require layered controls including code-enforced permissions, input filtering, human confirmation for high-risk actions, and explicit marking of external data. Major vendors including OpenAI, Anthropic, and Google acknowledge that no single static defense can fully eliminate the threat. OWASP ranks prompt injection as the leading risk for LLM applications, urging organizations to treat AI agents as systems with untrusted inputs.

Habr•AI Security
🇷🇺Jul 31

Bots Now Form Over Half of Global Internet Traffic in 2025, Driving API Attacks and Business Metric Distortion

Automated clients generated more than 50% of analyzed internet traffic in 2025, with malicious bots responsible for 40% of the total volume. AI-enabled automation attacks increased 12.5 times year-over-year, while daily API attacks rose 113% according to Akamai data. Simple scripts still dominate volume at 59% of bot traffic, yet sophisticated botnets exceeding 4.5 million devices now distribute activity across residential proxies and compromised endpoints. Credential stuffing, scraping, and transaction abuse continue to target business logic rather than software vulnerabilities, distorting analytics, inflating infrastructure costs, and degrading user experience. Cloudflare reports that 20% of verified bot traffic now comes from AI crawlers, blurring lines between beneficial and harmful automation. Organizations must classify bots by intent, delegation, and business impact instead of relying on IP reputation or single signals such as User-Agent strings.

Habr•Malware & Botnets
🇷🇺Jul 28

Pilcrow Publishes Free Comprehensive Guide on Web Authentication

Author Pilcrow has released a detailed, ad-free handbook covering authentication and authorization practices for web applications. The resource draws on personal experience and includes practical examples in JavaScript and Go. It examines password-based methods, email verification, multi-factor authentication, passwordless flows, and passkeys while highlighting associated risks and usability trade-offs. The book also provides in-depth guidance on session management, token security, expiration policies, and email address handling as account identifiers. Recommendations emphasize choosing methods that match application security requirements and user expectations. Additional context is given on OWASP resources and community support channels.

Habr•Other