ChatGPT Bots Can Be Hacked With 6 Lines of Code: Scanner Exposes the Vulnerability

BarkingDog is a security scanner for LLM-powered Telegram bots. When tested against a real open-source project, it uncovered critical vulnerabilities: the bot wrote keyloggers, gave dangerous advice and handed out hacking instructions. All of these problems can be fixed by editing the system prompt.

AI-processed from Habr AI; edited by Hamidun News
ChatGPT Bots Can Be Hacked With 6 Lines of Code: Scanner Exposes the Vulnerability
Source: Habr AI. Collage: Hamidun News.
Listen to article

Prompt injection has turned out to be a critical vulnerability in ChatGPT-powered Telegram bots. An engineer built BarkingDog, an open-source scanner that hunts for these holes, and the results are alarming.

What are prompt injections in ChatGPT?

A hacking technique in which specially crafted text bypasses a bot's built-in instructions and makes it carry out dangerous commands, from writing a keylogger to spreading disinformation.

How do you protect a ChatGPT bot from being hacked?

Based on the BarkingDog scanner's test results, there is no silver bullet. Even with built-in refusal instructions, a bot remains vulnerable to prompt injection.

Story

Key Questions Answered

What are prompt injections in ChatGPT?

A hacking technique in which specially crafted text bypasses a bot's built-in instructions and makes it carry out dangerous commands, from writing a keylogger to spreading disinformation.

How do you protect a ChatGPT bot from being hacked?

Based on the BarkingDog scanner's test results, there is no silver bullet. Even with built-in refusal instructions, a bot remains vulnerable to prompt injection.

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Hands-On AI Engineering · Hamidun Academy

Build & Ship Production AI Agents Without Boilerplate Code

Start your free 72-hour trial at Hamidun Academy (academy.hamidun.com) — interactive lessons on Claude Code & Cursor, live Tech Radar, and production agent templates.

Start 72h Free Trial →Vibe-Coding Intensive
What do you think?
Loading comments…