Blog
Hero AI Bot
This project is a proof of concept for a Hackbot, an AI-driven system that autonomously...
Read More
KONTRA OWASP LLM Top 10 Playground
ONTRA offers an interactive training module titled "OWASP Top 10 for Large Language Model (LLM)...
Read More
Pokebot Health Agent to practice prompt injection
A simple Health Agent to practice prompt injection https://youtu.be/dLS5a_fWBjw
Read More
Certified AI/ML Penetration Tester
The Certified AI/ML Pentester (C-AI/MLPen) is an intermediate-level certification offered by The SecOps Group, designed...
Read More
Image Prompt injection and double instructions
Prompt injection via images involves embedding hidden or overt textual commands within visual elements to...
Read More
OpenAI Playground
The OpenAI Playground is an interactive web-based platform that allows users to experiment with OpenAI's...
Read More
Prompt injection and exfiltration in Chats apps
Data exfiltration in messaging apps through unfurling exploits the feature where apps automatically generate previews...
Read More
Gandalf – AI bot to practice prompt injections
Gandalf AI, developed by Lakera, is an interactive online game designed to educate users about...
Read More
Google Colab Playground for LLMs
Google Colaboratory, commonly known as Google Colab, is a cloud-based Jupyter notebook environment that facilitates...
Read More
STRIDE GPT – Threat Modeling with LLMs
STRIDE GPT is an AI-powered threat modeling tool that leverages Large Language Models (LLMs) to...
Read More
OS Command Injection in LLMs
OS command injection in Large Language Models (LLMs) involves exploiting the model's ability to generate...
Read More
Hallucinations in LLMs
Hallucination in AI refers to the phenomenon where a model generates information that appears plausible...
Read More
Prompt Injection – Prompt Leakage
Prompt leakage refers to the unintended exposure of sensitive or proprietary prompts used to guide...
Read More
HTML Injection in LLMs
HTML injection in Large Language Models (LLMs) involves embedding malicious HTML code within prompts or...
Read More
RAG data poisoning via documents in ChatGPT
RAG (Retrieval-Augmented Generation) poisoning occurs when a malicious or manipulated document is uploaded to influence...
Read More
RAG data poisoning in ChatGPT
RAG (Retrieval-Augmented Generation) poisoning from a document uploaded involves embedding malicious or misleading data into...
Read More
Deleting ChatGPT memories via prompt injection
Deleting memories in AI refers to the deliberate removal of stored information or context from...
Read More
Updating ChatGPT memories via prompt injection
Injecting memories into AI involves deliberately embedding specific information or narratives into the system's retained...
Read More
Putting ChatGPT into maintenance mode
Prompt injection to manipulate memories involves crafting input that exploits the memory or context retention...
Read More
Voice prompting in ChatGPT
Voice prompt injection is a method of exploiting vulnerabilities in voice-activated AI systems by embedding...
Read More
Use AI to extract code from images
Using AI to extract code from images involves leveraging Optical Character Recognition (OCR) technology and...
Read More
Generating images with embedded prompts
Prompt injection via images is a sophisticated technique where malicious or unintended commands are embedded...
Read More
Access LLMs from the Linux CLI
The llm project by Simon Willison, available on GitHub, is a command-line tool designed to interact with...
Read More
AI/LLM automated Penetration Testing Bots
Autonomous AI/LLM Penetration Testing bots are a cutting-edge development in cybersecurity, designed to automate the...
Read More
Prompt injection to generate content which is normally censored
Prompt injection is a technique used to manipulate AI language models by inserting malicious or...
Read More
Creating hidden prompts
Hidden or transparent prompt injection is a subtle yet potent form of prompt injection that...
Read More
Data Exfiltration with markdown in LLMs
Data exfiltration through markdown in LLM chatbots is a subtle but dangerous attack vector. When...
Read More
Prompt Injection with ASCII to Unicode Tags
ASCII to Unicode tag conversion is a technique that can be leveraged to bypass input...
Read More
LLM Expert Prompting Framework – Fabric
Fabric is an open-source framework for augmenting humans using AI. It provides a modular framework...
Read More
LLMs, datasets and playgrounds (Huggingface)
Hugging Face is a prominent company in the field of artificial intelligence and natural language...
Read More
Free LLMs on replicate.com
Replicate.com is a platform designed to simplify the deployment and use of machine learning models....
Read More
GitHub repos with prompt injection samples
This video is a walkthrough some of the GitHub repos which have prompt injection samples....
Read More
Prompt Injection with encoded prompts
Prompt injection with encoded prompts involves using various encoding methods (such as Base64, hexadecimal, or...
Read More
Voice Audio Prompt Injection
Prompt injection via voice and audio is a form of attack that targets AI systems...
Read More
Prompt injection to generate any image
Prompt injection in image generation refers to the manipulation of input text prompts to produce...
Read More
LLM system prompt leakage
Large Language Model (LLM) prompt leakage poses a significant security risk as it can expose...
Read More
ChatGPT assumptions made
ChatGPT, like many AI models, operates based on patterns it has learned from a vast...
Read More
Jailbreaking to generate undesired images
Direct prompt injection and jailbreaking are two techniques often employed to manipulate large language models...
Read More
Indirect Prompt Injection with Data Exfiltration
Indirect prompt injection with data exfiltration via markdown image rendering is a sophisticated attack method...
Read More
Direct Prompt Injection / Information Disclosure
Direct Prompt Injection is a technique where a user inputs specific instructions or queries directly into...
Read More
LLM Prompting with emojis
Prompting via emojis is a communication technique that uses emojis to convey ideas, instructions, or...
Read More
Prompt Injection via image
In this video I will explain prompt injection via an image. The LLM is asked...
Read More
AI Security Expert Blog
Welcome. In this blog we will regularly publish blog articles around Penetration Testing and Ethical...
Read More