Blog
Prompt Airlines – AI Security Challenge – Flag 5
In this video we take a look at solving the promptairlines.com challenge (Flag 5) https://youtu.be/MPUwxjWGBQE
Read More
Prompt Airlines – AI Security Challenge – Flag 4
In this video we take a look at solving the promptairlines.com challenge (Flag 4) https://youtu.be/jDlTlWLdmaw
Read More
Prompt Airlines – AI Security Challenge – Flag 3
In this video we take a look at solving the promptairlines.com challenge (Flag 3) https://youtu.be/qrNFMPwJ9FQ
Read More
Prompt Airlines – AI Security Challenge – Flag 1 and 2
In this video we take a look at solving the promptairlines.com challenge (Flag 1 and...
Read More
Prompt leakage and indirect prompt injections in Grok X AI
In this video we will take a look at various prompt injection issues in Grok...
Read More
myllmbank.com Walkthrough Flag 3
In this video we will take a look at flag 3 of myllmbank.com https://youtu.be/dqXDV-mW0aA
Read More
myllmbank.com Walkthrough Flag 2
In this video we will take a look at flag 2 of myllmbank.com https://youtu.be/_PIoWmPlxYQ
Read More
myllmbank.com Walkthrough Flag 1
In this video we will take a look at flag 1 of myllmbank.com https://youtu.be/WWaRZR3dv4U
Read More
SecOps Group AI/ML Pentester Mock Exam 2
This is a walkthrough of the SecOps Group AI/ML Pentester Mock Exam 2 https://youtu.be/zX2GtI4Fj_Y
Read More
SecOps Group AI/ML Pentester Mock Exam 1
This is a walkthrough of SecOps Group AI/ML Pentester Mock Exam 1 https://youtu.be/UoSAjlUUiPs
Read More
CSRF potential in LLMs
Cross-Site Request Forgery (CSRF) via prompt injection through a GET request is a potential attack...
Read More
Prompt Injection via clipboard
Prompt injection via clipboard copy/paste is a security concern where malicious text, copied into a...
Read More
Hero AI Bot
This project is a proof of concept for a Hackbot, an AI-driven system that autonomously...
Read More
KONTRA OWASP LLM Top 10 Playground
ONTRA offers an interactive training module titled "OWASP Top 10 for Large Language Model (LLM)...
Read More
Pokebot Health Agent to practice prompt injection
A simple Health Agent to practice prompt injection https://youtu.be/dLS5a_fWBjw
Read More
Certified AI/ML Penetration Tester
The Certified AI/ML Pentester (C-AI/MLPen) is an intermediate-level certification offered by The SecOps Group, designed...
Read More
Image Prompt injection and double instructions
Prompt injection via images involves embedding hidden or overt textual commands within visual elements to...
Read More
OpenAI Playground
The OpenAI Playground is an interactive web-based platform that allows users to experiment with OpenAI's...
Read More
Prompt injection and exfiltration in Chats apps
Data exfiltration in messaging apps through unfurling exploits the feature where apps automatically generate previews...
Read More
Gandalf – AI bot to practice prompt injections
Gandalf AI, developed by Lakera, is an interactive online game designed to educate users about...
Read More
Google Colab Playground for LLMs
Google Colaboratory, commonly known as Google Colab, is a cloud-based Jupyter notebook environment that facilitates...
Read More
STRIDE GPT – Threat Modeling with LLMs
STRIDE GPT is an AI-powered threat modeling tool that leverages Large Language Models (LLMs) to...
Read More
OS Command Injection in LLMs
OS command injection in Large Language Models (LLMs) involves exploiting the model's ability to generate...
Read More
Hallucinations in LLMs
Hallucination in AI refers to the phenomenon where a model generates information that appears plausible...
Read More
Prompt Injection – Prompt Leakage
Prompt leakage refers to the unintended exposure of sensitive or proprietary prompts used to guide...
Read More
HTML Injection in LLMs
HTML injection in Large Language Models (LLMs) involves embedding malicious HTML code within prompts or...
Read More
RAG data poisoning via documents in ChatGPT
RAG (Retrieval-Augmented Generation) poisoning occurs when a malicious or manipulated document is uploaded to influence...
Read More
RAG data poisoning in ChatGPT
RAG (Retrieval-Augmented Generation) poisoning from a document uploaded involves embedding malicious or misleading data into...
Read More
Deleting ChatGPT memories via prompt injection
Deleting memories in AI refers to the deliberate removal of stored information or context from...
Read More
Updating ChatGPT memories via prompt injection
Injecting memories into AI involves deliberately embedding specific information or narratives into the system's retained...
Read More
Putting ChatGPT into maintenance mode
Prompt injection to manipulate memories involves crafting input that exploits the memory or context retention...
Read More
Voice prompting in ChatGPT
Voice prompt injection is a method of exploiting vulnerabilities in voice-activated AI systems by embedding...
Read More
Use AI to extract code from images
Using AI to extract code from images involves leveraging Optical Character Recognition (OCR) technology and...
Read More
Generating images with embedded prompts
Prompt injection via images is a sophisticated technique where malicious or unintended commands are embedded...
Read More
Access LLMs from the Linux CLI
The llm project by Simon Willison, available on GitHub, is a command-line tool designed to interact with...
Read More
AI/LLM automated Penetration Testing Bots
Autonomous AI/LLM Penetration Testing bots are a cutting-edge development in cybersecurity, designed to automate the...
Read More
Prompt injection to generate content which is normally censored
Prompt injection is a technique used to manipulate AI language models by inserting malicious or...
Read More
Creating hidden prompts
Hidden or transparent prompt injection is a subtle yet potent form of prompt injection that...
Read More
Data Exfiltration with markdown in LLMs
Data exfiltration through markdown in LLM chatbots is a subtle but dangerous attack vector. When...
Read More
Prompt Injection with ASCII to Unicode Tags
ASCII to Unicode tag conversion is a technique that can be leveraged to bypass input...
Read More
LLM Expert Prompting Framework – Fabric
Fabric is an open-source framework for augmenting humans using AI. It provides a modular framework...
Read More
LLMs, datasets and playgrounds (Huggingface)
Hugging Face is a prominent company in the field of artificial intelligence and natural language...
Read More
Free LLMs on replicate.com
Replicate.com is a platform designed to simplify the deployment and use of machine learning models....
Read More
GitHub repos with prompt injection samples
This video is a walkthrough some of the GitHub repos which have prompt injection samples....
Read More
Prompt Injection with encoded prompts
Prompt injection with encoded prompts involves using various encoding methods (such as Base64, hexadecimal, or...
Read More
Voice Audio Prompt Injection
Prompt injection via voice and audio is a form of attack that targets AI systems...
Read More
Prompt injection to generate any image
Prompt injection in image generation refers to the manipulation of input text prompts to produce...
Read More
LLM system prompt leakage
Large Language Model (LLM) prompt leakage poses a significant security risk as it can expose...
Read More
ChatGPT assumptions made
ChatGPT, like many AI models, operates based on patterns it has learned from a vast...
Read More
Jailbreaking to generate undesired images
Direct prompt injection and jailbreaking are two techniques often employed to manipulate large language models...
Read More