llm-security

Star

Here are 637 public repositories matching this topic...

Language: All

Filter by language

All 637 Python 343 TypeScript 76 JavaScript 28 Jupyter Notebook 25 Go 24 HTML 21 Rust 15 Shell 14 CSS 2 Dockerfile 2

Sort: Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

pathwaycom / llm-app

Star 58.1k

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. Docker-friendly.Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

machine-learning real-time chatbot pathway open-ai rag vector-database hugging-face llm llmops vector-index llm-prompting llm-security llm-local retrieval-augmented-generation

Updated Jan 7, 2026
Jupyter Notebook

NVIDIA / garak

Star 7.3k

the LLM vulnerability scanner

ai vulnerability-assessment security-scanners llm-security llm-evaluation

Updated Mar 19, 2026
HTML

NVIDIA-NeMo / Guardrails

Star 5.8k

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

python nvidia safety agents guardrails llms generative-ai llm-security llm-safety

Updated Mar 18, 2026
Python

Giskard-AI / giskard-oss

Sponsor

Star 5.2k

Open-Source Evaluation & Testing library for LLM Agents

ai-security mlops fairness-ai responsible-ai ml-validation red-team-tools trustworthy-ai ml-testing llm ai-red-team ai-testing llmops llm-security llm-eval llm-evaluation rag-evaluation agent-evaluation

Updated Mar 20, 2026
Python

verazuo / jailbreak_llms

Star 3.6k

[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).

jailbreak prompt jailbreaking llm chatgpt large-language-model llm-security

Updated Dec 24, 2024
Jupyter Notebook

Tencent / AI-Infra-Guard

Star 3.3k

A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

agent security benchmark skills mcp scanner jailbreak vulnerability-scanners security-tools mcp-scan llm ai-red-team llm-security agentskills agent-scan skills-scanner openclaw-scan clawscan

Updated Mar 20, 2026
Python

protectai / llm-guard

Star 2.7k

The Security Toolkit for LLM Interactions

transformers security-tools adversarial-machine-learning large-language-models llm prompt-engineering chatgpt llmops prompt-injection llm-security

Updated Dec 15, 2025
Python

beelzebub-labs / beelzebub

Star 1.9k

A secure low code honeypot framework, leveraging AI for System Virtualization.

go security framework mcp honeypot cybersecurity research-project llama cloudnative whitehat acis cloudsecurity deception decoys llm llm-security llm-honeypot mcp-honeypot agentic-ai-security preemptive-cybersecurity

Updated Mar 12, 2026
Go

msoedov / agentic_security

Star 1.8k

Agentic LLM Vulnerability Scanner / AI red teaming kit

agent-framework ai-red-team prompt-testing llm-security llm-vulnerabilities llm-evaluation llm-fuzzing llm-evaluation-framework llm-guardrails llm-scanner llm-jailbreaks llm-fuzzer llm-fuzzer-aggregator agent-security

Updated Feb 3, 2026
Python

cyberark / FuzzyAI

Star 1.3k

A powerful tool for automated LLM fuzzing. It is designed to help developers and security researchers identify and mitigate potential jailbreaks in their LLM APIs.

security ai jailbreak fuzzing jailbreaking llm llms ai-red-team llm-security llm-evaluation

Updated Feb 6, 2026
Jupyter Notebook

always-further / nono

Star 1.2k

Kernel-enforced agent sandbox and agent security CLI and SDKs. Capability-based isolation with secure key management, atomic rollback, cryptographic immutable audit chain of provenance. Run your agents in a zero-trust environment.

security mcp code-execution ai-agents zero-trust ai-security runtime-security supply-chain-security sigstore agent-sandbox prompt-injection llm-security llm-sandbox ai-security-tool agent-security mcp-security ai-agent-security ai-agent-sandbox

Updated Mar 20, 2026
Rust

OWASP / www-project-top-10-for-large-language-model-applications

Sponsor

Star 1.2k

OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)

ai appsec llm llm-security

Updated Feb 22, 2026
Python

splx-ai / agentic-radar

Star 929

A security scanner for your LLM agentic workflows

cli security ai mcp security-tools devsecops red-teaming ai-security llm generative-ai llm-security agentic-framework agentic-workflow agentic-ai mcp-server ai-red-teaming

Updated Nov 27, 2025
Python

EasyJailbreak / EasyJailbreak

Star 828

An easy-to-use Python framework to generate adversarial jailbreak prompts.

jailbreak discrete-optimization large-language-model llm-security llm-safety-benchmark jailbreak-framework

Updated Mar 27, 2025
Python

chawins / llm-sp

Star 567

Papers and resources related to the security and privacy of LLMs

security privacy awesome-list adversarial-machine-learning llm llm-security llm-privacy

Updated Jun 8, 2025
Python

deadbits / vigil-llm

Star 465

Vigil Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs

security-tools adversarial-machine-learning adversarial-attacks yara-scanner large-language-models llmops prompt-injection llm-security

Updated Jan 31, 2024
Python

liu00222 / Open-Prompt-Injection

Star 411

This repository provides a benchmark for prompt injection attacks and defenses in LLMs

security-and-privacy llm llms prompt-injection llm-security prompt-injection-tool

Updated Oct 29, 2025
Python

mensfeld / code-on-incus

Star 333

Run coding agents in hardened Incus containers with real-time network threat detection, automatic threat response (pause/kill), credential isolation, protected paths, session persistence, and multi-slot support.