Folly

Folly: Open-source LLM Prompt-Injection and Jailbreaking Playground

Folly is a professional toolkit designed for assessing prompt injection vulnerabilities and security boundaries in Large Language Models (LLMs). Providing security professionals, developers, and researchers with a comprehensive framework, Folly facilitates the evaluation of LLM security postures through standardized challenges and attack simulations.

Key Features:

• Interactive Testing Framework: Evaluate responses to potential prompt injection techniques.
• Multi-Provider Support: Test various LLM services with a consistent methodology.
• Challenge Library: Access pre-built security scenarios with configurable parameters.
• User Interfaces: Utilize a web interface for easy testing or a command line interface for a terminal-based experience.
• API-First Design: Automate testing through extensive API endpoints.
• CLI Commands: Features interactive command-driven conversation and rich formatting for challenge responses.

Benefits:

• Enhances security testing capabilities for LLMs.
• Provides an environment conducive to learning and understanding security vulnerabilities related to AI models.
• Facilitates contribution, with an open-source approach to improving and expanding functionalities.