
A flexible Python library and CLI tool for interacting with Model Context Protocol (MCP) servers using any LLM model.

A CLI host application that enables Large Language Models (LLMs) to interact with external tools through the Model Context Protocol (MCP).

A powerful command-line interface for interacting with Model Context Provider servers.

Bridge between Ollama and MCP servers, enabling local LLMs to use Model Context Protocol tools.

An open-source vulnerability scanner for AI systems, focusing on safeguarding LLMs against various attacks.

PFI is a system designed to prevent privilege escalation in LLM agents by enforcing trust and tracking data flow.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more.

A curated list of awesome LLM agents frameworks.

A comprehensive library for implementing LLMs with a unified training pipeline and model evaluation.

A guidebook sharing insights and knowledge about evaluating Large Language Models (LLMs).

Automatically evaluate your LLMs in Google Colab with LLM AutoEval.

A collection of benchmarks and datasets for evaluating large language models (LLMs).