
Simple, unified interface to multiple Generative AI providers.

Pocket Flow is a 100-line minimalist LLM framework that allows AI Agents to build Agents for enhanced productivity.

The official Python SDK for Model Context Protocol servers and clients.

A Datacenter Scale Distributed Inference Serving Framework for generative AI and reasoning models.

Hybrid thinking tool for efficient AI model integration in open-webui.

Promptfoo is a local tool for testing LLM applications with security evaluations and performance comparisons.

AutoAudit is a large language model (LLM) designed for enhancing cybersecurity through advanced AI-driven threat detection and response.

A curated list of tools, datasets, demos, and papers for evaluating large language models (LLMs).

Sample notebooks and prompts for evaluating large language models (LLMs) and generative AI.