Point your red team tools here.
garak, PyRIT, promptfoo and the rest, set up with Wild West API as the attacker, the judge or the target, with real config and a spend cap on every key.
garakgarak is NVIDIA's open-source LLM vulnerability scanner. It fires probe prompts at a model and runs detectors over the replies, and it talks to any OpenAI-compatible endpoint through its openai.OpenAICompatible generator.
PyRITPyRIT is Microsoft's Python Risk Identification Tool for generative AI. Its multi-turn attacks need an adversarial chat model to write the next attack turn and a scorer model to judge progress, and both can be OpenAIChatTarget instances pointed at Wild West API.
promptfoopromptfoo is an open-source CLI for evals and red teaming. Its openai:chat provider accepts any model id plus a custom apiBaseUrl, so Wild West API can generate attacks, grade results or serve as the target.
DeepTeamDeepTeam is Confident AI's open-source red teaming framework built on DeepEval. It needs a simulator model to write attacks and an evaluation model to grade replies, and both can be DeepEval LocalModel objects pointed at Wild West API.
InspectInspect is the UK AI Security Institute's open-source eval framework, and inspect_evals packages ready-made safety benchmarks for it. Its openai-api provider reads a base URL and key from environment variables named after any provider label you choose.
GiskardGiskard is an open-source testing library for LLM apps and agents. Its v3 vulnerability_scan uses a generator model to write adversarial scenarios and judge the replies, and that model can be served by Wild West API.
HarmBenchHarmBench is the Center for AI Safety's standardized benchmark for automated red teaming and refusal. It ships a behavior dataset, attack methods and a fine-tuned classifier, but its API model loader only recognizes a few vendor name patterns, so an OpenAI-compatible endpoint needs a small patch.
AugustusAugustus is Praetorian's open-source LLM security scanner, a single Go binary with garak-style probes and detectors plus multi-turn attacks. Its openai.OpenAI generator accepts a base_url, so it can target Wild West API or use it as the attacker and judge.
SpikeeSpikee is WithSecure Labs' toolkit for testing LLMs, guardrails and apps against prompt injection and jailbreaks. It reaches models through any-llm, and its custom provider takes any OpenAI-compatible URL.
LLM GuardLLM Guard is Protect AI's open-source library of input and output scanners for LLM apps. The scanners run locally; Wild West API supplies the model in between, and because it does not refuse, the output scanners are tested on their own merit.