镜像站点 · 本页由第三方 GitHub 只读镜像提供,非 GitHub 官方站点,不接受任何登录或凭据输入。前往 github.com
Skip to content

[bot] Instrument Guardrails AI (30,625 weekly downloads) #807

Closed as not planned
Closed as not planned

Description

@braintrust-bot

Summary

guardrails-ai (import name guardrails, by Guardrails AI Inc.) is a framework for adding structural, type, and quality validation directly around LLM calls. Its primary execution surfaces are Guard.for_pydantic(output_class=...) / Guard().use(<validators>) to construct a guard, and then the callable form guard(model=..., messages=[...]), which invokes the LLM directly and returns a response with .validated_output — i.e. the Guard itself owns the LLM call, not just post-hoc validation of already-generated text. guard.parse(...) is the sibling entrypoint for validating a given string against attached validators.

This is a distinct project/package from NVIDIA NeMo Guardrails (nemoguardrails, tracked separately in #768) — different maintainer, different PyPI package, different API shape (Guard/validators around a direct LLM call vs. NeMo's LLMRails rails pipeline). This repository has zero instrumentation for Guardrails AI anywhere: no py/src/braintrust/integrations/guardrails* directory, no wrapper, no nox session, no cassette directory, and no entry in py/pyproject.toml's [tool.braintrust.matrix].

What's missing

  • guard(model=..., messages=[...]) (and async variant) — the primary "guarded LLM call" entrypoint; since Guardrails AI drives the LLM call itself, an unwrapped call here means the underlying model call, validated output, and any validator retries are entirely invisible to Braintrust tracing.
  • guard.parse(...) / guard.parse_async(...) — validates a given string against attached validators, returning a result with .validation_passed.
  • Guard.for_pydantic(output_class=...) / Guard().use(<validators>) — guard construction with attached validators (useful for capturing validator configuration as metadata on the guarded-call span).

Weekly downloads

Weekly downloads: 30,625 (as of 2026-09-28; https://pypistats.org/api/packages/guardrails-ai/recent)

Braintrust docs status

not_found. Checked https://www.braintrust.dev/docs/guides/tracing and https://www.braintrust.dev/docs/guides/tracing/integrations (both checked 2026-09-28) — neither the tracing-integrations list ("OpenTelemetry, Temporal, Vercel AI SDK, OpenRouter SDK, LangChain, LangChain4j, LangSmith, LlamaIndex, Apollo GraphQL, Cloudflare Workers AI, DSPy, Google Discovery Engine, Instructor, LiteLLM, Ruby LLM, Spring AI, Traceloop, TrueFoundry") nor the agent-framework list mentions Guardrails AI or Guardrails.

Upstream sources

Braintrust docs sources checked

Local repo files inspected

  • py/src/braintrust/integrations/ — no guardrails/ directory (only unrelated py/src/braintrust/integrations/__init__.py and the separately-tracked nemoguardrails gap in [bot] Instrument NVIDIA NeMo Guardrails (149,615 weekly downloads) #768)
  • py/src/braintrust/wrappers/ — no Guardrails AI wrapper
  • py/pyproject.toml [tool.braintrust.matrix] — no guardrails-ai entry
  • py/noxfile.py — no test_guardrails session
  • Repo-wide case-insensitive grep for guardrails.ai/guardrails_ai under py/src/braintrust/**/*.py — zero matches

Activity

  1. AbhiPrasad commented on Oct 14, 2026

    @AbhiPrasad
    Member

    Closing as not planned. Guardrails AI is low adoption (~31k weekly downloads) and its LLM calls go through litellm/openai, which are already traced.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions