Skip to content
J·BJon BishopFractional growth marketer

Artificial intelligence · llms.txt file breakdown

Fiddler AI llms.txt

A directly retrieved Markdown index for Fiddler AI's documentation, with 111 links across 35 detected headings.

The actual file

Source Markdown

The saved llms.txt text, displayed as source. The file belongs to its publisher; the live endpoint may change.

Open saved text ↗

Showing the first 18000 characters. Load the complete file to read the remainder.

# Fiddler Documentation

> Unified observability for trustworthy AI across traditional ML, LLM applications, autonomous agents, and self-hosted deployments.

- [Documentation (111 pages)](https://docs.fiddler.ai/_llms/documentation.txt): Documentation for Documentation.

## Integrations

- [Integrations](https://docs.fiddler.ai/integrations/index.md)

### Agentic AI & LLM Frameworks

#### Agentic AI Overview

- [Agentic AI Overview](https://docs.fiddler.ai/integrations/agentic-ai-and-llm-frameworks/agentic-ai.md): Native SDKs and framework integrations for agentic AI and LLM applications
- [Span and Resource Attributes](https://docs.fiddler.ai/integrations/agentic-ai/attributes.md): Understand how Fiddler uses span and resource attributes from OpenTelemetry traces — required vs optional fields, typing, custom attributes, and how attributes flow into metrics, alerts, and dashboards.
- [Claude Code Integration](https://docs.fiddler.ai/integrations/agentic-ai/claude-code-integration.md): Integrate Claude Code with Fiddler for coding agent observability — track LLM calls, tool usage, user prompts, and session behavior via OpenTelemetry traces.
- [Fiddler Claude Code Plugin](https://docs.fiddler.ai/integrations/agentic-ai/fiddler-claude-code-plugin.md): Install, upgrade, and configure the Fiddler Claude Code plugin to capture per-turn OpenTelemetry traces (including LLM responses and tool input/output) from Claude Code sessions and deliver them to Fiddler.
- [Fiddler Google ADK SDK](https://docs.fiddler.ai/integrations/agentic-ai/google-adk-sdk.md): Native monitoring for Google ADK agents with Fiddler's purpose-built SDK
- [Fiddler LangGraph SDK](https://docs.fiddler.ai/integrations/agentic-ai/langgraph-sdk.md): Instrument LangGraph agents and custom AI applications with Fiddler's native SDK
- [Fiddler Strands SDK](https://docs.fiddler.ai/integrations/agentic-ai/strands-sdk.md): Native monitoring for Strands Agents with Strands Agents SDK
- [Fiddler Evals SDK](https://docs.fiddler.ai/integrations/agentic-ai/evals-sdk.md): LLM experiments framework with pre-built evaluators and custom metrics
- [OpenTelemetry Integration](https://docs.fiddler.ai/integrations/agentic-ai/opentelemetry-integration.md): Connect custom AI agents and multi-framework agentic applications to Fiddler using OpenTelemetry's OTLP protocol for comprehensive observability.
- [Fiddler OTel SDK](https://docs.fiddler.ai/integrations/agentic-ai/fiddler-otel-sdk.md): Instrument any Python AI agent or LLM application with Fiddler's core OpenTelemetry SDK
- [Fiddler LangChain SDK](https://docs.fiddler.ai/integrations/agentic-ai/langchain-sdk.md): Instrument LangChain V1 agents with Fiddler observability
- [Fiddler MCP Server](https://docs.fiddler.ai/integrations/agentic-ai/mcp-server.md): Connect MCP-compatible AI assistants to Fiddler's GenAI observability platform and query applications, traces, evaluators, metrics, and more using the Fiddler MCP Server.
- [Exporting OTel Traces to Fiddler](https://docs.fiddler.ai/integrations/agentic-ai/otel-trace-export.md): Map pre-existing OpenTelemetry span attributes to Fiddler's schema and export them to the v1/traces protobuf endpoint from your own storage or pipeline.
- [Multi-Application Trace Routing](https://docs.fiddler.ai/integrations/agentic-ai/multi-application-trace-routing.md): Send OpenTelemetry traces for many Fiddler applications through one endpoint and one API key. Fiddler authorizes and routes each span by its application.id, so a single shared pipeline can serve every application.
- [S3 Trace Ingestion](https://docs.fiddler.ai/integrations/agentic-ai/s3-trace-ingestion.md): Ingest pre-generated OTLP trace files from Amazon S3 into Fiddler without modifying your application code. Ideal for ECS Fargate, air-gapped environments, or any architecture where direct SDK integration is not possible.

##### AI Gateway Integrations

- [AI Gateway Integrations](https://docs.fiddler.ai/integrations/agentic-ai/ai-gateways.md): How Fiddler plugs into a third-party AI gateway (Kong, AgentGateway, LiteLLM, Portkey) for observability and guardrail enforcement — and how that differs from the Fiddler LLM Gateway.
- [AgentGateway Integration](https://docs.fiddler.ai/integrations/agentic-ai/agentgateway-integration.md): Integrate AgentGateway with Fiddler for zero-instrumentation LLM observability — no application code changes required.
- [Kong AI Gateway Integration](https://docs.fiddler.ai/integrations/agentic-ai/kong-integration.md): Integrate Kong AI Gateway with Fiddler for zero-instrumentation LLM observability — no application code changes required.
- [LiteLLM Integration](https://docs.fiddler.ai/integrations/agentic-ai/litellm-integration.md): Integrate LiteLLM with Fiddler for unified LLM cost tracking, latency monitoring, and LLM call observability — via the LiteLLM SDK or the LiteLLM proxy gateway.
- [Portkey AI Gateway Integration](https://docs.fiddler.ai/integrations/agentic-ai/portkey-integration.md): Integrate Portkey AI Gateway with Fiddler for zero-instrumentation LLM observability — no application code changes required.

### Data Platforms & Pipelines

#### Data Platforms Overview

- [Data Platforms Overview](https://docs.fiddler.ai/integrations/data-platforms-and-pipelines/data-platforms.md): Connect Fiddler to data warehouses, streaming platforms, and ML pipelines
- [Snowflake](https://docs.fiddler.ai/integrations/data-platforms/snowflake-integration.md): Learn how to extract baseline or production data from Snowflake for model onboarding and publishing production data to Fiddler for ML and LLM monitoring.
- [BigQuery](https://docs.fiddler.ai/integrations/data-platforms/bigquery-integration.md): Discover BigQuery integration with Fiddler. Learn how to load ML data from BigQuery tables and use it for tasks like publishing production data to Fiddler.
- [Apache Kafka](https://docs.fiddler.ai/integrations/data-platforms/kafka-integration.md): Dive into Fiddler’s Kafka connector services. Learn about prerequisites, installation, and limitations to manage production events and publish them to Fiddler.
- [Amazon S3](https://docs.fiddler.ai/integrations/data-platforms/integration-with-s3.md): Effortlessly extract AWS S3 data for model onboarding and inference publishing to Fiddler for monitoring.
- [Apache Airflow](https://docs.fiddler.ai/integrations/data-platforms/airflow-integration.md): Discover how to integrate Fiddler with an Airflow DAG for your ML pipeline, enabling you to train, manage, onboard models, and monitor performance seamlessly.
- [SageMaker Pipelines](https://docs.fiddler.ai/integrations/data-platforms/sagemaker-integration.md): Learn how integrating SageMaker with Fiddler simplifies model monitoring. Explore our guide on using AWS Lambda with the Fiddler Python client.

### ML Platforms & Tools

#### ML Platforms Overview

- [ML Platforms Overview](https://docs.fiddler.ai/integrations/ml-platforms-and-tools/ml-platforms.md): Integrate Fiddler with MLOps platforms, experiment tracking tools, and ML frameworks
- [Databricks](https://docs.fiddler.ai/integrations/ml-platforms/databricks-integration.md): Discover how Fiddler helps monitor, explain, and analyze models in Databricks Workspace. Integrate with MLFlow and Spark to manage, validate, and monitor models.
- [MLflow](https://docs.fiddler.ai/integrations/ml-platforms/ml-flow-integration.md): Explore how Fiddler helps your team onboard, monitor, explain, and analyze models with MLFlow. Learn to ingest model metadata and artifacts for observability.

### Cloud Platforms & Deployment

- [Cloud Platforms Overview](https://docs.fiddler.ai/integrations/cloud-platforms-and-deployment/cloud-platforms.md): Deploy and operate Fiddler natively on leading cloud platforms

#### AWS SageMaker Partner AI App

- [AWS SageMaker Partner AI App](https://docs.fiddler.ai/integrations/cloud-platforms-and-deployment/aws-sagemaker.md): Run Fiddler AI Observability platform within Amazon SageMaker as a Partner AI App. Procure, provision, and securely operate Fiddler seamlessly all within your existing AWS account.
- [Quick Setup Script](https://docs.fiddler.ai/integrations/aws-sagemaker/partner-ai-app-quick-setup-script.md): Quickly set up Fiddler's Partner AI App on SageMaker with our script. Automates IAM roles, permissions, and configuration for fast deployment.
- [Admin Guide](https://docs.fiddler.ai/integrations/aws-sagemaker/partner-ai-app-admin-guide.md): Admin guide to deploy the Fiddler Partner AI App on AWS SageMaker. Configure IAM roles, permissions, and subscriptions for secure AI systems observability.
- [User Guide](https://docs.fiddler.ai/integrations/aws-sagemaker/partner-ai-app-user-guide.md): User guide for Fiddler on AWS SageMaker. Learn to use the Fiddler UI and Python SDK to monitor, explain, and analyze your models and GenAI apps.

### Monitoring & Alerting

#### Monitoring & Alerting Overview

- [Monitoring & Alerting Overview](https://docs.fiddler.ai/integrations/monitoring-and-alerting/monitoring-alerting.md): Connect Fiddler alerts to incident management, observability, and communication tools
- [Datadog](https://docs.fiddler.ai/integrations/monitoring-alerting/datadog-integration.md): Learn about Fiddler’s Datadog integration to bring AI Observability metrics into your dashboards. Follow steps to centralize ML model and application monitoring.
- [PagerDuty](https://docs.fiddler.ai/integrations/monitoring-alerting/pagerduty.md): Discover how customer churn prediction works with Fiddler’s AI observability platform. Follow our example to detect and diagnose issues step by step.

## Developers

### Overview

- [Overview](https://docs.fiddler.ai/developers/index.md)

### Platform

- [Get Started in <10 Minutes](https://docs.fiddler.ai/developers/quick-starts/get-started-in-less-than-10-minutes.md): Choose your integration path and get started with Fiddler in under 10 minutes

### Agentic AI Monitoring

- [Google ADK SDK Quick Start](https://docs.fiddler.ai/developers/quick-starts/google-adk-quick-start.md): Learn how to integrate Google ADK agents with Fiddler using the Fiddler ADK SDK for automatic instrumentation and comprehensive observability.
- [LangGraph SDK Quick Start](https://docs.fiddler.ai/developers/quick-starts/langgraph-sdk-quick-start.md): Monitor AI agent behavior in LangGraph and LangChain applications. Fiddler LangGraph SDK provides real-time observability for GenAI workflows and debugging.
- [LangChain SDK Quick Start](https://docs.fiddler.ai/developers/quick-starts/langchain-sdk-quick-start.md): Monitor AI agent behavior in LangChain V1 applications. The Fiddler LangChain SDK provides real-time observability for `create_agent`-based workflows and middleware pipelines.
- [Strands Agent SDK Quick Start](https://docs.fiddler.ai/developers/quick-starts/strands-agent-quick-start.md): Learn how to integrate Strands agents with Fiddler using the Fiddler Strands SDK for automatic instrumentation and comprehensive observability of your AI agent workflows.
- [OpenTelemetry Quick Start](https://docs.fiddler.ai/developers/quick-starts/opentelemetry-quick-start.md): Integrate custom AI agents and agentic frameworks with Fiddler using OpenTelemetry for comprehensive observability and monitoring in multi-framework environments.

### LLM Monitoring

- [Simple LLM Monitoring](https://docs.fiddler.ai/developers/quick-starts/simple-llm-monitoring.md): Learn the basic onboarding steps to use Fiddler for monitoring LLM applications. Access Google Colab or download the notebook directly from GitHub.

### ML Monitoring

- [Simple ML Monitoring](https://docs.fiddler.ai/developers/quick-starts/simple-ml-monitoring.md): This document provides a guide for using Fiddler for model monitoring using sample data provided by Fiddler.

### Experiments

- [Experiments Quick Start](https://docs.fiddler.ai/developers/quick-starts/experiments-quick-start.md): Quick start guide for running experiments on LLM applications using the Fiddler Evals SDK

### Guardrails

- [Guardrails Quick Start](https://docs.fiddler.ai/developers/quick-starts/guardrails-quick-start.md): Get started with Fiddler Guardrails to protect your LLM applications from harmful content, PII leaks, and hallucinations

### Cookbooks

- [Overview](https://docs.fiddler.ai/developers/cookbooks/cookbooks.md): Use-case oriented guides for solving real-world AI evaluation and monitoring problems with Fiddler.
- [RAG Evaluation Fundamentals](https://docs.fiddler.ai/developers/cookbooks/rag-evaluation-fundamentals.md): Evaluate RAG application quality using Fiddler's built-in evaluators with direct scoring for rapid iteration on retrieval and generation quality.
- [Running RAG Experiments at Scale](https://docs.fiddler.ai/developers/cookbooks/rag-experiments-at-scale.md): Run structured RAG experiments with Datasets, golden label validation, and side-by-side comparison of pipeline configurations.
- [Building Custom Judge Evaluators](https://docs.fiddler.ai/developers/cookbooks/custom-judge-evaluators.md): Build domain-specific LLM-as-a-Judge evaluators using CustomJudge with prompt templates, structured output fields, and iterative prompt improvement.
- [Detecting Hallucinations in RAG](https://docs.fiddler.ai/developers/cookbooks/hallucination-detection-pipeline.md): Build a complete hallucination detection pipeline combining Evals SDK evaluation with LLM Observability enrichments for continuous RAG monitoring.
- [Monitoring Agentic Content Generation](https://docs.fiddler.ai/developers/cookbooks/agentic-content-generation.md): Monitor agentic content generation for quality, safety, and brand compliance using built-in evaluators and custom LLM-as-a-Judge scoring.
- [Agentic Document Extraction](https://docs.fiddler.ai/developers/cookbooks/agentic-document-extraction.md): Build observable, measurable document extraction pipelines using Fiddler's agentic tracing, custom evaluators, and experiments.
- [AI Security](https://docs.fiddler.ai/developers/cookbooks/ai-security.md): Monitor for AI security concerns using built-in evaluators and custom LLM-as-a-Judge scoring.
- [Tracking Bias and Accuracy Across Cohorts](https://docs.fiddler.ai/developers/cookbooks/bias-and-accuracy.md): Track GenAI accuracy and bias across protected cohorts using Fiddler out-of-the-box evaluators, custom LLM-as-a-Judge scoring, and segment-based fairness analysis.

### Tutorials

#### Agentic & LLM Monitoring

- [Agentic & LLM Monitoring](https://docs.fiddler.ai/developers/tutorials/llm-monitoring.md)
- [LangGraph SDK Advanced](https://docs.fiddler.ai/developers/tutorials/llm-monitoring/langgraph-sdk-advanced.md): Advanced observability patterns for LangGraph applications including multi-agent workflows, conversation tracking, and production configuration.

#### Experiments

- [Experiments](https://docs.fiddler.ai/developers/tutorials/experiments.md): Master LLM and AI application experiments with comprehensive tutorials covering the Fiddler Evals SDK, custom evaluators, model comparison, and custom experiment creation.
- [Evals SDK Advanced Guide](https://docs.fiddler.ai/developers/tutorials/experiments/evals-sdk-advanced.md): Advanced experiment patterns for production LLM applications including multi-score evaluators, complex parameter mapping, and comprehensive experiment analysis.
- [Advanced Prompt Specs](https://docs.fiddler.ai/developers/tutorials/llm-monitoring/prompt-specs-advanced.md): Advanced guide to Fiddler's LLM-as-a-Judge capabilities, including custom prompting, model selection, performance optimization, and enterprise deployment patterns.
- [RAG Health Metrics Tutorial](https://docs.fiddler.ai/developers/tutorials/experiments/rag-health-metrics-tutorial.md): Step-by-step guide to evaluating RAG applications using the RAG Health Metrics diagnostic triad: Answer Relevance, Context Relevance, and RAG Faithfulness.

#### Guardrails

- [Guardrails](https://docs.fiddler.ai/developers/tutorials/guardrails.md)
- [Faithfulness](https://docs.fiddler.ai/developers/tutorials/guardrails/guardrails-faithfulness.md): This Quick Start notebook introduces Fiddler Guardrails, an enterprise solution that safeguards LLM applications from risks like hallucinations, toxicity, and jailbreaking attempts.
- [PII](https://docs.fiddler.ai/developers/tutorials/guardrails/guardrails-pii.md): Learn to detect and protect PII, PHI, and sensitive data in text using Fiddler Guardrails for PII/PHI for comprehensive privacy compliance.
- [Safety](https://docs.fiddler.ai/developers/tutorials/guardrails/guardrails-safety.md): This Quick Start Notebook introduces Fiddler Guardrails' Safety Detection capabilities, an essential component of our enterprise solution for protecting LLM applications.
- [Secrets](https://docs.fiddler.ai/developers/tutorials/guardrails/guardrails-secrets.md): Learn to detect credentials, API keys, and tokens in text using Fiddler's Centor Secret Detection guardrail to prevent secret leakage in LLM applications.

#### ML Monitoring

- [ML Monitoring](https://docs.fiddler.ai/developers/tutorials/ml-monitoring.md)
- [Class Imbalance](https://docs.fiddler.ai/developers/tutorials/ml-monitoring/class-imbalance-monitoring-example.md): Discover how Fiddler uses class weighting to address class imbalance. Compare two identical models–with and without weighting–to detect drift signals.
- [CV Inputs](https://docs.fiddler.ai/developers/tutorials/ml-monitoring/cv-monitoring.md): Explore our guide to using Fiddler’s monitoring for computer vision models. Learn to detect drift in image data with our unique Vector Monitoring approach.
- [Model Versions](https://docs.fiddler.ai/developers/tutorials/ml-monitoring/ml-monitoring-model-versions.md): Explore our guide to using Fiddler’s sample data to set up and manage multiple versions of a model with the powerful Model Versions feature.
- [Regression](https://docs.fiddler.ai/developers/tutorials/ml-monitoring/ml-monitoring-reg

Measured from the saved file

Linked document

UTF-8 text size
25.6 KB26233 bytes
Token count
6009o200k_base encoding
Markdown links
111109 distinct URLs
Fenced code blocks
0214 lines in the file

Size measures the captured UTF-8 text, not compressed transfer size. Tokens are counted with a named tokenizer; other models can count differently. Neither measure establishes context compatibility or answer quality.

Project H1
Fiddler Documentation

Opening blockquote

Unified observability for trustworthy AI across traditional ML, LLM applications, autonomous agents, and self-hosted deployments.

Context architecture

How the content is divided

5 H2 sections organize 111 parsed Markdown links. 106 links point to .md or .markdown paths; 0 link occurrences use another hostname. Linked destinations have not been recursively validated.

H2 sectionLinksUTF-8 bytesTokens
IntegrationsLine 73993722213
DevelopersLine 7857139603102
ChangelogLine 185112170523
OpenAPI SpecsLine 205117142
IndexesLine 211221758

Link counts exclude parsed fenced and inline code and resolve relative destinations against the final endpoint. Section sizes cover the text below each H2 until the next H2.

Embedded material

Code, installation and API examples

Fenced blocks
0 closed
Declared languages
No fenced blocks detected
Package-install commands
0 detected in fenced or inline code
Authentication examples
0 fenced lines match API-key, Authorization, Bearer, OAuth or access-token patterns
HTTP request examples
0 fenced lines match request-method patterns
Authentication links
0 links have authentication-related labels

Embedded example text and links to further documentation are counted separately. A code block does not establish that a sample runs or that an authentication flow succeeds.

Publisher prioritization

The Optional section

No H2 section named “Optional” was detected in this file.

The community proposal uses Optional by convention for secondary links that can be skipped for a shorter context. This label does not establish that everything outside it is critical, or that the material inside it is deprecated.

Machine-readable routes

MCP references and configuration text

MCP-related text was detected in the captured file. 1 links have MCP-related labels or paths. 0 fenced lines match mcpServers, mcp_servers or an mcp add command.

These are text and link observations. No MCP server connection, authentication or tool call was tested.

Index and bundle

llms-full.txt companion

Verified text companion

Text companion verified

https://docs.fiddler.ai/llms-full.txt ↗
Discovery
Conventional sibling path checked
HTTP response
200 · text/plain; charset=utf-8
Text size
Whole-file size not established by the bounded response
Token count
Not measured for the whole file
Retrieval scope
Bounded prefix inspected; the whole body was not downloaded

A verified text response establishes a companion at the checked URL. It does not prove the bundle contains all product documentation, that generation is automated, or that it fits an assistant’s context window.

Change evidence

What can be said about freshness

This capture establishes a baseline. Update frequency cannot be determined from one observation.

Linked release and migration material

11 links have release, changelog, deprecation or migration terms in their labels or paths. These provide places to investigate product changes separately.

File changes can reveal documentation edits or navigation changes. They do not by themselves measure product release velocity, accuracy, agent adoption or AI visibility.

Capture identity and measurement method
Requested endpoint
https://docs.fiddler.ai/llms.txt
Final endpoint
https://docs.fiddler.ai/llms.txt
HTTP status
200
Content type
text/plain; charset=utf-8
Text retrieval
Firecrawl literal text capture
Tokenizer
tiktoken 0.14.0 · o200k_base
SHA-256 of saved UTF-8 text
24ef8c193e3d44763b9f6ea40fdfe9acb101daefa535b919c86a0de417856aef

Counts use a deterministic parser, not a spec-compliance grade. Unusual Markdown and indented code can fall outside its recognized patterns. See the llms.txt proposal and tokenizer implementation.

Related tools and resources

Contact Jon