Data platforms · llms.txt file breakdown
Dagster Docs organizes Dagster content, including Docs.
The actual file
The saved llms.txt text, displayed as source. The file belongs to its publisher; the live endpoint may change.
Showing the first 18000 characters. Load the complete file to read the remainder.
# Dagster Docs
## Docs
- [Changelog](about/changelog): Review detailed updates on Dagster software features and improvements.
- [Community](about/community): The open source Dagster project has an inclusive and welcoming community that you can contribute to in GitHub and on Slack.
- [Contributing code to Dagster](about/contributing): Set up a local Dagster development environment and contribute code and documentation to the Dagster open source project.
- [Dagster documentation content model](about/contributing-docs/content-model): A guide to Dagster documentation structure and types.
- [Dagster documentation style and formatting](about/contributing-docs/formatting-style): Style and formatting guidelines for writing Dagster docs.
- [Contributing documentation to Dagster](about/contributing-docs/index): Local dev instructions and style, formatting, and content structure guidelines for Dagster docs.
- [Data portability & switching information](about/data-portability): Dagster Labs supports customer data portability and switching in accordance with applicable law, including the EU Data Act.
- [Releases and compatibility](about/releases): Dagster's public, stable API adheres to semantic versioning and won't break within any major release.
- [Dagster telemetry](about/telemetry): Dagster telemetry collects non-identifiable frontend and backend usage information to enhance development without accessing pipeline data.
- [Filtering API lifecycle warnings](api/api-lifecycle/filtering-api-lifecycle-warnings): Filter Dagster API lifecycle warnings using the Python warnings module.
- [API lifecycle stages](api/api-lifecycle/index): Dagster's public, stable API adheres to semantic versioning and won't break within any major release.
- [dagster cli](api/clis/cli): dagster cli Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [create-dagster cli](api/clis/create-dagster): create-dagster cli Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [dagster-cloud CLI reference](api/clis/dagster-cloud-cli/dagster-cloud-cli-reference): dagster-cloud CLI reference
- [dagster-cloud CLI](api/clis/dagster-cloud-cli/index): The dagster-cloud CLI offers command-line tools for managing and deploying Dagster+ workflows.
- [Installing and configuring the dagster-cloud CLI](api/clis/dagster-cloud-cli/installing-and-configuring): Install and configure the Dagster+ dagster-cloud CLI.
- [Configuring Dagster+ with the dg CLI](api/clis/dg-cli/configuring-dagster-plus): Authenticate and configure the dg CLI for Dagster+.
- [dg api reference](api/clis/dg-cli/dg-api): dg api reference Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [Installing and configuring the dg CLI](api/clis/dg-cli/dg-cli-configuration): Install the dg CLI and configure it from both configuration files and the command line.
- [dg cli local build command reference](api/clis/dg-cli/dg-cli-reference): dg cli local build command reference Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [dg plus reference](api/clis/dg-cli/dg-plus): dg plus reference Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [dg utils reference](api/clis/dg-cli/dg-utils): dg utils reference Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [CLI reference](api/clis/index): The Dagster CLIs provides a robust framework for building, deploying, and monitoring Dagster data pipelines from the command line.
- [asset checks](api/dagster/asset-checks): asset checks Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [assets](api/dagster/assets): assets Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [components](api/dagster/components): components Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [config](api/dagster/config): config Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [definitions](api/dagster/definitions): definitions Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [dynamic mapping & collect](api/dagster/dynamic): dynamic mapping & collect Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [errors](api/dagster/errors): errors Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [execution](api/dagster/execution): execution Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [external assets instance api](api/dagster/external-assets-instance-api): external assets instance api Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [graphs](api/dagster/graphs): graphs Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [hooks](api/dagster/hooks): hooks Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [Dagster SDK](api/dagster/index): The core Dagster SDK provides a robust framework for building, deploying, and monitoring data pipelines.
- [internals](api/dagster/internals): internals Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [io managers](api/dagster/io-managers): io managers Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [jobs](api/dagster/jobs): jobs Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [loggers](api/dagster/loggers): loggers Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [metadata](api/dagster/metadata): metadata Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [ops](api/dagster/ops): ops Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [partitions](api/dagster/partitions): partitions Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [dagster pipes](api/dagster/pipes): dagster pipes Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [repositories](api/dagster/repositories): repositories Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [resources](api/dagster/resources): resources Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [schedules and sensors](api/dagster/schedules-sensors): schedules and sensors Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [types](api/dagster/types): types Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [utilities](api/dagster/utilities): utilities Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [graphql (dagster-graphql)](api/graphql/dagster-graphql): graphql (dagster-graphql) Dagster API | Comprehensive Python API documentation for Dagster, the data orchestration platform. Learn how to build, test, and maintain data pipelines with our detailed guides and examples.
- [Dagster GraphQL Python client](api/graphql/graphql-client): Dagster provides a Python client to interact with its GraphQL API
- [Dagster GraphQL API](api/graphql/index): Dagster exposes a GraphQL API that allows clients to interact with Dagster programmatically
- [API overview](api/index): Comprehensive API reference for Dagster core and library.
- [External assets REST API reference](api/rest-api): Dagster's external assets REST API allows you to report updates for external assets back to Dagster.
- [Asset checks](dagster-basics-tutorial/asset-checks): Ensuring quality with asset checks
- [Assets](dagster-basics-tutorial/assets): Building your first assets
- [Components](dagster-basics-tutorial/custom-components): Defining custom components
- [Asset dependencies](dagster-basics-tutorial/dependencies): Defining dependencies between assets
- [Dagster basics tutorial](dagster-basics-tutorial/index): Learn about Dagster basics, such as projects, assets, resources, asset dependencies, asset checks, automation, and components.
- [Projects](dagster-basics-tutorial/projects): The Dagster project
- [Resources](dagster-basics-tutorial/resources): Using resources with assets
- [Automation](dagster-basics-tutorial/schedules): Automating our pipeline
- [Authentication and access control](deployment/dagster-plus/authentication-and-access-control/index): Learn about RBAC, SSO, and SCIM provisioning with Dagster+.
- [Viewing and accessing audit logs](deployment/dagster-plus/authentication-and-access-control/rbac/audit-logs): The Dagster+ audit log enables Dagster+ Pro organization admins to track and attribute changes to their Dagster deployment with the UI or Dagster+ GraphQL API.
- [Role-based access control](deployment/dagster-plus/authentication-and-access-control/rbac/index): Manage user and team permissions in Dagster+ with role-based access control (RBAC).
- [Managing teams](deployment/dagster-plus/authentication-and-access-control/rbac/teams): Manage team permissions in Dagster+ with role-based access control (RBAC).
- [User roles and permissions](deployment/dagster-plus/authentication-and-access-control/rbac/user-roles-permissions): Role-based access control (RBAC) enables you to grant specific permissions to users in your Dagster+ organization, ensuring that users only have access to what they need.
- [Managing users](deployment/dagster-plus/authentication-and-access-control/rbac/users): Dagster+ allows you to grant specific permissions to your organization's users with role-based access control (RBAC), ensuring that Dagster users have access only to what they need.
- [Configuring Microsoft Entra ID SCIM provisioning](deployment/dagster-plus/authentication-and-access-control/scim/entra-id-scim): Configure Microsoft Entra ID provisioning for Dagster+ to sync user information between Microsoft Entra ID and your Dagster+ deployment.
- [SCIM provisioning](deployment/dagster-plus/authentication-and-access-control/scim/index): Automatically sync user information from your identity provider to Dagster+ and back with SCIM provisioning.
- [Configuring Okta SCIM provisioning](deployment/dagster-plus/authentication-and-access-control/scim/okta-scim): Configure SCIM provisioning in Dagster+ to sync user information between Okta and your Dagster+ deployment.
- [Setting up Microsoft Entra ID (formerly Azure Active Directory) SSO for Dagster+](deployment/dagster-plus/authentication-and-access-control/sso/azure-ad-sso): Configure Microsoft Entra ID (formerly Azure Active Directory) to use SSO with your Dagster+ organization.
- [Setting up Google Workspace SSO for Dagster+](deployment/dagster-plus/authentication-and-access-control/sso/google-workspace-sso): Configure Google Workspace to use single sign-on (SSO) with your Dagster+ organization.
- [Single sign-on](deployment/dagster-plus/authentication-and-access-control/sso/index): Configure single sign-on (SSO) for your Dagster+ organization.
- [Setting up Okta SSO for Dagster+](deployment/dagster-plus/authentication-and-access-control/sso/okta-sso): Configure Okta to use single sign-on (SSO) with your Dagster+ organization.
- [OneLogin SSO](deployment/dagster-plus/authentication-and-access-control/sso/onelogin-sso): Configure OneLogin to use single sign-on (SSO) with your Dagster+ organization.
- [Setting up PingOne SSO for Dagster+](deployment/dagster-plus/authentication-and-access-control/sso/pingone-sso): Configure PingOne to use single sign-on (SSO) with your Dagster+ organization.
- [Dagster+ code requirements](deployment/dagster-plus/code-requirements): Dagster+ code must load from a single entry point and be able to be run in an environment where the dagster and dagster-cloud 0.13.2+ Python packages are installed, plus meet additional requirements for hybrid deployments.
- [Dagster+ EU](deployment/dagster-plus/dagster-plus-eu): With Dagster+ EU, your control plane, metadata, and operational data reside in European data centers.
- [Adding a project to Dagster+](deployment/dagster-plus/deploying-code/adding-project-to-dagster-plus): You can add a single Dagster project manually to your Dagster+ deployment or add multiple Dagster projects that roll up into one global lineage graph.
- [Configuring concurrency for branch deployments](deployment/dagster-plus/deploying-code/branch-deployments/branch-deployment-concurrency): Control how many runs can execute concurrently across and within branch deployments using organization-scoped Dagster+ settings.
- [Change tracking in branch deployments](deployment/dagster-plus/deploying-code/branch-deployments/change-tracking): Dagster+ branch deployments compare asset definitions in the branch deployment against the asset definitions in the base deployment, helping your team identify how changes in a pull request will impact data assets.
- [Configuring branch deployments with GitHub or GitLab](deployment/dagster-plus/deploying-code/branch-deployments/configuring-branch-deployments): Configure branch deployments for a Dagster project in Dagster+ Serverless or Hybrid using GitHub or GitLab.
- [Configuring branch deployments with the dagster-cloud CLI (advanced)](deployment/dagster-plus/deploying-code/branch-deployments/configuring-branch-deployments-cli): Configure branch deployments for a Dagster project in Dagster+ Serverless or Hybrid using the dagster-cloud CLI.
- [Branch deployments](deployment/dagster-plus/deploying-code/branch-deployments/index): With branch deployments, Dagster+ creates a corresponding ephemeral preview deployment of your Dagster code for each pull or merge request to show what your pipeline will look like after the change is merged.
- [Managing branch deployments across multiple deployments](deployment/dagster-plus/deploying-code/branch-deployments/multiple-deployments): Frequent use cases and troubleshooting tips for managing branch deployments when your organization has multiple Dagster+ deployments or environments.
- [Testing against production data with branch deployments](deployment/dagster-plus/deploying-code/branch-deployments/testing-against-prod-data): Test your code in Dagster+ using branch deployments without impacting production data.
- [Configuring CI/CD in Dagster+](deployment/dagster-plus/deploying-code/configuring-ci-cd): Implement CI/CD for your Dagster+ Serverless or Hybrid deployment with GitHub, GitLab, or another CI/CD provider.
- [Full deployment settings](deployment/dagster-plus/deploying-code/full-deployments/full-deployment-settings-reference): Configure full deployment settMeasured from the saved file
Size measures the captured UTF-8 text, not compressed transfer size. Tokens are counted with a named tokenizer; other models can count differently. Neither measure establishes context compatibility or answer quality.
Context architecture
1 H2 sections organize 736 parsed Markdown links. 0 links point to .md or .markdown paths; 0 link occurrences use another hostname. Linked destinations have not been recursively validated.
| H2 section | Links | UTF-8 bytes | Tokens |
|---|---|---|---|
| DocsLine 3 | 736 | 149090 | 31926 |
Link counts exclude parsed fenced and inline code and resolve relative destinations against the final endpoint. Section sizes cover the text below each H2 until the next H2.
Embedded material
Embedded example text and links to further documentation are counted separately. A code block does not establish that a sample runs or that an authentication flow succeeds.
Publisher prioritization
No H2 section named “Optional” was detected in this file.
The community proposal uses Optional by convention for secondary links that can be skipped for a shorter context. This label does not establish that everything outside it is critical, or that the material inside it is deprecated.
Machine-readable routes
MCP-related text was detected in the captured file. 1 links have MCP-related labels or paths. 0 fenced lines match mcpServers, mcp_servers or an mcp add command.
These are text and link observations. No MCP server connection, authentication or tool call was tested.
Index and bundle
Verified text companion
A verified text response establishes a companion at the checked URL. It does not prove the bundle contains all product documentation, that generation is automated, or that it fits an assistant’s context window.
Change evidence
This capture establishes a baseline. Update frequency cannot be determined from one observation.
37 links have release, changelog, deprecation or migration terms in their labels or paths. These provide places to investigate product changes separately.
File changes can reveal documentation edits or navigation changes. They do not by themselves measure product release velocity, accuracy, agent adoption or AI visibility.
496e8320f167f0bc622d7f7a0c7e726e6c9d979263d4104bcf7ab82202de782dCounts use a deterministic parser, not a spec-compliance grade. Unusual Markdown and indented code can fall outside its recognized patterns. See the llms.txt proposal and tokenizer implementation.