Available starting with FlowX.AI 5.5.0
What Observatory does
Governance
Central AI registry, risk assessment, and compliance mapping (EU AI Act, NIST AI RMF)
Observability
Distributed tracing, execution monitoring, and real-time dashboards for AI pipelines
Management
Dataset handling, prompt management, and multi-dimensional evaluation with drift detection
Safety
Content validation and guardrails with optional LLM-Guard integration
How it fits into FlowX
Observatory connects to the AI agents and workflows you build with the FlowX AI Platform:- Business agents built with Agent Builder or installed from the Marketplace are automatically traced
- Config-time agents (Analyst, Designer, Developer, Assistant) can be monitored for usage and cost
- BPMN workflows with AI steps report execution data back to Observatory dashboards
Key capabilities
AI registry and governance
Maintain a centralized registry of all AI projects, models, and agents in your organization. Map them to regulatory frameworks and track risk assessments over time.Tracing and observability
Trace every step in your AI pipelines — from the initial user request through agent orchestration, tool calls, and LLM completions. Identify latency bottlenecks, errors, and cost drivers.Evaluation and quality
Run evaluations against datasets to measure agent accuracy, detect quality drift, and compare model performance across versions.Cost tracking
Monitor per-model token usage and costs across providers. Forecast spending and identify optimization opportunities.Getting started
Set up Observatory
Deploy Observatory as part of your FlowX 5.5.0+ installation. See the Observatory setup guide for self-hosting instructions.
Instrument your agents
Use the Observatory Python SDK to add tracing decorators (
@agent, @chain, @tool) to your AI pipelines. See the SDK documentation.Observatory documentation
For detailed guides, API reference, and architecture documentation, visit the dedicated Observatory docs:Core concepts
Foundational concepts and terminology
SDK reference
Python SDK with tracing decorators
API reference
Complete REST API documentation
Architecture
System design and infrastructure details