feat(otel): add OpenTelemetry ingest, query, and frontend traces UI#18
Open
feat(otel): add OpenTelemetry ingest, query, and frontend traces UI#18
Conversation
… integration - Introduced `temps-otel` crate to the workspace and updated dependencies in `Cargo.toml`. - Added `OtelRead` and `OtelWrite` permissions to the `Permission` enum in `temps-auth`. - Registered `OtelPlugin` in the console API for OpenTelemetry metrics, traces, and logs collection. - Created migration for OpenTelemetry tables in the database. - Updated relevant files to integrate OpenTelemetry functionality across the application.
- Added `.env` to `.gitignore` to prevent sensitive information from being tracked. - Updated `Cargo.toml` to include new crates: `temps-environments`, `temps-screenshots`, and `temps-embeddings`. - Added `tower` and `uuid` dependencies to `Cargo.lock` and `Cargo.toml`. - Enhanced `CHANGELOG.md` with new features related to PostgreSQL backups and preset providers. - Updated `docker-compose.yml` for PostgreSQL configuration to support WAL-G for backups. - Improved CLI error handling and added source map management commands in `temps-cli`. - Refined analytics event handling and introduced console event ingestion in `temps-analytics-events`.
- Added resource monitoring tab in the project sidebar and a dedicated monitoring settings page with per-environment CPU, memory, and disk metrics. - Introduced `status_code_class` query parameter for proxy log stats endpoints to filter by status code classes (e.g., "2xx", "3xx"). - Implemented TimescaleDB compression and retention policies for the `proxy_logs` hypertable, optimizing data management. - Enabled `cargo clippy` pre-commit hook to catch lint issues before CI, improving code quality. - Updated various components and API types to support new monitoring functionalities and enhance user experience.
- Complete temps-otel crate: OTLP/HTTP protobuf ingest (traces, metrics, logs), query handlers, TimescaleDB storage, rate limiting, quota checks, anomaly detection, health summaries, and sidecar config generation - Auth: support tk_ (API key) and dt_ (deployment token) authentication for OTel ingest with path-based and header-based routes - Frontend: Traces list page with filtering (time range, service, status), trace detail page with span waterfall visualization and span detail panel, setup section with OTLP endpoint and Next.js code snippets - Add deployment_id to deployment tokens for OTel context propagation - Fix protobuf Span.flags from uint32 to fixed32 per OTLP v1.1.0+ spec - Remove server-side tail sampling (sampling is client SDK responsibility) - Add OtelRead/OtelWrite permissions, plugin registered in console - 117 passing unit tests, zero clippy warnings
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add a complete OpenTelemetry observability stack to Temps — from OTLP/HTTP protobuf ingest through TimescaleDB storage to a frontend traces visualization UI.
Backend (
temps-otelcrate)tk_) and deployment tokens (dt_), with header-based and path-based ingest routestime_bucket, query logs, pipeline stats, health summaries, insightsAuth & Permissions
OtelRead/OtelWritepermissions addeddeployment_idadded to deployment tokens for full OTel context propagationFrontend
Notable fixes
Span.flagschanged fromuint32tofixed32per OTLP v1.1.0+ specTraceDetaildata extraction (data.datanotdata.spans)ERROR/OKfrom API)Type of change
Checklist
cargo test --lib)cargo check --libpasses with no warningsRelated issues
Ref #17