Commit 987a8d1
committed
feat: Complete QSE harness implementation with automation and documentation
- Fixed double instrumentation by removing manual spans
- Updated TEST_SCENARIOS with comprehensive evaluation metric coverage
- Implemented cross-platform automated test runner (run_qse_harness.sh)
- Added comprehensive README.md with architecture, flow map, and debugging guide
- Created Docker deployment configuration with updated Dockerfile.alpha
- Added Kubernetes CronJob configuration for automated testing
- Cleaned up directory structure by removing over-engineered files
- Fixed macOS compatibility issues (timeout command)
- Added proper scenario indexing and environment variable handling
- Included deployment assets migration from manual/ to multi-agent-qse/
QSE harness now provides:
- 6 comprehensive test scenarios covering all evaluation metrics
- Automated execution with logging and error handling
- Production-ready deployment configurations
- Complete documentation and troubleshooting guide1 parent c3694a1 commit 987a8d1
File tree
22 files changed
+984
-4394
lines changed- instrumentation-genai/opentelemetry-instrumentation-langchain/examples
- manual
- multi-agent-qse
- deploy
22 files changed
+984
-4394
lines changedLines changed: 0 additions & 5 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
2 | | - | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | 1 | | |
7 | 2 | | |
8 | 3 | | |
| |||
Lines changed: 17 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
Lines changed: 0 additions & 41 deletions
This file was deleted.
0 commit comments