Skip to content

Commit 6106a5c

Browse files
authored
feat(planning_data_analyzer): remove override scene related source and script (#400)
* remove override scene related source and script Signed-off-by: Go Sakayori <gsakayori@gmail.com> * fix pre-commit Signed-off-by: Go Sakayori <gsakayori@gmail.com> --------- Signed-off-by: Go Sakayori <gsakayori@gmail.com>
1 parent 76866ae commit 6106a5c

20 files changed

Lines changed: 8 additions & 4123 deletions

planning/autoware_planning_data_analyzer/CMakeLists.txt

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,15 +2,12 @@ cmake_minimum_required(VERSION 3.14)
22
project(autoware_planning_data_analyzer)
33

44
find_package(autoware_cmake REQUIRED)
5-
find_package(tf2_geometry_msgs REQUIRED)
65
autoware_package()
76

87
ament_auto_add_library(${PROJECT_NAME} SHARED
98
src/buffer.cpp
109
src/base_evaluator.cpp
1110
src/open_loop_evaluator.cpp
12-
src/or_event_extractor.cpp
13-
src/or_scene_evaluator.cpp
1411
src/metrics/deviation_metrics.cpp
1512
src/metrics/epdms_aggregation.cpp
1613
src/metrics/ego_progress.cpp
@@ -29,7 +26,6 @@ ament_auto_add_library(${PROJECT_NAME} SHARED
2926
src/utils/path_utils.cpp
3027
src/autoware_planning_data_analyzer_node.cpp
3128
)
32-
ament_target_dependencies(${PROJECT_NAME} tf2_geometry_msgs)
3329

3430
rclcpp_components_register_node(${PROJECT_NAME}
3531
PLUGIN "autoware::planning_data_analyzer::AutowarePlanningDataAnalyzerNode"
@@ -67,5 +63,4 @@ ament_auto_package(
6763
INSTALL_TO_SHARE
6864
config
6965
launch
70-
scripts
7166
)

planning/autoware_planning_data_analyzer/README.md

Lines changed: 3 additions & 44 deletions
Original file line numberDiff line numberDiff line change
@@ -4,11 +4,6 @@
44

55
This package provides offline evaluation tools for trajectory planning performance analysis from recorded rosbag data.
66

7-
## Evaluation Modes
8-
9-
1. **Open Loop**: Evaluate prediction accuracy against ground truth trajectories
10-
2. **OR Scene**: Evaluate override regression scenarios (LIVE vs HISTORICAL)
11-
127
## Open-Loop Evaluation
138

149
Open-loop evaluation computes both trajectory error metrics and planning-quality subscores.
@@ -63,31 +58,6 @@ ros2 run autoware_planning_data_analyzer autoware_planning_data_analyzer_node --
6358
-p json_output_path:=~/results.json
6459
```
6560

66-
### OR Scene Evaluation
67-
68-
```sh
69-
# Using the unified script
70-
./install/autoware_planning_data_analyzer/share/autoware_planning_data_analyzer/scripts/run_evaluation.sh \
71-
-b ~/result_bag.mcap \
72-
-m or_scene \
73-
-t /planning/diffusion_planner/trajectory \
74-
-o ~/results \
75-
--live \
76-
--viz
77-
```
78-
79-
### Multi-Model Pipeline
80-
81-
```sh
82-
# Evaluate multiple models from DLR results
83-
./install/autoware_planning_data_analyzer/share/autoware_planning_data_analyzer/scripts/multi_model_pipeline.sh \
84-
--scenario ~/dataset/scenario.yaml \
85-
--trajectory /planning/model_a/trajectory \
86-
--trajectory /planning/model_b/trajectory \
87-
--output ~/comparison \
88-
--viz
89-
```
90-
9161
## Output Files
9262

9363
- **`evaluation_result.json`** - Detailed metrics (ADE, FDE, TTC, etc.) and summary statistics
@@ -96,28 +66,17 @@ ros2 run autoware_planning_data_analyzer autoware_planning_data_analyzer_node --
9666

9767
## Parameters
9868

99-
Key parameters in `config/offline_evaluation.param.yaml`:
69+
Key parameters in `config/planning_data_analyzer.param.yaml`:
10070

101-
- `evaluation.mode`: Evaluation mode (`open_loop` or `or_scene`)
71+
- `evaluation.mode`: Evaluation mode (`open_loop`)
10272
- `evaluation_interval_ms`: Sampling interval (default: 100ms)
10373
- `sync_tolerance_ms`: Time synchronization tolerance (default: 100ms)
10474
- `trajectory_topic`: Trajectory topic to evaluate
105-
- `or_scene_evaluation.*`: OR scene specific settings
106-
107-
### Utility Scripts
108-
109-
Located in `scripts/` directory:
110-
111-
- **Bag Processing**: `merge_bags.py`, `rename_bag_topic.py`, `add_prefix_to_bag.py`
112-
- **Ground Truth**: `add_gt_trajectory_to_bag.py`
113-
- **OR Analysis**: `detect_or_and_route.py`, `evaluate_or_segments.py`
114-
- **Visualization**: `generate_or_visualization.py`
115-
- **Comparison**: `compare_live_historical.py`
75+
- `open_loop.*`: Open-loop specific settings
11676

11777
---
11878

11979
## For More Information
12080

121-
- Offline evaluation scripts: [scripts/](scripts/)
12281
- Configuration: [config/planning_data_analyzer.param.yaml](config/planning_data_analyzer.param.yaml)
12382
- Launch files: [launch/](launch/)

planning/autoware_planning_data_analyzer/config/planning_data_analyzer.param.yaml

Lines changed: 1 addition & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
/**:
22
ros__parameters:
33
# Evaluation Mode
4-
# Options: "open_loop" or "or_scene"
4+
# Options: "open_loop"
55
evaluation:
66
mode: "open_loop"
77

@@ -60,34 +60,3 @@
6060
lane_keep:
6161
max_lateral_deviation: 0.5 # Maximum absolute lateral deviation allowed for LK [m]
6262
max_continuous_violation_time: 2.0 # Continuous over-threshold duration allowed for LK [s]
63-
64-
# OR Scene Evaluation Configuration (only used when mode="or_scene")
65-
or_scene_evaluation:
66-
# Time window configuration (symmetric around OR event)
67-
time_window_sec: 0.5 # Time window on each side of OR event [OR - 0.5s, OR + 0.5s]
68-
69-
# Trajectory source selection
70-
evaluate_live_trajectories: true # true = evaluate result_bag (DLR output with LIVE trajectories)
71-
# false = evaluate input_bag (HISTORICAL recorded trajectories)
72-
input_bag_path: "" # Path to input bag (only used if evaluate_live_trajectories=false)
73-
74-
# Topics to monitor
75-
control_mode_topic: "/vehicle/status/control_mode" # Topic for OR detection (ControlModeReport)
76-
77-
# OR event extraction (Stage 1)
78-
skip_or_extraction: false # Set true if or_events.json already exists
79-
or_events_input_path: "" # Path to pre-extracted or_events.json (optional)
80-
or_events_output_path: "~/or_events.json" # Where to save extracted OR events
81-
82-
# Success criteria (optional - disabled by default)
83-
success_criteria:
84-
enabled: false # Set true to enforce thresholds
85-
max_ade: 1.0 # Maximum allowed ADE (meters)
86-
max_fde: 1.5 # Maximum allowed FDE (meters)
87-
max_lateral_deviation: 0.5 # Maximum absolute lateral deviation in the vehicle frame (meters)
88-
min_ttc: 3.0 # Minimum required TTC (seconds)
89-
90-
# Debug visualization
91-
enable_debug_visualization: false # Generate debug images showing predicted vs GT trajectories
92-
debug_output_dir: "~/or_scene_debug_images" # Directory for debug visualization images
93-
map_path: "" # Optional: path to lanelet2_map.osm for lane visualization

0 commit comments

Comments
 (0)