AIP-84 Migrate UI endpoints from views.py to the new rest api

[pierrejeambrun]

Body

Migrate all of the custom/private endpoints that the legacy react views use into the new REST API. Some of them may be best to be moved to the public REST API. Including but not limited to:

• object/grid_data AIP-84 Migrate /object/grid_data from views to FastAPI #42595
• object/graph_data AIP-84 Add external dependencies to a dag's graph_data #931 #42367
• object/rendered-k8s this should probably be moved to the public API
• trigger dag run
• /object/next_run_datasets
• /object/dataset_dependencies AIP-84 Refactor dataset dependencies graph #42368
• /object/datasets_summary we will redesign this one
• /object/calendar_data We will redesign this one
• /object/task_instances we should just delete this one
• /object/historical_metrics_data AIP-84 Migrate /object/historical_metrics_data from views to FastAPI #42623
• /last_dagruns AIP-84 Add UI batch recent_dag_runs endpoint #42933
• /task_stats part of replacing the dags list AIP-84 Begin scoping out DAGs list in React #42369
• /last_dagruns part of replacing the dags list AIP-84 Begin scoping out DAGs list in React #42369
• /dag_stats part of replacing the dags list AIP-84 Begin scoping out DAGs list in React #42369

Committer

• I acknowledge that I am a maintainer/committer of the Apache Airflow project.

[bugraoz93]

Thanks for the umbrella ticket! I want to work on this. I couldn't decide which one to migrate to first. Do you have any priority on these @pierrejeambrun?

[pierrejeambrun]

I am not sure, maybe @bbovenzi will have more information about that. I would say that object/grid_data is of some importance but is also a complex one. Otherwise you can just pick the one that sound fun to you :).

[bugraoz93]

Thanks for clarifying @pierrejeambrun! All seems fun, I am going with object/grid_data then :)

[bbovenzi]

@bugraoz93 Actually, we may refactor how grid_data is built. So let's hold off on that one for now. I would work on /object/historical_metrics_data. I'd like to get the dashboard running in the UI soon.

[bugraoz93]

Thanks @bbovenzi! I have created the issue. I will first take a look at /object/historical_metrics_data. :)