need to do dynamic ops.assets https://medium.com/@thegreat.rashid83/dagster-sensors-partition-c7a5205d4c0d
At the top level (dagster/implents) you can run
dagster dev
You need to set the environment based on dagster/implnets/deployment/envFile.env
It should run workflows/tasks/tasks
defined in the pyproject.toml
[tool.dagster]
module_name = "workflows.tasks.tasks"
cd dagster/implnets/workflows/tasks You need to set the environment based on dagster/implnets/deployment/envFile.env
dagster dev
will run just the task, and in editable form, i think.
Medium on Dagster with configurable API and asset examples
Keep the python versions in the DOCKER definitions in sync. GRPCC can be finicky
aka:
FROM python:3.11-slim