Replies: 1 comment
-
Any ideas on it? @dailidong @CalvinKirs |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi the dolphinscheduler community, do you mind introducing the task plugin of TonY, which is a framework to natively run deep learning jobs on Apache Hadoop. It currently supports TensorFlow, PyTorch, MXNet and Horovod. TonY enables running either single node or distributed training as a Hadoop application. This native connector, together with other TonY features, aims to run machine learning jobs reliably and flexibly.
I think it will make people reuse the existing on-perm Hadoop cluster resources and dolphinscheduler will also be a new workflow engine that covers the machine learning lifecycle jobs.
Beta Was this translation helpful? Give feedback.
All reactions