v0.9.0rc1

This is the release notes of v0.9.0rc1. See here for the complete list of solved issues and merged PRs.

New Features

• Tensor
  • Implements mars.tensor.setdiff1d (#2823)
• Learn
  • Added support for mars.learn.metrics.roc_auc_score (#2832)
• Services
  • A speculative execution based task scheduler (#2576)
• Metric
  • [ray] Add metric for ray object store (#2776, thanks @Catch-Bull!)
• Others
  • Use versioneer to manage release versions (#2806)

Enhancements

• Support generating a DOT file for subtask graph (#2803)
• Support generating dtypes, index_value etc lazily for DataFrame chunks (#2756)
• [ray] Default enable fault tolerance for ray (#2801)
• Improve subtask details in logs (#2836)
• Accurate resource management for global slot manager (#2732)
• Configure nthread of XGBoost jobs (#2844)
• Improved performance of mars.learn.metrics.{roc_curve, roc_auc_score} (#2838)
• Bump minimist and nanoid in Mars UI due to security alerts (#2849)
• Fix store duplicate chunk and meta per subtask (#2845)

Bug fixes

• Fix default value of gpu property for some operands (#2811)
• Fixes the failure on Vineyard CI by ensure the input tensor chunk is a numpy's ndarray (#2817)
• Fix race condition of set_subtask_result (#2784)
• Fix duplicate subtask submit (#2815)
• Change StorageHandlerActor to stateful (#2824)
• Fix running xgboost on Ray cluster (#2826)
• Fix FileSystem.ls for OSS (#2837)
• Stop fetching data when pure dependencies specified (#2840)
• Fix dirty version number caused by versioneer when building with cibuildwheel (#2855)

Tests

• [Ray] Refine ray tests (#2793)
• Build docker images cronically (#2804)
• Introduce asv benchmark (#2798)