Repositories list

• data-juicer

  Public
  Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

  data-sciencedatadata-visualization+ 11data-analysisdata-processingmulti-modaldata-pipelinesynthetic-datapre-trainingfoundation-models+ 4

  Python

  •

  Apache License 2.0

  •313•5.7k•42•22•Updated Jan 8, 2026Jan 8, 2026

• data-juicer-agents

  Public
  🤖 Your Intelligent Copilot for Data Exploration and Processing Pipeline

  Python

  •

  Apache License 2.0

  •3•5•0•0•Updated Jan 8, 2026Jan 8, 2026

• data-juicer-sphinx

  Public

  datajuicer/data-juicer-sphinx’s past year of commit activity
  Apache License 2.0

  •1•0•0•0•Updated Jan 6, 2026Jan 6, 2026

• data-juicer-sandbox

  Public

  datajuicer/data-juicer-sandbox’s past year of commit activity
  A Feedback-Driven Suite for Multimodal Data-Model Co-development.

  Python

  •

  Apache License 2.0

  •2•4•0•0•Updated Dec 16, 2025Dec 16, 2025

• data-juicer-hub

  Public
  Community-driven data-juicer recipes and best practices for various pre-training/fine-tuning tasks.

  Apache License 2.0

  •2•3•0•0•Updated Dec 15, 2025Dec 15, 2025

• transformers-stream-generator

  Public
  This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers. Self-modified version.

  Python

  •

  MIT License

  •19•0•0•0•Updated Nov 15, 2025Nov 15, 2025

• recognize-anything

  Public
  Open-source and strong foundation image recognition models. Self-modified version.

  Jupyter Notebook

  •

  Apache License 2.0

  •316•0•0•0•Updated Nov 15, 2025Nov 15, 2025

• .github

  Public

  datajuicer/.github’s past year of commit activity
  0•0•0•0•Updated Nov 5, 2025Nov 5, 2025