☁️ Build multimodal AI applications with cloud-native stack

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Turns Data and AI algorithms into production-ready web applications in no time.

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. All in a modern, AI-native editor.

Always know what to expect from your data.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

📚 Parameterize, execute, and analyze notebooks

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Machine Learning Pipelines for Kubeflow

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Blender addons that improve the game development workflow between Blender and Unreal.

Python library for creating data pipelines with chain functional programming

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Data intensive science for everyone.

PyTorch extensions for fast R&D prototyping and Kaggle farming