Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

Free MLOps course from DataTalks.Club

A curated list of awesome projects and resources related to Argo (a CNCF graduated project)

Polaris: High performance workflow orchestrator for Golang

A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)

Data Engineering examples covering Airflow and Mage for workflows; dbt for BigQuery, Redshift, ClickHouse; Spark and Kafka for Batch/Streaming Processing

SpiffWorkflow is a software development platform for building, running, and monitoring executable diagrams

Open source AI platform for rapid development of advanced AI and AGI pipelines.

The Kubernetes native and CloudEvents native distributed event streaming, event orchestration & messaging platform

An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts storage. AWS Lambda/ ECR for serverless model serving. AWS REST API gateway as endpoint to lambda function. GitHub Actions for CI/CD.

m2m is a node.js library for developing machine-to-machine and edge applications using the node-m2m framework.

A microservices flow orchestrator and workflow manager.

Repo for my MLOps Zoomcamp project

Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform

examples of Event-Driven Architectures (EDA) and Domain Driven Design (DDD) patterns implemented using eventual

Notes, homeworks, and projects for MLOps Zoomcamp @ datatalks.club

Our startup, Mela, aims to simplify cryptocurrency trading for everyone and provide reliable investment sources while mitigating risks. We aim to design and build a reliable, large-scale trading data pipeline that can run various backtests and store useful artifacts in a robust data warehouse.