Make stream processing easier! Easy-to-use streaming application development framework and operation platform.

A Kafka Connect source connector that generates data for tests

A library enabling DAG structuring of data processing programs such as ETLs

Parallel Streaming Transformation Loader

this repo for learning search engine such as elk and web search engine concept such as google to grow knowledge of software engineering

《DNA元基催化与肽计算》 在进化计算中, 软件函数文件进行 DNA 语义元基索引编码的 PDE 新陈代谢优化方式, 是一种有效的进化方式.

JChunk is a lightweight and flexible library designed to provide multiple strategies for text chunking within Java applications

Metal is a data flow modeling platform. Metal supports visual modeling and submitting batch job.

A library enabling DAG structuring of data processing programs such as ETLs

Comms processing (ETL) with Apache Flink.

Dataflow pipeline, Used for ETL

Pipeline microframework for data processing

Modern ETL Architecture Built with Flink 1.20.0 and Java 11

Streaming census data with Kafka

ETL Console is the Canary Islands Government's corporate solution for registering and executing ETL files developed using Pentaho Data Integration technology

Unveiling Cinematic Brilliance: Illuminating the Future of Movie Production through Data-Driven Insights

Project with ETL pipelines logic made to demonstrate the power of Spring framework

This repository comprises the design, implementation, and analysis of a near real-time data warehouse prototype for an electronics business chain, utilising a multi-threaded Extract, Transform, Load (ETL) pipeline leveraging the efficient HYBRIDJOIN algorithm implemented with Java and MySQL on customer sales data.

Toy project for the Extract part in an ETL pipeline

Spring Boot 2 service that forms the analysis tier of the TweetPipe streaming data pipeline. This application consumes tweets from a Kafka topic, analyses them, and will persist the result to a target database.