Airflow Deployment on AWS ECS Fargate Using Cloudformation

Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University

Accelerate data science

Materials for the Deploy and Monitor ML Pipelines with Python, Docker and GitHub Actions workshop at the PyData NYC 2024 conference

Students' material for the course in Artificial Intelligence and Data Engineering at University of Pisa.

Data

Documentation repository for the Egeria project.

An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlDB. The processed analytics data is then sent to Telegram for real-time notifications.

Udacity Nanodegree - Data Analyst - Wrangling, Exploring, Analyzing, and Visualizing Data

The Goal of this project is to provide documentation for the Lakehouse Engine framework.

Upload big files in the chunks using Flask

A simple and approachable guide to build data engineering skills in modern data world

『第12回データ工学と情報マネジメントに関するフォーラム』の最終論文集です

Este projeto tem como objetivo realizar análises espaciais exploratórias. As Linguagens utilizadas foram Python e HTML

Heart Disease Analysis

A data pipeline to extract News articles from BBC News, storing it to MongoDB, performing NLP analysis (Topic modeling, sentiment analysis), and orchestrating with airflow.

This contains the projects related to Data Analytics, Buisness Analytics, Visualization etc

NUMLPay is a comprehensive fee payment system designed to simplify and streamline the payment process for students at the National University of Modern Languages (NUML). With NUML’s legacy of over forty years in educational excellence, NUMLPay represents a significant advancement in adapting to the evolving needs of students.

This repository contains a collection of interactive tutorials and hands-on coding exercises designed to help you learn and master various programming concepts and technologies. Each codelab provides step-by-step instructions, practical examples, and challenges to enhance your coding skills.

Unsupervised Pandas - Another blog about data