Continuous Archiving for Postgres

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

The simplest, highest-throughput Python interface to S3, GCS & Azure Storage, powered by Rust.

Reliable data integration & processing for advertisers

Local emulator for Google Cloud Storage

Unified cloud storage API for storage services.

Jupyter support for Google Cloud Storage

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.

ACK is an E(T)L tool specialized in API data ingestion. It is accessible through a Command-Line Interface. The application allows you to easily extract, stream and load data (with minimum transformations), from the API source to the destination of your choice.

An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

A global file-based mutex lock using Google Cloud Storage

Python examples on Google Cloud Platform (GCP). How to manage Compute Engine VM instances, Cloud Storage buckets, etc.

A full text RSS generator which can hosted on google app engine

A file system with the power of an object store.

Cloud Dataflow Tutorial for Beginners

💾 ☁️ Tutorial for interacting with Google Cloud Storage via the Python SDK.

Django storage module implementation for Google Cloud Storage

A set of modules for deploying custom Git LFS servers on different infrastructure providers

My personal project for data engineering zoomcamp

asyncio Python library for distributed mutex with GCS as a backend