Projects with this topic
-
Utilizing Airflow to track trading activity of congress members by analyzing disclosure statements and sending email alerts when new disclosure are submitted. The STOCK act requires members of congress to disclose trading activity within 30 days, so the alerts might lag behind the actual date of trading.
Updated -
Configuration and data workflows for an instance of Apache Airflow for the DDRplatform
Updated -
A production-ready data pipeline that ingests data from public API endpoints, validates and processes it through a medallion architecture (Raw → Bronze → Gold) using Apache Airflow orchestration, AWS Glue transformations, and S3 Data Lake storage. Features robust error handling, circuit breaker patterns, and schema evolution management.
Updated -
Проект на основе лабораторных работ по курсу DevOps (ИТМО). Содержит примеры развёртывания Apache Airflow, интеграции со Spark, настройки GitLab CI/CD и мониторинга (Grafana, Loki, Zabbix) с использованием Docker Compose.
Updated -
This is the code repository associated with my development notes notebook.
I need it to improve development efficiency. I study concepts, prototype solutions, save them here along with their comments. When needed, I know where I can quickly find code examples to reuse.
Updated -
Official weather data ETL for wind energy project evaluation in El Calafate, Argentina.
Updated -
Engineered a modern data pipeline for a dummy real estate firm, integrating Apache Airflow, dbt, and PostgreSQL in a Dockerized environment.
Updated -
Развертывание модели и запуск обучения по расписанию с использованием Airflow в Docker.
Updated -
Quick and dirty pipeline to prepare a dataset for mobility studies, starting from a collection of CDRs.
Updated -
-
Bash scripts for building and running a Docker container locally with Apache Airflow Standalone.
Not suitable for production environment. Use it for local development and testing only!
UpdatedUpdated -
Airflow test for VLGI Investimentos.
Updated