A

airflow

Utilized Airflow and Selenium to scrape weather forecast and send email alerts regarding extreme weather. Thresholds for extreme weather are defined in an external settings (yml) file. Quarto was used for documentation: https://avivfaraj.gitlab.io/weather-alerts/ .

Data ETL jobs

https://public.tableau.com/app/profile/shayne.lussier/viz/ClothingStore-Dashboard/Dashboard

В данном проекте находятся два задания, написанные на Python и реализующие выполнение цепочек задач (DAG) в среде Airflow

В данном репозитории находятся два проекта, демонстрирующие работу c данными в Python и на SQL, а также использование специализированных библиотек для статистических расчетов и визуализации данных, в Jupiter Notebook.

Simulation of a real hospital scenario with a ML model in production

DluOne Data Composer for Data Engineering and Data Science

This is a repo with scripts for Data Science and Engineering quick start with docker

I'm using personally for my daily work and side projects

A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.

See the documentation at: https://airflow-dbt-python.readthedocs.io/

project for module 33.Airflow in the course "Basic Data Science" at Skillbox.

Airflow pipeline, mainly for exploration and self-learning, but particularly for scraping LINE Webtoon data and store it in external MySQL database. The ingested data are used to create dashboard on https://ammarchalifah.com/webtoon-insights

Some basic Apache Airflow DAGs running ML-Workflows. This project is part of the lecture Business Computing at the HTWSaar in south-west Germany.

Airflow test for VLGI Investimentos.

Airflow data processing with Ansible and LXD