D

data-ingestion

A self-service data ingestion platform that lets teams connect to 30+ databases (PostgreSQL, ClickHouse, Sybase, Snowflake, and more), upload CSVs with a visual column mapper, and execute bulk INSERT/UPSERT operations with real-time execution analytics.

Built on a FastAPI backend with Google OAuth, encrypted credential storage, and a full audit trail — paired with a React/TypeScript frontend that includes an AI-powered query risk analyzer before execution.

Designed for data engineering workflows where traceability and security matter: every operation is hashed into an immutable audit chain, and all inputs are validated against SQL injection at the API layer.

Elasticsearch ingest pipeline validation. https://estceque.touhey.pro/

A Streamlit+Snowflake app for automatically loading uploaded CSV files to brand new tables in a staging area.

Ingest SFTP path into S3 container, configured by args and environment variables. Concurrently download sftp files in a path and copy inside a S3 prefix.