Data Engineer
Successfully transitioned and optimized data infrastructure with demonstrated expertise in modern data engineering practices by transitioning data workflows to a Snowflake architecture at Baufest.
Developed and implemented robust data pipelines and systems and designed and implemented ETL pipelines using SQL, AWS S3, Python, and XSLT across multiple roles. PROFESSIONAL EXPERIENCE BAUFEST, Uruguay Data Engineer 2023 - Present ● Transitioned data workflows to Snowflake architecture; employed SQL and AWS S3 for ETL pipeline management of +100M records ● Ensured compatibility and scalability of new systems, supporting the data needs of an American retail client operating 500+ stores ● Implemented 15+ data contracts to facilitate ingestion of semi structured data into Snowflake, improving data availability by 25% ● Managed end-to-end processes of ETL pipelines ensuring efficient and accurate data delivery; addressed technical challenges promptly, maintaining SLAs 99% operational success rate
Managed large datasets (+100M records), implemented data contracts for semi-structured data, and ensured high operational success rates (99% SLA).
About Data Engineer
A highly motivated Data Engineer with over four years of experience, specializing in SQL, Python, Snowflake, and AWS, and possessing a strong track record in designing and optimizing ETL processes. Adept at managing large-scale datasets and building automated data pipelines, with proven skills in data analysis, visualization, and cloud-based data solutions, further validated by Snowflake certification.
75711
Skills
SQL
Designed and optimized ETL processes using SQL. Managed large-scale datasets (100M+ records) in Snowflake. Created and maintained complex queries, views, and stored procedures for data transformations
Python
Built ETL pipelines, automated data ingestion, and performed data transformations. Used Pandas, NumPy, Matplotlib and Seaborn for data analysis. Developed scripts for web scraping and data extraction
Snowflake
Designed and migrated data workflows to Snowflake-centric architecture. Implemented data contracts for structured and semi-structured data ingestion. Snowflake certified
AWS (S3)
Managed cloud-based data storage and ETL processes. Integrated Snowflake with AWS S3 for scalable data ingestion
ETL/ETL Pipelines
Built and optimized end-to-end ETL/ELT processes using SQL, Python, and Snowflake. Ensured data quality and integrity through validation and monitoring
Gir & Version Control
Managed code versioning using Git and GitHub. Collaborated in Agile teams using Jira and Confluence.