Technocrats Domain Technologies
|Data Engineer
Hyderabad, Telangana, India
Summary
Currently leading the design and optimization of incremental ETL pipelines and data warehousing solutions to deliver high-reliability data ingestions and business intelligence reporting for key business operations.
Highlights
Designed and optimized incremental ETL pipelines using Azure Data Factory (ADF), Databricks, ADLS, Python, and SQL, enabling efficient daily ingestions of multiple pipelines (~1GB) with high reliability.
Built and maintained a Snowflake data warehouse, implementing star schemas (fact and dimension tables) to enable efficient business intelligence reporting.
Automated ETL workflows using ADF Dataflows, Copy Activities, and Notebooks to transform raw data from databases, Excel, CSV, and IBM sources into structured formats.
Provided production support by resolving pipeline failures, debugging daily jobs, and performing root cause analysis for data mismatches raised through ServiceNow.
Partnered with Business Analysts to deliver accurate and timely financial insights by applying data validation and quality checks, improving reporting accuracy by 20% and reducing manual data fixes.