Senior Azure Data Engineer

Job Description: Position Summary We are seeking a Senior Azure Data Engineer with 8+ years of experience designing, developing, and optimizing large-scale data platforms. The ideal candidate brings strong expertise in Microsoft Azure data services, Microsoft Fabric, and Data Lake architecture, along with hands-on experience in financial forecasting modeling, PySpark, and SQL programming. In this role, you will collaborate with cross-functional teams to build robust, scalable, and secure data pipelines and analytics platforms that support business intelligence, financial planning and analysis, data science, and advanced analytics initiatives. Key Responsibilities Data Integration and Pipeline Development Design, develop, and maintain data ingestion, transformation, and integration pipelines using Azure Data Factory, Microsoft Fabric, and Azure Synapse Analytics. Integrate data from disparate systems and applications, ensuring data is reliable, well-documented, and fit for downstream analytics. Develop and maintain scalable data-processing solutions using Python and PySpark. Write, review, and optimize SQL programs for data transformation, analysis, and reporting, including complex queries and database objects as appropriate. Optimize data flows and pipeline performance for scalability, efficiency, and reliability. Cloud Architecture and Implementation Architect and implement Azure Data Lake and Delta Lake solutions for structured and unstructured data. Build and support data solutions using Microsoft Fabric and its applicable data engineering and analytics capabilities. Utilize cloud-based data warehouse and data lake solutions. Apply modern data architecture patterns, including Medallion (Bronze/Silver/Gold) design. Financial and Business Analytics Partner with finance and business stakeholders to understand financial planning, forecasting, and analytical requirements and translate them into data solutions. Work with financial models and the data that supports them, helping ensure inputs, transformations, assumptions, and outputs are traceable and reliable. Prepare, integrate, validate, and structure financial and operational data for modeling, analysis, and business intelligence. Collaborate with analysts to improve the quality, consistency, and usability of data used in financial and performance reporting. Collaboration and Leadership Provide technical guidance and promote engineering best practices for Azure- and Fabric-based data solutions. Communicate technical concepts, design decisions, and data limitations clearly to technical and non-technical audiences. Performance Monitoring and Optimization Monitor data quality and performance metrics; investigate and resolve data-related issues. Continuously optimize pipelines, SQL queries, and database structures for efficiency and reliability. Apply appropriate data quality checks and operational controls to support trusted analytics. Required Skills and Experience Technical Skills