Job description
Overview
We are seeking a skilled Azure Data Architect & Engineer to lead the design and implementation of our modern data platform. In this dual-capacity role, you will define the architectural roadmap for our cloud data estate while remaining hands-on in building scalable pipelines, optimizing Spark performance, and migrating legacy workloads into Microsoft Fabric and Azure Synapse.
Responsibilities
Architectural Leadership: Design and implement scalable, secure, and resilient cloud data architectures using the Medallion (Bronze/Silver/Gold) architecture pattern.
Data Pipeline Engineering: Build and maintain complex ETL/ELT workflows using Azure Data Factory (ADF) and Microsoft Fabric Data Factory.
Advanced Analytics & Spark: Develop high-performance data processing logic using PySpark, Spark SQL, and Python on Azure Databricks or Fabric Spark Notebooks.
Migration & Modernization: Lead hands-on migrations of on-premises data warehouses to Azure, ensuring minimal downtime and data integrity.
Performance Tuning: Perform deep code-level analysis of Spark core internals and Delta Lake logs to troubleshoot and optimize large-scale data processing.
Unified Analytics: Integrate Power BI with OneLake and Lakehouse architectures, ensuring seamless "Direct Lake" connectivity and optimized reporting.
Security & Governance: Implement robust security frameworks, including Row-Level Security (RLS), data masking, and compliance with global privacy regulations
DevOps & Best Practices: Champion CI/CD for data (DataOps) using Azure DevOps/GitHub, ensuring code modularity, version control, and comprehensive documentation.
Qualifications
Core Experience
3–5+ years of experience in Data Warehousing, BI, and Cloud Data Engineering.
Proven track record of designing end-to-end data solutions on Microsoft Azure.
The Azure Stack - Azure Data Lake Storage (ADLS Gen2), Azure SQL DB, and Synapse Analytics, ADF, Fabric ecosystem
Data Modeling & Visualization
Expertise in Dimensional Modeling (Star/Snowflake schemas).
Advanced Power BI skills, including DAX, RLS implementation, and performance tuning for large datasets.
Programming & Infrastructure
Strong proficiency in Python (PySpark) and SQL.
Understanding of Infrastructure as Code (ARM templates, Terraform, or Bicep) and hybrid cloud integration.
Preferred Certifications
DP-203: Azure Data Engineer Associate
DP-600: Fabric Analytics Engineer Associate
DP-700: Fabric Data Engineer Associate (New/Beta)
HarperCollins Publishers is a company full of people who are passionate about books. When you apply for a position, we want to know why you want to work here, and why you are interested in the job. That’s why cover letters are strongly preferred.
The salary range for this position is $110,000-$135,000. We recognize that attracting the best talent is key to our strategy and success as a company. As a result, we aim for flexibility in structuring competitive compensation offers to ensure we are able to attract the best candidates. The quoted salary range represents our good faith estimate as to what our ideal candidates are likely to expect, and we tailor our offers within the range based on the selected candidate's experience, industry knowledge, technical and communication skills, and other factors that may prove relevant during the interview process.
In addition to cash compensation, the company provides a comprehensive and highly competitive benefits package, with a variety of physical health, retirement and savings, caregiving, emotional wellbeing, transportation, and other benefits, including "elective" benefits employees may select to best fit the needs and personal situations of our diverse workforce.
HarperCollins Publishers is an equal opportunity employer.
HarperCollins Publishers is committed to providing reasonable accommodation for qualified individuals with disabilities, in our job application and/or interview process. If you need assistance or accommodation in completing your application, due to a disability, email us at . Note: we will only respond to accommodation requests.
Originally posted on Himalayas
Who can apply
Eligible countries: United States. Accepted UTC offsets: UTC-10, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.