About this opportunity
Harvey Nash lists this Senior Data Engineer opportunity in short hills, New Jersey. Review the employer’s description below for duties, qualifications and application requirements.
Job description
The following information aims to provide potential candidates with a better understanding of the requirements for this role.
Senior Data Engineer
Location: Short Hills, NJ
Work Model: Hybrid – 2 days onsite per week
Employment Type: Contract-to-Hire
About the Role
We are looking for Senior Data Engineer to join a collaborative Data & Analytics team supporting Claims Analytics . This is a hands-on engineering role focused on building, enhancing, and supporting modern data applications and pipelines.
The ideal candidate has strong experience with Python, PySpark, SQL, and Databricks , along with cloud data engineering experience in Azure or another major cloud platform .
You will work closely with Data Architects, Product Owners, and other engineering teams to design, develop, optimize, and support enterprise-scale data solutions.
Databricks
Unity catalogue
They are able to write python code for pipelines within databricks
Spark Declarative pipelines - need to know how to write these
How to ingest data within databricks
Data eng. skillset - 3 main things We are looking for
Building pipelines, designing projects and implementing them, hands on
Good understanding of the data, if he gives you a data set, can they look at it and tell what story it's telling
Ability to learn and pickup things quickly, basic analytical skills
What You'll Do
Design, develop, and support new and existing data engineering applications.
Build and maintain scalable ETL/ELT pipelines and data integrations.
Develop data solutions using Python, PySpark, SQL, and Databricks .
Work with Data Architects to translate high-level data flows into technical implementations.
Optimize SQL queries, Spark jobs, schemas, and data pipelines for performance and scalability.
Develop and maintain data solutions across Data Lake and Data Warehouse environments.
Participate in code reviews, testing, deployment, and technical documentation.
Monitor production data pipelines and troubleshoot complex issues.
Support CI/CD processes for data engineering applications.
Work collaboratively with Product Owners, Product Managers, Scrum Masters, and engineering teams.
Provide technical guidance and help mentor junior engineers.
Required Qualifications
5–8 years of experience in Data Engineering, Data Integration, or Data Warehousing.
Strong hands-on experience with Python .
Strong experience with PySpark / Apache Spark .
Advanced SQL skills.
Hands-on experience with Databricks .
Experience with Azure, AWS, or GCP , preferably Azure.
Strong understanding of Data Lakes, ETL/ELT, and data modeling .
Experience optimizing data pipelines and SQL queries for performance.
Experience with CI/CD pipelines .
Strong problem-solving and production troubleshooting skills.
Ability to work effectively in a collaborative Agile environment.
Nice to Have
Delta Lake
Azure Data Factory
Azure Synapse
Kafka or Kinesis
Streaming/event-driven architectures
Power BI
Azure ML
Experience supporting analytics or machine learning platforms
Experience working in regulated enterprise environments
Data security, encryption, and access-control experience
Interview Process
The technical interview will include live coding and technical problem-solving .
Candidates should be prepared for:
Python/PySpark coding
SQL testing
Data engineering scenarios
Spark/PySpark troubleshooting
Performance optimization
Experience-based and scenario-based technical questions
What We're Looking For
We're looking for someone who is genuinely hands-on and comfortable working deep in the technology. Strong candidates will have recent experience building production data solutions rather than simply managing or overseeing them.
Core skills: Python | PySpark | SQL | Databricks | Azure | Data Engineering | Data Lake | ETL/ELT
If you're interested in building scalable data solutions and working with a strong Data & Analytics team, we'd love to hear from you.
A reasonable, good faith estimate of the minimum and maximum hourly wage for this position is $70/Hr. to $75/hr.
Benefits of our contractor
At Harvey Nash, we know that great technology professionals deserve great support. That’s why we offer a comprehensive benefits package designed to help you thrive—professionally and personally. From company-contributed medical, dental, and vision plans to a 401(k), we invest in your health and future. You’ll also enjoy perks like referral bonuses, commuter savings, a mobile payroll app for easy access to your pay and benefits, and a variety of voluntary insurance options to fit your lifestyle. Join a global IT leader that values your expertise, rewards your contributions, and supports your well-being every step of the way.
* The pay range listed above reflects the expected starting salary /Pay rate for this role. xzgxqkn This range may be adjusted based on market conditions, location, and other relevant factors. The Company will determine the final starting salary/Pay rate in consultation with the selected candidate(s), in full compliance with applicable laws
Worksite address
short hills, NJ, 07078, US
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.