Job description
Job Purpose The Senior Data Engineer designs, builds, and maintains scalable data pipelines and architectures to support the Denials AI workflow under the guidance of the Team Lead, Data Management. This role ensures data is reliable, compliant with HIPAA, and optimized.
Required Hours: 9AM-5PM EST
Duties & Responsibilities
Collaborate with the Team Lead and cross functional teams to gather and refine data requirements for Denials AI solutions
Design, implement, and optimize ETL/ELT pipelines using Python, Dagster, DBT, and AWS data services (Athena, Glue, SQS)
Develop and maintain data models in PostgreSQL; write efficient SQL for querying and performance tuning
Monitor pipeline health and performance; troubleshoot data incidents and implement preventive measures
Enforce data quality and governance standards, including HIPAA compliance for PHI handling
Conduct code reviews, share best practices, and mentor junior data engineers
Automate deployment and monitoring tasks using infrastructure-as-code and AWS CloudWatch metrics and alarms
Document data workflows, schemas, and operational runbooks to support team knowledge transfer
Other duties as assigned
Use, protect and disclose patients’ protected health information (PHI) only in accordance with Health Insurance Portability and Accountability Act (HIPAA) standards
Understand and comply with Information Security and HIPAA policies and procedures at all times
Limit viewing of PHI to the absolute minimum as necessary to perform assigned duties
Qualifications
Bachelor’s or master’s degree in Computer Science, Data Engineering, or related field
5+ years of hands on experience building and operating production grade data pipelines
Solid experience with workflow orchestration tools (Dagster) and transformation frameworks (DBT) or other similar tools such (Microsoft SSIS, AWS Glue, Air Flow)
Strong SQL skills on PostgreSQL for data modeling and query optimization or any other similar technologies (Microsoft SQL Server, Oracle, AWS RDS)
Working knowledge with AWS data services: Athena, Glue, SQS, SNS, IAM, and CloudWatch
Basic proficiency in Python and Python data frameworks (Pandas, PySpark)
Experience with version control (GitHub) and CI/CD for data projects
Familiarity with healthcare data standards and HIPAA compliance
Experience mentoring or leading small technical efforts
Proficiency in Microsoft Office Suite
Strong interpersonal skills, ability to communicate well at all levels of the organization
Strong problem solving and creative skills and the ability to exercise sound judgment and make decisions based on accurate and timely analyses
High level of integrity and dependability with a strong sense of urgency and results oriented
Excellent written and verbal communication skills required
Working Conditions
Regular working hours; on-call for data pipeline incident response.
Must possess a smart-phone or electronic device capable of downloading applications, for multifactor authentication and security purposes.
Physical Demands: While performing the duties of this job, the employee is occasionally required to move around the work area; Sit; perform manual tasks; operate tools and other office equipment such as computer, computer peripherals and telephones; extend arms; kneel; talk and hear.
Mental Demands: The employee must be able to follow directions, collaborate with others, and handle stress.
Work Environment: The noise level in the work environment is usually minimal.
Med-Metrix will not discriminate against any employee or applicant for employment because of race, color, religion, sex (including pregnancy, gender identity, and sexual orientation), parental status, national origin, age, disability, genetic information (including family medical history), political affiliation, military service, veteran status, other non-merit based factors, or any other characteristic protected by federal, state or local law.
Originally posted on Himalayas
Who can apply
Eligible countries: United States. Accepted UTC offsets: UTC-10, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.