About this opportunity
Data Surge lists this Data Engineer opportunity in roanoke, Virginia. Review the employer’s description below for duties, qualifications and application requirements.
Job description
Senior Data Engineer With Databricks
Remote, Anywhere in the Continental US
Due to the nature of the role, this position requires U.S. Citizenship.
Data Surge is disrupting the services industry with cutting-edge technology that brings together the very best consultants from the big data, machine learning, and software modernization space.
At Data Surge, we value collaboration , curiosity , and being customer centric . Our team thrives on collective efforts, innovation, and a commitment to wellness , ensuring employees are empowered to thrive professionally and personally.
About the Role
We are seeking a skilled and motivated Data Engineer with deep Databricks and cloud experience to support our Federal Services team. In this role, you will help design and implement scalable data solutions, build and optimize pipelines, and automate infrastructure within secure cloud environments.
This role is ideal for experienced developers who enjoy tackling complex data engineering challenges, optimizing performance, and contributing to impactful government programs. You'll help shape robust, secure, and efficient pipelines that serve critical public-sector missions.
Day-to-Day Impact
Design, develop, and optimize robust data pipelines in Databricks to process and transform large-scale data sets
Collaborate with data scientists, engineers, and cloud architects to build reliable, secure data systems
Automate infrastructure provisioning using Terraform and manage resources on Azure (or AWS/GCP)
Monitor, troubleshoot, and support production-grade data pipelines and jobs
Develop CI/CD workflows to streamline deployment and version control of data processing code
Ensure security, performance, and reliability across all stages of data workflow
Utilize and manage Docker containers where needed to deploy data services
Participate in Agile team ceremonies and help shape iterative data delivery plans
Support continuous improvement in data architecture, automation, and governance practices
Other duties as reasonably required
Essential Experience
5+ years of experience in data engineering or backend data infrastructure roles
2+ years of hands-on experience with Databricks, Spark, or distributed data processing systems in a production environment
Deep proficiency with PySpark and Python for data engineering tasks
Experience with data modeling
Solid experience with Airflow, dbt, or other orchestration and transformation tools
Proven skills in data governance, lineage, or security best practices
Experience working with Azure (preferred), AWS, or Google Cloud
Strong working knowledge of CI/CD tools and version control workflows
Comfortable working with relational (e.g., PostgreSQL, MySQL) and NoSQL databases
Proven experience in monitoring, debugging, and scaling cloud-based data systems
Strong communication skills and ability to work independently in a remote team environment
Kudos If You Have:
Experience with Kubernetes and Helm for deploying data workloads (not required)
Solid experience with Terraform or other Infrastructure as Code tools
Familiarity with containerization using Docker
Knowledge of data lakehouse architectures and Delta Lake
Experience working on Federal or government projects
Existing security clearance (preferred but not required)
Databricks Certification
Learn More
Data Surge offers a competitive compensation and total rewards package.
Comprehensive Benefits
Remote-first work environment
PTO – Including holidays + your birthday
401(k) with 4% Match, immediately vested
Growth and development opportunities
Bonuses + more
Find out more about our story at .
Visit our Careers page to explore our openings at
Follow us on LinkedIn at .
As a participator in E-Verify, Data Surge electronically confirms employment eligibility of employees to work in the United States.
Job Type: Full-time
Benefits:
401(k)
401(k) matching
Dental insurance
Health insurance
Paid time off
Retirement plan
Vision insurance
Education:
Bachelor's (Preferred)
Experience:
Data Engineering: 7 years (Preferred)
Databricks: 3 years (Preferred)
Work Location: Remote
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.