Job description
This is a remote position.
We are seeking a Data Engineer with approximately 5 years of experience to design, build, and maintain scalable data platforms and pipelines. The ideal candidate will have strong expertise in modern data engineering practices, distributed data processing technologies, and open data lake architectures. This role involves working closely with cross-functional teams to ensure reliable, efficient, and high-quality data solutions that support analytics and business needs. The Key Responsibilities are:
Build resilient data pipelines using Medallion architecture principles.
Manage and optimize open storage formats including Parquet, Iceberg, and Delta Lake.
Design, develop, and maintain distributed data processing workloads using Databricks and Apache Spark.
Perform database operations, optimization, and maintenance for PostgreSQL and SQLite environments.
Ensure data quality, reliability, scalability, and performance across data platforms.
Collaborate with data consumers and stakeholders to support reporting, analytics, and operational data requirements.
Monitor, troubleshoot, and improve data infrastructure and pipeline performance.
Follow data engineering best practices, coding standards, and documentation processes.
Requirements
Requirements
Bachelor’s degree in Computer Science, Software Engineering, or a related field.
Approximately 5 years of experience in Data Engineering or a related role.
Advanced SQL skills with strong expertise in PostgreSQL.
Strong proficiency in Python and DuckDB.
Experience with data lakes and open-source query and storage layers.
Hands-on experience working with Parquet, Iceberg, and Delta Lake.
Experience with distributed computing frameworks, specifically Databricks and Apache Spark.
Strong understanding of data modeling, ETL/ELT processes, and data pipeline development.
Knowledge of database administration, performance tuning, and optimization techniques.
Excellent problem-solving and analytical skills.
Ability to work effectively both independently and within a collaborative team environment.
Excellent English communication skills.
This opportunity is remote for Egyptian applicants and Hybrid for Lebanese applicants.
Originally posted on Himalayas
Who can apply
Eligible countries: United States. Accepted UTC offsets: UTC-10, UTC-9, UTC-8, UTC-7, UTC-6, UTC-5, UTC+14. Review the full description for employer-specific work authorization, residency and schedule requirements.