About this opportunity
Samprasoft lists this BigData Engineer opportunity in mc lean, Virginia. Review the employer’s description below for duties, qualifications and application requirements.
Job description
Big Data EngineerLocation: Hybrid Onsite (Mclean, VA)Duration: 6-12 months ContractResponsibilities include:Cleanse, manipulate and analyze large datasets (Semi-Structured and Unstructured data – XMLs, JSONs, CSVs, PDFs) using python and Snowflake database.Develop Python scripts to filter/cleanse/map/aggregate data.Manage and implement data processes (Data Quality reports)Develop data profiling, deduping logic, matching logic for analysisProgramming Languages experience in Python, PySpark and SQL for data ingestionPresent ideas and recommendations on data handling and data parsing technologies to managementQualifications:5+ years of experience in processing large volumes and variety of data (Structured and semi-structured data, writing code for parallel processing, shredding XMLS, JSONs and reading PDFs) - Mandatory3+ years of programming experience in Python for data processing and analysis – Mandatory2+ years of experience with Snowflake, preferable parsing JSON and XML files- DesirableStrong SQL experience is a must - Mandatory3+ years of experience – using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work - Optional2+ years of programming experience in PySpark for data processing and analysis - OptionalDetail oriented. Excellent communication skills (verbal and written)Must be able to manage multiple priorities and meet deadlines
Worksite address
mc lean, VA, 22101, US
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.