About this opportunity
NutaNXT Technologies lists this Senior Data Engineer - Azure Databricks & Data Pipelines opportunity in santa clara, California. Review the employer’s description below for duties, qualifications and application requirements.
Job description
NutaNXT is looking for supporting the planning and implementation of data design services, providing sizing and configuration assistance and performing needs assessments. Delivery of architectures for transformations and modernizations of enterprise data solutions using Azure cloud data technologies. As a Senior Data Engineer, you will collect, aggregate, store, and reconcile data in support of Customer’s business decisions. You will design and build data pipelines, data streams, data service APIs,
data generators and other end-user information portals and insight tools.
RESPONSIBILITIES
Plan, build and implement data solutions based on DataBricks or other ETL Tools.
Design and build Modern Data Pipelines and Data Streams
Develop and Maintain Data Warehouse
Design and create ETL processes supplying Data Warehouse
Implement effective metrics and monitoring process
Preprocess of structured and unstructured data, create queries in databases
Ability to conduct data profiling, cataloging, and mapping for technical design and construction of technical data flows
Experience with any programming language used for data engineering purpose: Python, Scala, R, Java etc.
QUALIFICATIONS
Experience working with Azure Databricks
Familiarity with PySpark
Very good in communication, both verbal and written
Mastery of SQL (T-SQL or PL SQL preferred)
Knowledge of at least one component: Azure Data Factory, Azure Data Lake, Azure SQL DW, Azure SQL
Minimum experience of 8+ Years in the ETL & Data Engineering space.
Microsoft Certified: Azure Data Engineer
Knowledge of the following components of Azure Analytics: Azure HDInsight with Spark, Azure Stream Analytics, Azure IoT Hub, or Azure Event Hub, Azure CosmosDB
Experience preparing data for Data Science and Machine Learning
Knowledge of Jupyter Notebooks or Databricks Notebooks for Python development
Europe and APAC regions
#J-18808-Ljbffr
Worksite address
santa clara, CA, 95053, US
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.