waypointjobs

Citi

Big Data/PySpark Engineering Lead - Vice President

tampa, FL

Check who can apply and the requirements below before continuing.

This job is closed

Applications are no longer available for this announcement. Explore current related opportunities below.

Job description

The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Key Responsibilities

Architecture & Design

Design and implement scalable, fault-tolerant batch and real-time data processing pipelines.

Develop robust data models and schema designs optimized for both performance and storage efficiency.

Evaluate and integrate emerging tools and frameworks (e.g., Spark, Flink, Kafka) into the existing stack.

Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions

Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals

Data Modernization & Migration Leadership

Legacy Systems Decommissioning: Lead the strategic migration of data and logic from legacy platforms (e.g. on-premises SQL Servers) to a modern Data Lakehouse environment.

ETL/ELT Transformation: Re-engineer existing stored procedures and complex legacy ETL jobs into scalable, distributed processing frameworks using Spark (Python) and Starburst/Trino.

Validation & Parity Testing: Design and implement automated frameworks for Data Parity Testing to ensure 100% accuracy and consistency between legacy outputs and new big data results.

Schema Evolution: Map and transform rigid, legacy relational schemas into flexible, high-performance formats optimized for the cloud (e.g., Parquet, Avro, or Iceberg).

Phased Cutover Management: Orchestrate a phased migration strategy (Parallel Run, Shadow Execution) to ensure zero downtime for downstream business applications and reporting tools.

Performance Benchmarking: Establish performance baselines on legacy systems and ensure the new Big Data architecture meets or exceeds those benchmarks at scale.

Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards

2. Engineering Excellence

Write clean, high-performance code in Python.

Optimize complex SQL queries and fine-tune distributed computing clusters to reduce latency and costs.

Ensure data integrity and security by implementing rigorous validation and encryption standards.

3. DevOps & Reliability

Build and maintain CI/CD pipelines for automated testing and deployment of data jobs.

Monitor system health and troubleshoot performance bottlenecks across the data lifecycle.

4. Leadership & Strategy

Provide technical mentorship and conduct code reviews for junior and mid-level engineers. Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary.

Translate complex business requirements into technical specifications.

Collaborate with Product Managers to ensure data availability for downstream analytics, business models and users

Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements

Recommended Qualifications:

6+ years of relevant experience in the Financial Service industry

Experience as Applications Development Manager

Experience as senior level in an Applications Development role

Experience in Data Engineering, focused on Big Data ecosystems.

Knowledge in Hadoop, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development. Programming Expert level and hand on experience in Python.

Familiarity with data formats like Avro, Parquet, CSV, JSON.

Hands-on experience in writing SQL queries.

Highly experienced with Unix based operating systems and shell scripting.

Experience with source code management tools such as Bitbucket, Git etc.

Big Data Tech Proficiency and hands-on in Hadoop, Spark, Hive, Kafka, and NoSQL databases (MongoDB, HBase).

Experience working with query engines like Trino, Presto, Starburst

Strong computer science fundamentals in data structures, algorithms, databases, and operating systems.

Reverse Engineering, ability to read "spaghetti" SQL or old scripts and document the business logic before moving it.

Data Lineage, Experience using tools (like Collibra or Informatica) to track where data comes from and where it’s going.

Change Management, Experience managing the technical "shock" to the business when switching from legacy BI tools to modern query engines like Starburst.

Stakeholder and people management experience

Demonstrated leadership skills

Proven project management skills

Basic knowledge of industry practices and standards

Consistently demonstrates clear and concise written and verbal communication

Education:

Bachelor’s degree/University degree or equivalent experience

Master’s degree preferred

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Primary Location:

Tampa Florida United States

Primary Location Full Time Salary Range:

$113,840.00 - $170,760.00

In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above.

Anticipated Posting Close Date:

Jul 27, 2026

Automated Processing and AI

We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.

Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.

Illinois residents - AI Notice and Right

Equal Opportunity Statement

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.

#J-18808-Ljbffr

Worksite address

tampa, FL, 33646, US

Who can apply

Review the original listing for work authorization, qualifications and employer requirements.

Explore related searches

Current related jobs

Akron Children's Hospital

WhatJobs

Certified Surgical Technologist (CST)

akron, OH

Salary not specified

Full-time, 40 hours/week M-F variable hours 11am-11pm or 3-11pm with call commitment Onsite- Akron $10,000 Sign on bonus (available) taxabl…

Last received from source 2026-10-17View job

SPECTRUM

WhatJobs

Assistant Store Manager

eau claire, WI

Salary not specified

This role requires the ability to work lawfully in the U.S. without employment-based immigration sponsorship, now or in the future. Please ensure…

Last received from source 2026-10-17View job

Connecticut Institute For Communities Inc.

WhatJobs

Preschool Classroom Aid / CDA Specialist

danbury, CT

Salary not specified

Connecticut Institute for Communities, Inc. Make your application after reading the following skill and qualification requirements for this posit…

Last received from source 2026-10-17View job