Lead Data Engineer

Job Descriptions:
In this contingent resource assignment, you may: Consult on complex initiatives with broad impact and large-scale planning for Software Engineering.
Review and analyze complex multi-faceted, larger scale or longer-term Software Engineering challenges that require in-depth evaluation of multiple factors including intangibles or unprecedented factors.
Contribute to the resolution of complex and multi-faceted situations requiring solid understanding of the function, policies, procedures, and compliance requirements that meet deliverables.
Strategically collaborate and consult with client personnel.

Required Qualifications:
5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work or consulting experience, training, military experience, education.

Overview:
We are seeking a highly motivated Senior Software Engineer with strong experience building and maintaining enterprise'scale data pipelines. This role requires more than technical execution-you must demonstrate ownership, accountability, and proactive communication. The ideal candidate leads work, escalates risks early, partners closely with product teams, and delivers outcomes without needing to be hand?held.
Experience in financial services within a large enterprise environment is a strong plus.

Key Responsibilities:
Design, build, and maintain high?performance, scalable data pipelines in a large enterprise environment
Develop and optimize solutions using SQL, PySpark, and Python
Take full ownership of assigned deliverables, from design through production support
Lead prior initiatives by:

Driving deliverables to completion:
Clearly communicating status, risks, and dependencies
Proactively escalating issues rather than waiting on direction
Partnering closely with product managers and upstream/downstream teams

Translate business requirements into technical solutions with a data'driven mindset
Improve pipeline reliability, scalability, and performance
Contribute to and enhance CI/CD pipelines, code quality, test coverage, and security remediation
Act as a strong collaborator and mentor within Agile teams

What We're Looking For (Behavioral & Leadership)
Strong communication skills-clear, concise, and proactive
Demonstrated ability to hold yourself accountable and follow through on commitments
A self'starter mentality: you don't wait-you identify, act, and escalate
Proven experience leading or owning past projects, not just contributing tasks
Comfortable working in fast?paced, enterprise'scale environments

Required Qualifications:
7+ years of overall experience as a Software Engineer
4+ years of experience building big data pipelines
4+ years of hands?on experience with Apache Spark, Hive, and Iceberg tables
4+ years working with SQL Server or other RDBMS platforms

Strong programming experience with:
Python
PySpark / Spark'SQL
Scala
Bash scripting
Strong experience with CI/CD pipelines, improving code coverage, and vulnerability remediation
2+ years of experience working in Agile (Scrum / SAFe) environments

Most Important Technical Skills
SQL
Python
PySpark

Good to Have
Experience in financial services within a large enterprise
Understanding of REST APIs, Dremio, and Object Storage
Experience building streaming or event'driven pipelines using Apache Kafka
2+ years of automation experience using Autosys or Apache workflow tools (Airflow, Oozie, etc.)

Why This Role
This position is ideal for engineers who want to own outcomes, influence architecture, and lead through action-not wait for instructions. If you thrive in environments that expect accountability, strong communication, and technical excellence, this role offers meaningful impact and visibility.

EEO:
"Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans."