Data Engineer

Software Technology Inc

United States

Data Developer

Apex Systems is now hiring Data Developers for one of our top clients in the financial services industry.

Location: 100% remote; prefer someone local to Richmond or Plano

Duration: 1 year – 2 year extension

Interview Process: 1 round to hire

Please contact Patrick Haley for more information

Project Details:

Receives all cloud operational logs (infrastructure, application engineering, etc) from various internal sources and serves as the gateway for log analytics

Daily Responsibilities:

Python and Spark heavy role—heavy coding
Python, PySpark
Building big data streaming pipelines from scratch and maintaining them.
Experience building big data pipelines
Experience scaling data pipelines on the cloud

Required Qualifications:

8+ years of experience overall
5+ years of coding experience with Spark and Python
3+ years of experience developing software solutions to solve complex business problems
5+ years of hands-on AWS experience
SQL
Experience building big data pipelines

Preferred Qualifications:

Financial industry experience
Scala
Kafka
Kinesis

Required Skills: Total Solids Basic Qualification: aws, spark, python Additional Skills: aws, spark, python Background Check: Yes Notes: Upon offer, it is required to show consultants W2 take home pay in the Exh A. Vendor must disclose candidate's W2 hourly $$$ in the comments section when submitting in iLabor.

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Data Engineer in United States vacancy

Data Engineer
...MANTECH seeks a motivated, career and customer-oriented Data Engineer to join our team in Chantilly, VA. The Data Engineer will leverage their development skills and experience to support the successful designing, ingesting, cleansing, transformation, loading...
Suggested
Full time
Work at office
MANTECH
Chantilly, Loudoun County, VA
10 hours ago
Data Engineer
...MANTECH seeks a motivated, career and customer-oriented Data Engineer to join our team in Herndon VA. The Data Engineer will leverage their expertise with Python to support the customer’s data pipelines and related applications, from collection to ingestion, and ensure...
Suggested
MANTECH
Herndon, VA
10 hours ago
Senior Data Engineer
...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. The Senior Data Engineer will leverage their strong technical background and knowledge to support the Sponsor’s data initiatives, to include designing...
Suggested
Full time
Work at office
MANTECH
Chantilly, Loudoun County, VA
10 hours ago
Data Engineering Analyst
...Focused on improving data pipelines and migrating legacy systems, the remote contract Data Engineering Analyst will enhance data accuracy and system performance while ensuring seamless data transfer and integration. Key responsibilities: Improve data pipelines through...
Suggested
Contract work
Remote work
Virtual Vocations Inc
United States
2 days ago
Lead Data Engineer
£1,000 per month
...years. Join us - and help us fulfil our mission to close the world’s digital skills gap. What you’ll bring to the table: As a Lead Data Engineer, you’ll help our clients deploy and maintain data pipelines in a production‑safe manner, using the latest technologies and with...
Suggested
Flexible hours
AND Digital
Parsons, WV
3 days ago
Lead Data Engineer
...Providing technical leadership in a full-time capacity, the Lead Data Engineer will design, develop, and manage enterprise data platforms and integration services, ensuring data-driven decision-making across the organization while collaborating with business and technology...
Full time
Remote work
Virtual Vocations Inc
United States
5 days ago
Lead Data Engineer
...Responsibilities Lead modernization of legacy data platforms, migrating ETL/ELT and ingestion frameworks to cloud (Azure/AWS). Own... ...monitoring processes. Establish CI/CD and DevOps practices for data engineering workflows. Monitor and optimize pipeline performance,...
ValueMomentum
Kansas City, MO
2 days ago
Lead Data Engineer
...Lead Data Engineer with Agentic AI experience Core must-haves (screen for these explicitly) Applied Agentic AI engineering experience: evidence of building Agentic workflows - ideally delivered into a real project. Modern multi-agent architecture experience: hands‑on designing...
TechDigital Group
Saint Louis, MO
3 days ago
Lead Data Engineer
...Lead Data Engineer / Technical Architect Location: Chicago Reporting to: CIO Open to SOW to Hire, SOW, or FTE About the Role We are looking for an experienced Lead Data Engineer / Technical Architect to design and deliver a full end-to-end data architecture strategy for...
InterEx Group
Chicago, IL
3 days ago
Senior Data Engineer
$120.7k - $142k
...Job Description You will play a key role in shaping how data flows across Uncommon Schools, helping teams make better decisions... ...that directly impact students and communities. As a Senior Data Engineer, you'll design and build the systems that connect our applications...
Summer holiday
Work at office
Local area
Flexible hours
3 days per week
Uncommon Schools
New York, NY
4 hours ago
Data Engineer
...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Data Engineer based in the United States. This role sits at the intersection of data engineering, cloud architecture, and mission-critical...
Remote job
Full time
Flexible hours
jobgether
United States
7 hours ago
Lead Data Engineer
...HiLabs is looking for highly motivated and technically strong Lead Data Engineers with deep expertise in Big Data platforms and a passion for building scalable, data-intensive systems. The ideal candidates will have strong hands-on experience in Spark, PySpark, distributed...
Relocation
Relocation package
HILABS Inc
Bethesda, MD
3 days ago
Lead Data Engineer
...The Role We're looking for a Lead Data Engineer to own the data infrastructure that powers GXL's AI products (eg. Paperclip). You'll be responsible for designing, building, and maintaining the pipelines, warehouses, and systems that our research and products depend on....
Visa sponsorship
GXL
Palo Alto, CA
3 days ago
Lead Data Engineer
$149.3k - $200.2k
...products and techniques that shape industry norms and enhance how audiences experience sports, entertainment & news. The Product & Data Engineering team is responsible for end to end development for Disney’s world-class consumer-facing products, including streaming...
Work experience placement
Worldwide
The Walt Disney Company
Seattle, WA
2 days ago
Lead Data Engineer
$107k - $135k
...Overview The Lead Data Engineer is responsible for the design, architecture and support of systems, services and applications required for the collection, storage, processing, and analysis of all forms of data to enable data-driven decisions and outcomes across the enterprise...
Contract work
Work at office
Remote work
Work visa
Relocation package
3 days per week
Aegon
Cedar Rapids, IA
5 days ago
Lead Data Engineer
$100k - $200k
...Who We Are Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... .... Build Dream Teams. Who You Are You’re a senior, hands‑on data engineer with 8+ years of experience designing, building, and operating production...
Local area
Flexible hours
Galaxy USA
New York, NY
3 days ago
Lead Data Engineer
...store, online, ATM, and other channels to Wells Fargos more than 70 million global customers. Wells Fargo Bank N. A. seeks a Lead Data Engineer in Raleigh, NC. Job Role and Responsibility: Lead complex initiatives with broad impact and act as key participant in large...
Wells Fargo
Raleigh, NC
2 days ago
Lead Data Engineer
...Must have skills: Azure Cloud, MS Fabric, ADF, Azure SQL, Synapse, DBT Preferred skills: Data Mesh implementation, Insurance domain Detailed Job Description Designs, builds, and maintains scalable data pipelines and architectures, leading a team to deliver robust data...
TechDigital Group
New York, NY
2 days ago
Lead Data Engineer
$152.73k
...applying judgment, empathy, and expertise in the moments that matter most. Responsibilities State Farm (Bloomington, IL) seeks a Data Engineer to design and implement complex knowledge graph structures to enhance claims investigation and fraud detection through advanced...
Full time
Remote work
State Farm
Bloomington, IL
3 days ago
Lead Data Engineer
$150k - $170k
...clean energy. We have an important role to play in securing the region’s clean and reliable energy future and are looking for a Data Engineer to join our team. In this role, you will design, develop, and maintain the enterprise data warehouse, data marts, and BI data systems...
H1b
Relocation
Visa sponsorship
Work visa
Relocation package
Flexible hours
3 days per week
ISO New England
Holyoke, MA
2 days ago
Lead Data Engineer
$215.2k - $245.6k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you’ll be part of a big group of makers, breakers...
Internship
Local area
Capital One National Association
San Francisco, CA
3 days ago
Lead Data Engineer
$215k - $265k
...Join to apply for the Lead Data Engineer role at Genies Genies is an avatar technology company powering the next era of interactive digital identity through AI companions. With the Avatar Framework and intuitive creation tools, Genies enables developers, talent, and creators...
Full time
Work at office
Work from home
Flexible hours
GENIES INC
Los Angeles, CA
5 days ago
Lead Data Engineer
$175k - $220k
...to help our team members grow in a rapidly evolving industry. About the Role The Data Operations team is critical to delivering top‑quality data to our customers. As a senior data engineer, you will lead the design and development of scalable data pipelines and workflows...
For contractors
Work at office
Visa sponsorship
PitchBook
Seattle, WA
2 days ago
Lead Data Engineer
...Role Lead Data Engineer Required Skills Matillion ELT Snowflake DataStage Azure Data Services such as ADLS, SQL Server Dbt tool Experience in Data platform migration projects Experience in design documentation Responsibilities The core requirement for developers will be...
TechDigital Group
San Jose, CA
3 days ago
Lead Data Engineer
...The Data Environments and Engineering Department (L176) in the Data and Human Centered Solutions Innovation Center is seeking highly motivated, adaptive, and enthusiastic candidates with a wide variety of interests and a foundation of skills in systems engineering, software...
MITRE
McLean, VA
2 days ago
Lead Data Engineer
$125k - $140k
...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...
VettaFi
New York, NY
2 days ago
Lead Data Engineer
...Location: Houston Downtown(77002 Onsite) Full time direct hire job opportunity Salary range: 140K to 160K Must haves 5+ years as a Data Engineer focused on designing and maintaining data pipeline architectures. Programming: 5+ years of in-depth experience with Python and...
Full time
Collabera
Houston, TX
2 days ago
Lead Data Engineer
...About the Role We’re hiring a Data Engineer to help own and scale our core data platform. This role is hands‑on and production‑focused: you’ll design, build, and maintain data pipelines that power analytics, machine learning, and operational systems. We’re especially interested...
Contract work
Work from home
Health Care Service Corporation
Hartford, CT
3 days ago
Lead Data Privacy Engineer
$106.61k - $284.28k
...something bigger – helping to simplify health care one person, one family and one community at a time. Responsibilities Lead Data Privacy Engineer to assist in leading our Data Protection Engineering, Monitoring, and Audit efforts. This role is responsible for embedding...
Hourly pay
Full time
Temporary work
Work experience placement
Local area
Flexible hours
Hispanic Alliance for Career Enhancement
Topeka, KS
2 days ago
Lead Data Engineer
$197.3k - $225.1k
...of a big group of makers, breakers, doers and disruptors who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity...
Full time
Part time
Internship
H1b
Local area
Capital One
McLean, VA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!