Data Engineer
Spark Eighteen
Role Description
This is a remote position. We are seeking a Data Engineer with 5+ years of experience to build and scale data platforms powering AI-driven analytics on high-volume sensor, satellite, and third-party data. The ideal candidate will have expertise in designing and managing scalable batch and real-time data pipelines using:
- Apache Airflow
- Apache Spark
- Kafka
- Python
- SQL
Strong experience with PostgreSQL, TimescaleDB, PostGIS, cloud-based data lake architectures, and geospatial/time-series data is essential. The role involves owning data pipelines end-to-end—from real-time ingestion to analytics—while ensuring:
- Data quality
- Performance
- Observability
- Reliability in a cloud-native environment
Strong stakeholder management, problem-solving, and collaboration skills are key to delivering impactful data products and analytical solutions.
Qualifications
- 5+ years of experience in Data Engineering and production-scale data platforms
- Strong proficiency in Python, SQL, Airflow, Spark, and PostgreSQL
- Experience with geospatial and time-series data
- Comfortable working in Ubuntu-based environments
Requirements
- Design and manage Apache Airflow pipelines for high-volume sensor, satellite, and third-party data ingestion
- Build and optimize Apache Spark workloads for batch processing, geospatial analytics, and large-scale aggregations
- Develop and maintain PostgreSQL, TimescaleDB, PostGIS, and DuckDB-based data solutions
- Implement Kafka-based streaming pipelines for real-time data ingestion
- Work with Object Storage (AWS S3 or equivalent) for scalable data lake architecture
- Collaborate with customer teams to translate business requirements into data products and analytical solutions
- Ensure data quality, lineage, observability, performance, and SLA compliance
- Troubleshoot production issues and optimize pipeline, database, and query performance
- Create and maintain technical documentation, data models, and run-books
- Strong communication, stakeholder management, and problem-solving skills
Benefits
- Comprehensive insurance coverage that gives you peace of mind, so you can focus on doing your best work
- Flexible work arrangements designed to support sustained productivity, personal well-being, and work-life balance
- Continuous learning and accelerated skill development through hands-on projects and mentorship from experienced industry leaders
- Global client exposure across 20+ countries, offering real-world experience with diverse markets and business environments
- Opportunity to work on high-impact, large-scale projects that have collectively generated over $1B in measurable business value
- Competitive, market-aligned compensation packages that recognize performance, expertise, and long-term contribution
- Monthly demo days that celebrate innovation, showcase your work, and give you a real voice in what we build
- Annual recognition programs and performance-driven awards in a truly meritocratic environment
- Referral bonuses that reward you for helping grow a strong, like-minded team
- A strong problem-solving culture with opportunities to tackle meaningful, real-world challenges
- A positive, people-first workplace that supports happiness, balance, and long-term growth
$160.81k
...Barclays to connect them with exceptional professionals for this role. What will you be doing? Barclays Services Corp. seeks Big Data Engineer, AVP in Whippany, NJ (multiple positions available): Analyze system requirements to automate and improve functionality and...SuggestedHourly payLocal areaRemote work$138k - $185k
...hackajob is collaborating with Excella to connect them with exceptional professionals for this role. Lead Consultant Data Engineer (DHS) Arlington, Virginia, United States Excella is a transformative technology firm that helps organizations unlock new possibilities...SuggestedWork from homeHome officeFlexible hours$160.56k - $193k
Role Description Lead Data Engineer, Fortune Brands Innovations Group, Inc., Deerfield, IL. ~Administer a cloud data warehouse platform (e.g., Snowflake or similar), including roles/permissions, performance tuning, security, & cost governance. ~Utilize Git for version...SuggestedFull timeRemote workFlexible hours- Role Description The Lead Data Engineer owns the Navanta data backbone — public Call Report data in the early build, and secure ingestion from bank cores into lakehouses as each client’s on-premises environment is stood up. Working under the SVP of Technology and Commercial...SuggestedFull timeWork at office
$127k - $236.5k
Role Description L3Harris Enterprise Data and AI team is seeking a Data Engineer with experience in managing enterprise-level data life cycle processes. This role includes: ~Overseeing data ETL/ELT pipelines ~Ensuring adherence to data standards ~Maintaining data...SuggestedFull timeFlexible hours- Role Description ~Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. ~Collaborate with product and technology teams to design and validate the capabilities of the data platform...Full time
$155k - $175k
...You will be responsible for designing and implementing scalable data pipelines and data infrastructure that support various business... ...frameworks, templates, and self-service tooling so both engineering and business teams can move faster. ~Own source code management...Full timePart timeRemote workWork from homeFlexible hours$188.25k - $230.08k
Role Description We are seeking a Lead Data Engineer with strong experience in AI/ML data pipelines, feature engineering, and scalable data architectures. This role will lead the design, development, and optimization of data platforms that power advanced analytics and machine...Full timeH1bRemote workRelocationFlexible hours$125k - $150k
Role Description We're looking for a Lead Data Engineer to own the reliability and operational excellence of our data platform. You'll work hands-on across Snowflake, Airflow, AWS, Python, and SQL, building and operating systems that support analytics, machine learning,...Full timeFlexible hours$106.61k - $284.28k
...Description At CVS Health, protecting the privacy and security of customer, patient, member, and colleague data is foundational to our mission. The Lead Data Privacy Engineer will play a critical role in advancing enterprise data protection capabilities by designing and...Hourly payFull timeWork experience placement$70 - $90 per hour
Role Description Our client is a nationally recognized organization seeking a Lead Data Engineer to join a growing data and engineering team. This role will focus on building scalable data platforms, supporting analytics initiatives, and driving data engineering best practices...Contract workTemporary workRemote work$126.4k - $165.9k
Role Description The Lead Data Engineer is responsible for leading a team of data engineers in the design, development, and implementation of data solutions using Microsoft Fabric and Azure data platform technologies. The ideal candidate will have a strong understanding...Full timeTemporary workWork experience placementRemote workWorldwideAfternoon shift$170k - $210k
Role Description We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You will play a critical role in shaping the future of our data infrastructure, while mentoring...Full time- Role Description The primary mission of the Lead Data Engineer role is to help our business evolve into a data and insights-driven organization. The Lead Data Engineer will provide technical leadership to our Product Team by helping design and implement our next generation...Full timeWork at office
- Role Description We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices...Full time
- Role Description We’re hiring a Data Engineering Lead to help scale and guide a growing team of data engineers. This role is ideal for someone who enjoys solving technical challenges hands-on while also shaping engineering best practices, coaching others, and helping cross...Full timeRemote work
- Role Description We have a contract opportunity for Lead Data Engineer (Remote) with one of our clients. Detailed job descriptions is provided below. ~Title: Lead Data Engineer (Microsoft Fabric) ~Duration: 9+ Months ~Work Authorization: US Citizen or Green Card...Full timeContract workFor contractorsRemote work
- Role Description At IT Labs, we are looking for an experienced Lead Data Engineer to support one of the most innovative companies in the digital health space. Our client is transforming healthcare through a technology-driven platform that connects employers and patients...Full timeContract workRemote work
$142.3k - $195.7k
Role Description The Lead Data Engineer oversees data processing architectures and solutions ensuring the efficient conversion of structured and unstructured data to insights at enterprise scale. You will work on problems of diverse scope and complexity ranging from moderate...Full timeTemporary workWork at officeRemote workHome office$220k - $300k
Role Description The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...Local areaRemote workFlexible hours$111.8k - $160k
Role Description Now we are investing in the next evolution of our data, analytics, and artificial intelligence ecosystem. We are looking for a Lead Data Engineer who’s ready to do more than just build pipelines on Databricks and AWS. You will help shape enterprise analytics...Full timeRemote work$170k - $190k
Role Description As a Lead Data Engineer, you will serve as a senior technical leader within the Data Engineering organization, helping define the architecture, engineering standards, and best practices that support Walker & Dunlop’s enterprise data platform. This role...Full timeContract workTemporary workFlexible hours$50 per hour
...identify trends, insights, and business opportunities. ~Develop and optimize SQL queries for data extraction, validation, and reporting. ~Collaborate with business, data engineering, and leadership teams to define KPIs and metrics. ~Ensure data accuracy, consistency,...Contract work$121.7k - $162.2k
Role Description We’re looking for an experienced Senior Data Engineer/Analyst to lead the design and delivery of production-grade data platforms, pipelines, and analytics solutions that drive business intelligence and AI/ML capabilities across the organization. In this...Full timeWork experience placement$40.43 - $69.11 per hour
...Description This position exists to design, build, and support enterprise data integrations and analytics-ready data products that power... ...across Minnesota State Colleges and Universities. The Data Engineer and Analyst ensures that data needed for analytical and operational...Full timeTemporary work- Role Description We are looking for a Data Engineer to support a modern data platform built on Databricks. This role will focus on building scalable data pipelines, supporting a metadata-driven ingestion framework, and ensuring data quality and governance are embedded into...Full timeTemporary work
$95k - $125k
Role Description As a Data Engineer II, you will be a key technical contributor working directly alongside the Director of Data to advance the vision and maturity of our data platform. This role is focused on elevating data quality, driving platform modernization, and leading...Full timeRemote workFlexible hours$140k - $170k
...staffing agencies and healthcare employers, significantly reducing time to hire. Vivian Health is searching for a software engineer to join the data team. The Data Team plays a critical role in providing insights that drive business strategy and empower data-driven...Full timeWork from homeFlexible hours$62.5k - $75k
Role Description The Data Engineer will be part of the Research & Development team, responsible for designing, building and maintaining internal systems used by management, coaches, scouts, analysts and all other Hockey Operations staff. The primary focus of the role will...Full timeTemporary workRemote workFlexible hoursNight shift$103.5k - $143.5k
Role Description The Data Engineer will play a crucial role in advancing the CDC Foundation's mission by designing, building, and maintaining data infrastructure for a public health organization. This role is aligned to the Workforce Acceleration Initiative (WAI), which...Temporary workFor contractorsWork at officeRemote workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- junior data engineer remote Remote
- data engineering intern summer Remote
- hadoop big data developer Remote
- data integration engineer Remote
- senior data quality engineer Remote
- aws data engineer Remote
- staff data engineer Remote
- data engineer Remote
- finance data engineer Remote
- senior data center engineer Remote


























