Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer: End-to-End Pipelines, ML & Analytics

Programmers.io

Programmers.io in Arlington, VA is seeking a data engineer who can bridge business, data, and technical teams to uncover use cases and design scalable data solutions. You will build robust data pipelines end-to-end with a strong emphasis on data quality, using Python or Scala, Spark and Hadoop, plus SQL for analytics. Experience with Hive, Airflow, NiFi, Scoop and cloud platforms like Databricks or AWS is a plus as you deploy production-grade data-driven applications. #J-18808-Ljbffr Programmers.io

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer: End-to-End Pipelines, ML & Analytics in Arlington, VA vacancy
  • $154.6k - $209.1k

    The AWS Analytics Engineering (AAE) organization is the analytics...  ...and operate the data platform that...  ...-scale processing pipelines, design analytical...  ...3-5 data domains end-to-end, operate hundreds...  ...with AI/ML technologies, including...  ...environment, able to think big while paying... 
    Pipeline
    Big data
    Temporary work
    Flexible hours

    Amazon

    Washington DC
    a month ago
  • $218.8k - $295.9k

     ...boundaries of AI/ML technology (e.g. multi-agent analytics system, agentic...  ...The AWS Analytics Engineering (AAE) is at the...  ...from their data. We are a cross...  ...system, develop big data engineering...  ...architectures and data pipelines when needed...  ...specialize in the full end-to-end ML... 
    Pipeline
    Big data
    Flexible hours

    Amazon

    Washington DC
    a month ago
  • $187k - $253k

     ...'re looking for a Data Engineering Manager to lead and...  ...infrastructure, pipelines, and platform capabilities...  ...that power our analytics, AI tools, and...  ...team’s GenAI and ML applications including...  .... We own the end-to-end data platform...  ...Spark or Hadoop based big data solution)... 
    Pipeline
    Big data
    Worldwide
    Flexible hours
    Shift work

    AmazonWebServices

    Washington DC
    26 days ago
  •  ...seeking a proactive Lead AI & Data Analytics Engineer to support a federal...  ...solutions. Develop data pipelines, reusable data models, and...  ...ready datasets Design end-to-end big data architectures across cloud...  ...business intelligence, AI/ML, or analytics product development... 
    Pipeline
    Big data
    Full time
    Contract work

    Navaide

    Arlington, VA
    12 days ago
  • $115k - $150k

     ...clients.As a Senior Data Engineer, you will...  ...design of robust data pipelines, enforce best practices...  ...and develop end-to-end ETL/ELT pipelines...  ...experience with big data tools:Apache...  ...warehousing, and real-time analytics.Ability to lead...  ...).Experience with ML pipelines (e.g.,... 
    Pipeline
    Big data
    Full time
    Visa sponsorship

    Insomniac Design

    Washington DC
    3 days ago
  • $152k - $205.6k

     ...talents of science, engineering, and UX to...  ...worldwide.As a Data Engineer on PXTCS...  ...leading-edge ML and Generative...  ...features, developing end-to-end data...  ...for complex analytical problems, and collaborating...  ...include:• Data Pipeline Development:...  ...with big data technologies... 
    Pipeline
    Big data
    Local area
    Worldwide
    Flexible hours

    Amazon

    Arlington, VA
    4 days ago
  •  ...future, build the next big thing, and change the...  ...are seeking a Front-End Software Engineer to support the...  ...mission-critical big data analytics platform for a United...  ...source control and CI/CD pipelines.Experience designing...  ...data, analytics, AI/ML, or data visualization... 
    Pipeline
    Big data
    Permanent employment
    Full time
    Work at office
    3 days per week

    Maxar Technologies

    Herndon, VA
    2 days ago
  •  ...Data EngineerHatch I.T. is partnering...  ...to find a Data Engineer. See details below...  ..., advanced analytics, machine learning...  ...and deploy data pipelines, preprocessing workflows...  ...and production ML responsibilities...  ...and a Top 20 Big Data Solutions...  ...integration with end-user applications... 
    Pipeline
    Big data
    For contractors
    Work at office
    Immediate start

    Hatchit Co

    Washington DC
    4 days ago
  • $132.1k - $178.8k

     ...a robust/scalable data infrastructure and...  ...passionate about data and analytics. They are an...  ..., able to think big (while paying careful...  ...operation of data pipelines and datasets...  ...Product, Finance, Engineering, Privacy, and Legal...  ...experimentation, ML/AI use cases, self... 
    Pipeline
    Big data
    Flexible hours

    Amazon

    Washington DC
    3 days ago
  • $100k - $130k

     ...analyze sensitive data at speed without compromising...  ...their toughest analytics and digital...  ...impressive Data Analytics Engineer. As a Data...  ...lead data initiatives end to end, in an...  ...reliability of AI/ML outputs against domain...  ...trustworthy Oversee data pipelines Own the... 
    Pipeline
    Summer work
    Remote work
    Work from home
    Flexible hours

    VIA

    Washington DC
    16 hours ago
  • $132.1k - $178.8k

    The AWS Analytics Engineering (AAE) organization is the analytics backbone...  ...we build and operate the data platform that powers business...  ...of data, implement big data procurement pipelines, and establish the governance...  ...including, but not limited to, AI/ML, GenAI, Analytics,... 
    Pipeline
    Big data
    Flexible hours

    Amazon

    Washington DC
    a month ago
  •  ...Senior Consultant Data Engineer Full‑time Americas...  ...maintain scalable data pipelines and infrastructure...  ...enable advanced analytics, AI, and...  ...implement, and optimize end‑to‑end data pipelines...  ..., and AI or ML use cases. Optimize...  ...Experience with big data technologies... 
    Pipeline
    Big data
    Full time
    Immediate start
    Remote work
    Flexible hours
    Shift work

    Kearney Italia, Inc.

    Arlington, VA
    3 days ago
  •  ...Big Data EngineerLocation: Arlington, VA (3 Days onsite/week)Ability...  ...robust and efficient data pipelines end-to-end with a strong focus on...  ...Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating... 
    Pipeline
    Big data
    3 days per week

    Futran Tech Solutions Pvt. Ltd.

    Arlington, VA
    16 hours ago
  • $132.1k - $178.8k

     ...The Prime Video Product Analytics (PVPA) team is a...  ...Business Intelligence Engineers, Data Engineers, and Data Scientists...  ...infrastructure and pipeline development to...  ...to build a complete, end-to-end view of the customer...  ...funnel attribution, and ML use cases.* Monitor pipeline... 
    Pipeline
    Flexible hours

    Amazon

    Washington DC
    a month ago
  •  ...Group’s Homes.com team seeks a Senior Analytics Data Engineer to design and scale end-to-end data infrastructure,...  ...functional teams to build reliable pipelines, define data strategy, and deliver...  ...solutions; productionize models with ML/LLM integrations and improve data... 
    Pipeline

    Visual Lease

    Arlington, VA
    3 days ago
  • $200k - $280k

     ....*** Are you a Principal Analytic Software Engineer who is ready for a new challenge...  ...Application Development, Big Data, Cloud Technologies,...  ...s and AI-Integrated Python pipelines to drive mission-critical initiatives...  ...research. Knowledge of end-to-end SIGINT collection... 
    Pipeline
    Big data
    Full time
    Contract work
    Remote work
    Work from home
    Relocation package

    GliaCell Technologies

    Laurel, MD
    more than 2 months ago
  • $189.4k - $256.2k

     ...the boundaries of data science (e.g. statistical...  ..., product growth analytics, and forecasting...  ...The AWS Analytics Engineering is at the...  ...leveraging cutting-edge AI/ML technology and...  ...architectures and data pipelines when needed.About...  ...in the full end-to-end ML development... 
    Pipeline
    Flexible hours

    Amazon

    Washington DC
    25 days ago
  •  ...AWS Data EngineerThe AWS Data Engineer designs and develops scalable data...  ...Data Engineer utilizes big data computation,...  ...and testing of data pipelines and solutions. Additionally...  ...with Advance Analytics and AI platforms. Must...  ...experience is a plus.Front-end software development... 
    Pipeline
    Big data
    Contract work

    Software Technology Inc

    Washington DC
    1 day ago
  • $136k - $160k

     ...experience with agile engineering and problem-solving...  ...across technology, data sciences,...  ...maintaining scalable Big Data solutions. You...  ...complex ideas into end-to-end data solutions...  ...and streaming data pipelines across modern cloud...  ...required to support AI/ML deployment,... 
    Pipeline
    Big data
    Contract work

    Publicis Media

    Arlington, VA
    3 days ago
  •  ...Enterprise Data Architecture & Data Modeling...  ...enterprise analytics and operations....  ...Advanced Data Engineering & ETL/ELT Development...  ...data integration pipelines, and large-scale data...  ...SQL, Python, and Big Data Experience...  ...of Performance: end of the year with likely... 
    Pipeline
    Big data
    Contract work

    3B Staffing LLC

    Washington DC
    4 days ago
  • $132.1k - $178.8k

     ...accurate and timely financial data. The team supports the global...  ...individual with a strong back-end and front-end background to maintain...  ...working with ambiguity, big data, UI components and enjoys...  ...responsibilitiesWorking with stakeholders and other engineering teams to identify and scope... 
    Big data
    Flexible hours

    Amazon

    Arlington, VA
    2 days ago
  • $130.4k - $176.3k

     ...Business Intelligence Engineer to join the AWS Analytics Engineering (AAE)...  ...interactive dashboards, and ML-driven insights such...  ...chat with their data, conduct deep research...  ...team, you will own the end-to-end analytical...  ...build scalable data pipelines and models to derive... 
    Pipeline
    Work at office
    Flexible hours

    Amazon

    Washington DC
    7 days ago
  • $138k - $185k

     ...remains current, at the end of a 3-year period...  ...Overview Lead Data Engineers at Excella play a key...  ...and sustainable data pipelines using batch and streaming...  ...Hands-on experience with big data technologies such...  ...Familiarity with data lake and analytical architecture patterns,... 
    Pipeline
    Big data
    Work from home
    Home office
    Flexible hours

    Excella Consulting

    Arlington, VA
    2 days ago
  • $148.7k - $199.4k

     ...global organization of engineers, product developers...  ..., technologists, data scientists, and...  ...team that delivers end-to-end solutions across...  ...machine learning, big data, microservices...  ..., from streaming pipelines and embedding pipelines...  ...infrastructure, ML engineering, product... 
    Pipeline
    Big data

    Disney Interactive

    Washington DC
    3 days ago
  •  ...customers with the data and insight to make...  ...enthusiastic senior data engineers who share our passion for big data, AI, and...  ...into either more back-end or ML/AI work depending...  ...on the data pipelines Interface directly...  ...environment Strong analytical and problem-solving... 
    Pipeline
    Big data

    Ex Parte, Inc

    Bethesda, MD
    3 days ago
  • $155k - $165k

    Data Engineer We need an experienced Data Engineer at the National Guard...  ...within the DoW's central analytics platform, and plays a...  ...will design and implement end-to-end data pipelines using ETL processes and technologies...  ...of large datasets Leverage big data technologies to... 
    Pipeline
    Big data
    Full time
    Work at office
    2 days per week
    1 day per week

    West 4th Strategy

    Arlington, VA
    3 days ago
  • $123.4k - $178.5k

     ...is based on market data; final salary...  ...world's greatest engineering, procurement, and...  ...design and delivery of end-to-end AI and machine...  ...scalable data and ML systems, and...  ...functional problems - from big-data pipelines to production...  ...applications. Excellent analytical, problem-solving,... 
    Pipeline
    Big data
    16 hours
    Part time
    Work experience placement
    Local area
    Remote work
    Relocation

    Bechtel Global Corporation

    Reston, VA
    16 hours ago
  •  ...our team as a Senior Data Engineer to align data...  ...Disability Claims AI/ML program. Our team is...  ...Experience in data pipelines, utilizing advanced analytics tools and platforms...  ...Experience: Owned the end-to-end design and implementation...  ...improvements. Big Data Technologies... 
    Pipeline
    Big data
    Contract work
    Work at office
    Local area
    3 days per week

    SteerBridge

    Vienna, VA
    2 days ago
  •  ...Leverage a variety of modern big data tools / approaches to...  ...Data Science needs Build pipelines / scalable analytics tools using leading technologies...  ...) Develop data engineering designs that positively impacts...  ...Time Off; one is at year end and the other is around... 
    Pipeline
    Big data
    Full time
    Local area

    KPMG

    Washington DC
    5 days ago
  •  ...Systems Architect - Data Science & Advanced Analytics to provide...  ...scientists, data engineers, business stakeholders...  ...and strategy for Big Data, Artificial...  ...LearningArchitect end-to-end machine...  ...development of data pipelines and analytical...  ...Experience developing AI/ML solutions... 
    Pipeline
    Big data

    ANALYTICA

    Bethesda, MD
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer: End-to-End Pipelines, ML & Analytics. Be the first to apply!