Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Unisys Corporation

Role: Big Data Engineer

Location: Rockville, MD or Tysons, VA or Jericho, NY or New York, NY or Jersey City, NJ and Woodbridge, NJ

Duration: Long Term

We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability of big data platforms. The ideal candidate will have deep expertise in distributed systems, cloud platforms, and modern big data technologies such as Hadoop, Spark etc

Responsibilities:

• Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).

• Implement data ingestion, storage, transformation, and analysis of solutions that are scalable, efficient, and reliable.

• Stay current with industry trends and emerging Big Data technologies to continuously improve the data architecture

• Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

• Optimize and enhance existing data pipelines for performance, scalability, and reliability.

• Develop automated testing frameworks and implement continuous testing for data quality assurance.

• Conduct unit, integration, and system testing to ensure the robustness and accuracy of data pipelines.

• Work with data scientists and analysts to support data-driven decision-making across the organization.

• Ability to write and maintain automated unit, integration, and end-to-end tests

• Monitor and troubleshoot data pipelines in production environments to identify and resolve issues.

Education/Experience Requirements:

Bachelor's degree in Computer Science, Information Systems or related discipline with at least five (5) years of related experience, or equivalent training and/or work experience; Master's degree and past Financial Services industry experience preferred.

Demonstrated technical expertise in Object Oriented and database technologies/concepts which resulted in deployment of enterprise quality solutions.

Past experience with developing enterprise quality solutions in an iterative or Agile environment.

Extensive knowledge of industry leading software engineering approaches including Test Automation, Build Automation and Configuration Management frameworks.

Strong written and verbal technical communication skills.

Demonstrated ability to develop effective working relationships that improved the quality of work products.

Should be well organized, thorough, and able to handle competing priorities.

Ability to maintain focus and develop proficiency in new skills rapidly.

Ability to work in a fast paced environment.

Experience with object oriented programming languages such as Java, Scala or Python.

Essential Technical Skills:

  • AI Tool Proficiency: Hands-on experience with AI development tools (GitHub Copilot, Q Developer, ChatGPT, Claude, etc.)
  • Technical Background: Strong software development background with ability to contribute to technical discussions
  • Agile Methodology: Extensive experience with Scrum, Kanban, and continuous improvement practices

Big Data technologies

• Experience with Big data technologies such as Hadoop, Spark, Hive & Trino

• Evaluate understanding of common issues like:

? Data skew and strategies to mitigate it.

? Working with massive data volumes in PetaBytes.

? Troublehsooting job failures due to resource limitations, bad data, scalability challenged.

• Look for real-world debugging and mitigation stories.

AI Skills

  • Prompt Engineering: Proficiency in crafting effective prompts for AI coding assistants and analysis tools
  • AI Workflow Design: Experience redesigning development processes to leverage AI capabilities
  • Data Analysis: Ability to interpret AI-generated insights and translate them into actionable team improvements
  • Change Management: Experience leading teams through AI adoption and workflow transformation

SQL Skills (Window Functions, Joins, Complex Queries)

• Assess comfort with SQL window functions, multi-table joins, aggregations.

• Provide examples or ask them to write/optimize SQL queries on the spot.

• Probe how they handle edge cases like NULLs, duplicates, ordering, etc.

Apache Spark (Development, Internals & Tuning)

• Test their understanding of Spark's core architecture — executors, tasks, stages, DAG.

• Focus on Spark performance tuning techniques: partitioning, caching, broadcast joins, etc.

• Ask scenario-based questions on troubleshooting slow running/stuck jobs or resource issues in Spark.

• Explore their experience optimizing Spark jobs for large-scale datasets.

Cloud Technologies

• Check exposure to AWS services like S3, EMR, Glue, Lambda, Athena, etc.

• Ask how they've used S3 with Spark (e.g., dealing with file formats, consistency issues).

• EKS, Serverless knowledge, etc.

Programming - Python or Scala

• Assess ability to write clean, modular, and performant code.

• Look for experience in functional programming concepts (e.g., immutability, higher-order functions).

• Ask about real-world use cases where they wrote scalable data processing code.

• Evaluate understanding of collections, concurrency, and memory management.

Good to have:

• Experience with managing production data pipelines/ETL systems

• Experience with CI/CD

• Experience writing test cases

• AWS certifications

LI-CGTS

TS-2505

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Rockville, MD vacancy
  • Software Guidance & Assistance, Inc., (SGA), is searching for a Big Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients in Rockville, MD or Tysons, VA. We are seeking a highly skilled and experienced Big Data Engineer to design, develop... 
    Big data
    Contract work
    Work experience placement

    Software Guidance & Assistance, Inc. (SGA, Inc.)

    Rockville, MD
    a month ago
  •  ...Job Description Job Description Title : Big Data Engineer Location : DC Metro Area Target Start Date : ASAP Type :contract Pay Rate: DOE We are seeking an experienced Data Engineer to design, develop, and optimize large-scale data processing... 
    Big data
    Contract work
    Immediate start

    ConsultNet

    Rockville, MD
    18 days ago
  •  ...opportunity with strong work-life balance. As a Senior Backend Engineer, you'll lead through excellent code, solve complex problems, set...  ...environment, utilizing distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop), and full-stack... 
    Big data

    Unisys

    Rockville, MD
    26 days ago
  •  ...Guidance & Assistance, Inc., (SGA), is searching for a Senior Data Engineer for a CONTRACT assignment with one of our premier Regulatory...  ..., and maintain large-scale data processing pipelines using Big Data technologies. In this role, you will: Collaborate with... 
    Big data
    Contract work

    Software Guidance & Assistance

    Rockville, MD
    4 days ago
  • Job-ID29514256Reference26-02235Remote50% RemoteTitle: Senior Data Engineer Location: Rockville, MD Target Start Date: ASAP Type: contract Pay...  ...software engineering fundamentals, hands-on experience with Big Data technologies, and the ability to solve complex technical challenges... 
    Big data
    Contract work
    Immediate start

    ConsultNet

    Rockville, MD
    3 days ago
  •  ...Description Job Summary: We are looking for a highly skilled Azure Data Engineer to design and implement modern data solutions using the Azure...  ...: Experience in building end-to-end data pipelines for big data and analytics . Knowledge of data governance and... 
    Big data

    Macpower Digital Assets Edge Private Limited

    Rockville, MD
    20 days ago
  •  ...Description: Hybrid 3 days onsite in McLean, VA Our client seeks a Data Engineer to lead data management and big data or machine learning engineering initiatives. The role will focus on building and optimizing data pipelines and platforms using Python, PySpark,... 
    Big data
    Hourly pay
    Local area

    Eliassen Group

    McLean, VA
    1 day ago
  •  ...We’re hiring: Senior/Lead Big Data Engineer We’re looking for a senior- or lead-level Big Data Engineer who can take on complex technical challenges and communicate solutions clearly. This is a hybrid role based in Rockville, MD, or Tysons Corner, VA . Must... 
    Big data

    Unisys

    Tysons Corner, VA
    26 days ago
  •  ...Data Scientist / Data EngineerJTEC Consulting LLC focuses on successfully delivering solutions...  ...is actively hiring Data Scientists, Data Engineers, and Data Analysts to support critical...  ...: Support data-centric solutions, big data analytics, and data modeling in secure... 
    Big data
    Local area

    JTEC Consulting LLC

    McLean, VA
    4 days ago
  • $70 - $75 per hour

     ...Job Title: Senior Data Engineer Location: Mclean, VA/ Richmond, VA - Hybrid Duration: 07+ Months Contract with Extension Job id...  ...Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR. Big Data Architecture: Proven track record of building scalable... 
    Big data
    Full time
    Contract work

    PTR Global

    Mc Lean, VA
    12 days ago
  •  ...We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and... 
    Big data

    Unisys

    Mc Lean, VA
    26 days ago
  •  ...and citizen services. We're a nonprofit engineering, applied research, and advanced technology...  ...- and help shape the future. MITRE's Data Science and Engineering department is looking...  ...Distributed Data Processing and Big Data Architectures (e.g., Spark, Hadoop,... 
    Big data
    Full time
    Internship
    Local area

    The MITRE Corporation

    McLean, VA
    3 days ago
  •  ...and citizen services. We're a nonprofit engineering, applied research, and advanced technology...  ...future. Department Summary: MITRE's Data Science and Engineering department is...  ...Engineering Distributed Data Processing and Big Data Architectures, such as Spark, Hadoop... 
    Big data
    Internship
    Local area
    3 days per week

    The MITRE Corporation

    McLean, VA
    1 day ago
  • $62k - $141k

     ...Job Number: R0249294 Data Engineer The Opportunity: Do you want to work at the forefront of advanced technology and solve complex data...  ...experience with Python and SQL ~3+ years of experience with big data technologies, including Databricks and distributed... 
    Big data
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    4 days ago
  • $62k - $141k

     ...Job Number: R0249404 BigID Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l intelligence...  ...You Have: Experience with Databricks Experience with big data ecosystems Experience with Infrastructure-as-Code tools... 
    Big data
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    4 days ago
  •  ...and design, develop, and optimize architectures to tackle the Big Data and Data Science needs for federal and local government agencies...  ...accredited college/university Ability to rapidly ingest, transform, engineer, and visualize data for both ad hoc and product-level (e.g.,... 
    Big data
    Local area

    KPMG

    McLean, VA
    3 days ago
  •  ...Cloud Big Data Software EngineerWe are seeking a skilled Cloud Big Data Software Engineer to join our team and play a pivotal role in designing and developing cloud-based big data solutions. In this role, you will work with cutting-edge technologies to build scalable systems... 
    Big data
    Temporary work
    For contractors
    Immediate start

    Cymertek

    McLean, VA
    5 days ago
  • $62k - $141k

     ...Job Number: R0236780 Data Engineer, Mid The Opportunity: Ever-expanding te chn ology like IoT, machine learning, and artifi cia l intelligence...  ...than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it's gathered from... 
    Big data
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    1 day ago
  •  ...Job Description Job Description Data Engineer  Employment Type: Full-Time, Mid-level Department: Business Intelligence   CGS is...  ...manipulate data (Python, R, SQL, SAS). -Strong knowledge of big data analysis and storage tools and technologies. -Strong understanding... 
    Big data
    Full time
    Flexible hours

    Contact Government Services, LLC

    Rockville, MD
    9 days ago
  • $125k - $160k

    OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services...  ...experience in Data Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake, etc.... 
    Big data

    Steampunk

    McLean, VA
    4 days ago
  • $125k - $165k

    OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services...  ...in Data Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL... 
    Big data

    Steampunk

    McLean, VA
    4 days ago
  • $62k - $141k

    Data Engineer, MidThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more...  ...than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate... 
    Big data
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    4 days ago
  • $116.2k - $229.1k

    Position Summary Join Deloitte’s AI & Engineering practice and help organizations transform...  ...technology platforms, modernize data environments, and unlock value through innovation...  ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring... 
    Big data
    Local area
    Visa sponsorship

    Deloitte

    McLean, VA
    2 days ago
  •  ...evolving technology landscape, an organization’s data has never been a more important aspect in...  ...We are looking for seasoned Data Engineer to work with our team and our clients to develop...  ...with experience in tools such as: Big data tools: Hadoop, Spark, Kafka, etc. Relational... 
    Big data

    Steampunk, Inc.

    Mc Lean, VA
    4 days ago
  • $49.59k - $68.99k

     ...The Opportunity BAE Systems is seeking an AI/ML Engineer Intern for Summer 2027 with a Computer Science, Data Engineering, Software Engineering, or Computer Engineering...  ...(e.g., Apache Beam, AWS Glue). Familiarity with big data technologies like Hadoop, Spark, and Kafka.... 
    Big data
    Full time
    Temporary work
    Summer work
    Internship
    Local area
    Worldwide

    BAE Systems

    Rockville, MD
    2 days ago
  • Software Guidance & Assistance, Inc., (SGA), is searching for a Data Scientist for a CONTRACT assignment with one of our premier...  ..., and documentation. Experience with distributed query engines and big data platforms. By applying for a job with SGA, you agree to... 
    Big data
    Contract work

    LinkedIn

    Rockville, MD
    2 days ago
  •  ...Guidance & Assistance, Inc., (SGA), is searching for a Senior Data Engineer for a CONTRACT assignment with one of our premier Regulatory clients...  ...out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year,... 
    Contract work

    Software Guidance & Assistance

    Rockville, MD
    1 day ago
  •  ...Job Description Job Description Description: Hybrid 3 days onsite in McLean, VA   Our client seeks a Data Engineer to lead data management and big data or machine learning engineering initiatives. The role will focus on building and optimizing data pipelines and... 
    Big data
    Hourly pay
    Local area

    Eliassen Group

    McLean, VA
    12 days ago
  • $91.4k - $136.9k

     ...Government and Infrastructure - Technology Consulting - AI & Data - Data Engineer - Top Secret ClearanceFrom strategy to execution, the Government...  ...better working world.​​​​EY delivers unparalleled service in big data, business intelligence, and digital analytics built on a... 
    Big data
    For contractors
    Summer holiday
    Work at office
    Local area
    Immediate start
    Flexible hours

    EY (Ernst & Young)

    McLean, VA
    4 days ago
  • $128.4k - $192.5k

     ...Government and Infrastructure - Technology Consulting - AI & Data - Data Engineer - Senior ConsultantFrom strategy to execution, the Government...  ...build a better working world.EY delivers unparalleled service in big data, business intelligence, and digital analytics built on a... 
    Big data
    For contractors
    Summer holiday
    Work at office
    Local area
    Flexible hours

    EY (Ernst & Young)

    McLean, VA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!