Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Architect - Data Engineering - Irving

$62k - $217k

Photon

Job Description

Key Responsibilities:

  • Architect and design large-scale, distributed big data solutions using Java and big data technologies to handle high-volume data processing and analytics.
  • Develop, test, and deploy data processing applications using Apache Spark and Scala.
  • Optimize and tune Spark applications for better performance on large-scale data sets.
  • Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
  • Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
  • Design and implement high-performance data processing and analytics solutions.
  • Ensure data integrity, accuracy, and security across all processing tasks.
  • Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
  • Implement version control and CI/CD pipelines for Spark applications.

Required Skills & Experience:

  • Minimum 15+ years of experience in application development.
  • Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
  • Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
  • Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
  • Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
  • Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
  • Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
  • Ability to troubleshoot and optimize Spark and Cloudera platform performance.
  • Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).

Compensation, Benefits and Duration

Minimum Compensation: USD 62,000Maximum Compensation: USD 217,000Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.This position is not available for independent contractorsNo applications will be considered if received more than 120 days after the date of this post

Job Info
  • Job Identification 21711
  • Job Category Dev & Run Ops
  • Posting Date 02/11/2025, 06:08 PM
  • Locations United States
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Architect - Data Engineering - Irving in Washington DC vacancy
  • Leidos is seeking a Senior Information Security Systems Engineer (ISSE) to join a skilled team in Bethesda, MD. In this role, you will conduct cybersecurity risk assessments, support the design of threat detection capabilities, and engage with stakeholders to define security... 
    Suggested

    Leidos

    Bethesda, MD
    4 days ago
  •  ...Advisory practice. Responsibilities: Utilize data wrangling tools and coding languages such as Python, PySpark,...  ...cleansing, data integration, and data transformation Develop data engineering designs and translate efforts between business / technical... 
    Suggested
    Full time
    Local area

    KPMG

    Washington DC
    a month ago
  •  ...Job Description Job Description The ServiceNow Architect will lead the design and implementation of ServiceNow solutions to optimize...  ...advancements. • Ensure compliance with security standards and data integrity across ServiceNow applications. Requirements •... 
    Suggested
    Contract work

    Greenberg-Larraby, Inc. (GLI)

    Bethesda, MD
    19 days ago
  •  ...Job Description Job Description ServiceNow Architect (SNA) – Journeyman    Work Location: Washington, DC  Employment Type: Full...  ...decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.... 
    Suggested
    Full time
    Flexible hours

    Contact Government Services, LLC

    Washington DC
    24 days ago
  • $120k - $140k

     ...Conquer Risk ®. Summary Potomac is continuing to invest in modern data and AI capabilities to support our growing business. We are seeking a Machine Learning Data Engineer to join our team and play a critical role in building and scaling our data infrastructure... 
    Suggested
    Full time
    Contract work

    Potomac Inc

    Bethesda, MD
    3 days ago
  •  ...Employment Type: Full-Time (W-2 or 1099) Overview Praescient Analytics is seeking a highly motivated Data Scientist / Machine Learning Engineer to support our Department of Defense (DoD) and national security partners. The ideal candidate will have a strong... 
    Full time

    Praescient Analytics

    Arlington, VA
    4 days ago
  •  ...Data Science / Machine Learning Engineer (Remote, Continental United States) 3 weeks ago Be among the first 25 applicants About ICA, Inc. International Consulting Associates, Inc. is a rapidly growing company, located in the D.C./Metro area. Founded in 2009, we... 
    Local area
    Remote work
    Flexible hours

    ICA Corporation

    Arlington, VA
    2 days ago
  •  ...Data Scientist Exusia, a cutting-edge digital transformation company, seeks a Data Scientist to join our global delivery team's Data Engineering & Analytics practice in the United States. The Data Scientist role will be part of our Data Engineering & Analytics practice... 

    Exusia

    Washington DC
    1 day ago
  •  ...Data Scientist / ML Engineer KSA Integration is a Service-Disabled Veteran-Owned Small Business (SDVOSB) that provides business and management solutions through three core capabilities: data analytics, comprehensive veterans support, and business process improvement... 
    Full time
    For contractors
    Work experience placement
    Summer work
    Flexible hours

    KSA Integration

    Arlington, VA
    3 days ago
  • $120k - $140k

     ...A boutique asset management firm in Bethesda, MD is seeking a Machine Learning Data Engineer to design and maintain scalable data infrastructure. The ideal candidate will have a Bachelor’s degree in Computer Science or related field, with over 4 years of experience in... 

    Potomac Inc

    Bethesda, MD
    4 days ago
  •  ...Data Center Operation Engineer III Required Activities: Communications and Link Support: Provide 1st Level and 2nd level network and communication link infrastructure support to the World Bank engineers, HQ IT, and Country Offices (CO). Troubleshooting activities include... 
    Work at office
    Local area
    Shift work
    Night shift

    TechDigital Group

    Washington DC
    3 days ago
  • $70.6k - $141.2k

     ...Job Description Team Overview: The Data Center Construction organization at Oracle Cloud Infrastructure (OCI) is rapidly expanding...  ...digital nervous system of OCI’s data centers. As a Principal Engineer, you will serve as a technical authority and delivery leader, driving... 
    Temporary work
    Live in
    Local area
    Worldwide
    Relocation
    Relocation package
    Flexible hours

    Oracle

    Washington DC
    2 days ago
  • An innovative consulting firm in Arlington, VA, seeks a Data Science / Machine Learning Engineer skilled in applying machine learning techniques to solve complex challenges. You will develop and implement cutting-edge ML models, analyze large datasets, and collaborate... 
    Remote work

    ICA Corporation

    Arlington, VA
    2 days ago
  •  ...ICA.ai is looking for a Senior Data Science/Machine Learning Engineer to solve complex problems and enhance AI capabilities. You will implement machine learning models using Python, collaborate with teams, and optimize algorithms on cloud platforms. Ideal candidates have... 
    Remote work

    ICA Corporation

    Arlington, VA
    4 days ago
  •  ...of IT experience focusing on enterprise data architecture and management to include data...  ...AI/ML teams with optimizing feature engineering code. Expertise in Spark/Python/Databricks...  ...a bonus. Experience leading and architecting enterprise-wide initiatives specifically... 
    Remote work

    Sparibis

    Washington DC
    18 days ago
  •  ...Data Engineer – Spear AI Location: On-site, Washington, DC Clearance Required: Secret (active) Employment Type: Full-time, salaried, benefits-eligible About Spear AI: Spear AI delivers cutting-edge artificial intelligence solutions tailored specifically... 
    Full time

    Spear AI

    Washington DC
    25 days ago
  •  ...Data Engineer General Information Requisition # 675 Locations USA-VA-Arlington Posting Date 03/04/2026 Security Clearance Required - IRS MBI Remote Type Hybrid Time Type Full time Description & Requirements Elder Research Inc... 
    Full time
    Work at office
    Local area
    Remote work

    Elder Research

    Arlington, VA
    4 days ago
  • $150k - $190k

     ...Advanced Solutions Group of SHI that is building new digital experiences for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of solutions focused on data engineering and ETL workflows. As a... 
    Work experience placement
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Washington DC
    7 days ago
  •  ...Job Title: Mission (Data)Engineer Travel: Approximately 10% international travel required. Number of Openings: 3 Company Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo‑spatial data subscriptions that can... 
    Remote work
    Flexible hours

    Atreides

    Arlington, VA
    3 days ago
  •  ...Talascend is currently seeking a Databricks Data Engineer for a contract opportunity with our client in Washington, District of Columbia . Overview We are looking for a Databricks Data Engineer to develop and support data pipelines and analytics environments... 
    Contract work

    Talascend

    Washington DC
    3 days ago
  •  ...Eagle Harbor Solutions, LLC a Koniag Government Services company, is seeking an experienced Data Protection Engineer with a TS/SCI Security clearance to support EHS and our government customer in Washington, DC. This position is for a Future New Business Opportunity.... 
    Work experience placement
    Local area
    Flexible hours

    Koniag Government Services

    Washington DC
    3 days ago
  •  ...Data Engineering Lead Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support our...  ...AI across the joint force. Key Responsibilities Architect and implement enterprise data platforms and infrastructure... 
    Full time
    Remote work
    Home office
    Relocation package
    Flexible hours

    Spear AI

    Washington DC
    1 day ago
  •  ...Description This Department of War enterprise data and analytics program delivers mission-critical capabilities that enable leaders...  ...Modernization sector is seeking an experienced Senior Data Governance Engineer to support the delivery, enhancement, and adoption of enterprise... 

    Via Logic LLC

    Alexandria, VA
    4 days ago
  •  ...Clearance Required About the Opportunity PTF Consulting is supporting direct-hire opportunities for Junior and Senior Data Engineers supporting mission-driven data initiatives in international environments. In these roles, you will help organize, process,... 
    Overseas
    2 days per week
    3 days per week

    PTF Consulting LLC

    Washington DC
    4 days ago
  •  ...PID: 26-17-09J-001 E-INFOSOL is searching for a highly motivated Senior Data Engineer to be a full-time employee in Washington, DC to join our innovative and customer solutions focused team. Job Description: We are seeking candidates committed to high... 
    Full time
    Contract work
    Temporary work
    Work experience placement
    Local area

    E-InfoSol LLC

    Washington DC
    4 days ago
  • $90k - $200k

     ...Responsibilities Job title: HPC Data Storage Engineer Sabre is seeking an HPC Data Storage Engineer to support a mission-critical Department of Defense (DoD) program dedicated to high-performance computing operations. In this role, you will be responsible for managing... 
    Contract work
    For contractors
    Remote work

    Sabre Systems

    Arlington, VA
    2 days ago
  •  ...Full-Time/Part-Time Full-Time Description RiVidium Inc. is seeking a Data Engineer to support our planned MODES III team supporting Military Community and Family Policy (MC&FP). This role supports IT, Cybersecurity, and Data Operations - Core Operations... 
    Full time
    Contract work
    Part time

    Rividium Inc

    Alexandria, VA
    2 days ago
  •  ...Data Engineer Location: Hybrid, periodic onsite presence (approximately 1-2 days/month) in Crystal City, VA The Role You'll be at the forefront of delivering data and software solutions that directly impact our clients' law enforcement mission. You'll work with... 

    INTEGRITYOne Partners

    Arlington, VA
    2 days ago
  • $141.5k - $236k

     ...Dive into innovation in Digital Transformation, Cybersecurity, IT, Data Analytics and Software Development. Your journey to impactful...  ...MANTECH seeks a motivated, career, and customer-oriented Data Engineer for a new initiative within the National Capital Region. This effort... 
    Hourly pay
    Contract work
    Temporary work
    Work experience placement
    Work at office
    Local area
    Remote work

    ManTech International Corporation

    Washington DC
    3 days ago
  •  ...Data Engineer The Data Engineer documents, supports, and automates the cloud data warehouse for Lippert Components. The candidate should have experience with ELT/ETL and dimensional modeling. The candidate must be able to work in a dynamic and rapidly expanding environment... 
    Full time
    Work at office
    Local area
    Immediate start
    Monday to Friday
    Flexible hours

    Lippert

    Washington DC
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Architect - Data Engineering - Irving. Be the first to apply!