Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

programmers.io

Location: Arlington, VA (3 Days onsite/week)
Job Summary:
  • Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
  • Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
  • High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
  • Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
  • Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
  • Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required
#J-18808-Ljbffr
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Arlington, VA vacancy
  • Job Description Job Description Data Engineer Top Secret clearance required to apply.7+ years of experience in database design and coding with big data. PowerBI development experience is highly desirable. Minimum Education: Bachelor's Degree.
    Big data

    Bow Wave LLC

    Arlington, VA
    a month ago
  •  ...The Big Data Engineer will design, develop, and optimize large-scale data processing systems capable of operating at petabyte scale. The role focuses on building scalable and reliable data pipelines using Spark, Python/PySpark, Hadoop, Hive, Trino, and AWS services. The... 
    Big data
    Work experience placement

    Compunnel

    McLean, VA
    3 days ago
  •  ...Big Data Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance... 
    Big data
    Temporary work
    For contractors
    Immediate start
    Flexible hours

    Cymertek

    McLean, VA
    1 day ago
  • $62k - $141k

    BigID Data EngineerThe Opportunity:Ever-expanding technology like IoT, machine learning,...  ...available today than ever before. As a data engineer, you know that organizing data can yield...  ...Experience with DatabricksExperience with big data ecosystemsExperience with Infrastructure... 
    Big data
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    3 days ago
  •  ...and cost-effective solutions that meet the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and... 
    Big data

    ByteCubed

    Arlington, VA
    3 days ago
  •  ...unstructured datasets. •Analyze complex data structures and source-to-target mappings...  ...requirements into effective data engineering solutions. •Monitor pipeline performance...  ...Google Cloud Platform. •Knowledge of big data technologies (Hadoop, Spark, or distributed... 
    Big data

    Bow Wave LLC

    Arlington, VA
    17 days ago
  •  ...distance to Arlington Interview: F2F Assessment: Glider – Data Engineering (Advanced) Overview seeking an experienced Data Engineer...  ...delivery of business-critical data. Develop and optimize big data workflows using Apache Spark and Hadoop technologies.... 
    Big data
    Temporary work
    Work at office
    Local area
    Monday to Friday
    3 days per week

    Delan Associates, Inc

    Arlington, VA
    more than 2 months ago
  •  ...loading datasets under the guidance of more experienced engineers. •Support analysis of data structures, mappings, and data quality checks to identify...  ...AWS, Azure, or Google Cloud Platform. •Exposure to big data technologies (Hadoop, Spark, or distributed processing... 
    Big data
    Internship

    Bow Wave LLC

    Arlington, VA
    17 days ago
  • Silverthorne Advisory Group is seeking a skilled Data Engineer to join our defense sector team. You will design, build, and maintain our Advana data infrastructure and ensure robust, scalable pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter... 
    Big data
    Remote job

    Silverthorne Advisory Group

    Arlington, VA
    6 days ago
  •  ...Northern Virginia The Mission: Square Peg is seeking a Data Engineer to be responsible for designing, implementing, and maintaining...  ...one or more programming languages (Python, SQL, Java) Prepare big data, implement data models and develop database to support the... 
    Big data

    Square Peg Technologies

    Washington DC
    a month ago
  •  ...Actifai is seeking experienced Senior Data Engineers. The Company Actifai is an AI company helping broadband and telecom providers...  ...impact. You will work with engineers to build and operate a big data platform that processes and refines data and enables efficient... 
    Big data
    Full time
    Work experience placement
    Work at office
    Remote work

    Actif.ai

    Washington DC
    a month ago
  • Publicis Sapient in Chicago Hybrid is seeking a Senior Associate Data Engineer to design, develop, and maintain scalable Big Data solutions across batch and streaming pipelines on cloud platforms. You will work with clients to translate requirements into data architectures... 
    Big data

    Publicis Groupe Holdings B.V

    Arlington, VA
    3 days ago
  • Our client is seeking an experienced Big Data Engineer to design, develop, and support large-scale data pipelines and transformation processes. The ideal candidate will have strong SQL, Python, ETL/ELT, and data engineering experience, along with the ability to communicate... 
    Big data
    Full time

    Omniscius Consulting

    Washington DC
    a month ago
  •  ...Job Description Job Description Data Engineer – Baltimore City, MD About us  Creative Information Technology Inc (CITI) is an esteemed...  ..., Human Services, Identity Credentialing, Cloud Computing, and Big Data Analytics. With clients in the US and abroad, we hold key... 
    Big data
    Contract work

    Creative Information Technology, Inc.

    Falls Church, VA
    a month ago
  • $110k - $160k

     ...Overview We are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services...  ...in Data Engineering with experience in tools such as: ~ Big data tools:Databricks, Apache Spark, Delta Lake, etc. ~... 
    Big data

    Steampunk.com

    McLean, VA
    1 day ago
  • An established industry player is seeking a skilled data engineer to leverage big data for impactful missions. In this dynamic role, you will design and develop scalable data platforms, ensuring that complex data applications are operationalized effectively. Collaborating... 
    Big data
    Remote job

    Phase2 Technology

    Arlington, VA
    2 days ago
  • Programmers.io in Arlington, VA is seeking a data engineer who can bridge business, data, and technical teams to uncover use cases and design scalable data solutions. You will build robust data pipelines end-to-end with a strong emphasis on data quality, using Python or... 
    Big data

    programmers.io

    Arlington, VA
    4 days ago
  •  ...Analytica is seeking a Databricks Data Engineer to support a high-profile program for a financial regulatory agency. This program entails...  ...Experience with Databricks, Apache Spark, PySpark, or similar big data technologies. Experience with AWS cloud services such as... 
    Big data
    Full time
    For contractors
    Local area

    Analytica

    Washington DC
    a month ago
  •  ...Expression is seeking a Data Engineer to support the Drug Enforcement Administration (DEA) Investigative Case and Data Ecosystem (ICDE) modernization...  ...with AWS, Azure, or Google Cloud Platform. Knowledge of big-data technologies such as Hadoop, Spark, or other distributed-... 
    Big data
    Full time
    For contractors
    Work at office
    Immediate start

    Expression

    Washington DC
    a month ago
  •  ...and U.S. Intelligence Community.   We are seeking to hire a Data Engineer to our team! Client: CTEC develops and delivers innovative...  ...) for enterprise analytics. Familiarity with Spark-based big data processing frameworks. Experience supporting data migration... 
    Big data
    Work experience placement
    Work at office

    CyberMedia Technologies

    McLean, VA
    a month ago
  •  ...and citizen services. We’re a nonprofit engineering, applied research, and advanced technology...  ...future. Department Summary MITRE’s Data Science and Engineering department is looking...  ...Distributed Data Processing and Big Data Architectures, such as Spark, Hadoop... 
    Big data
    Internship
    Local area
    3 days per week

    MITRE

    McLean, VA
    4 days ago
  •  ...: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence...  ...to manipulate data (Python, R, SQL, SAS) Strong knowledge of big data analysis and storage tools and technologies Strong... 
    Big data
    Full time
    Flexible hours

    CGS Federal (Contact Government Services)

    Washington DC
    1 day ago
  •  ...practice. Responsibilities: Leverage a variety of modern big data tools / approaches to solve complex business objectives...  ...Qualifications: A minimum of five years of technical data engineering experience; U.S. Federal government consulting experience preferred... 
    Big data

    KPMG

    McLean, VA
    4 days ago
  • $155k - $165k

     ...Data Engineer We need an experienced Data Engineer at the National Guard Bureau (NGB). The NGB is the link between the Army and Air National...  ...maintain the accuracy and integrity of large datasets Leverage big data technologies to efficiently process and analyze large datasets... 
    Big data
    Full time
    Work at office
    2 days per week
    1 day per week

    West 4th Strategy

    Arlington, VA
    3 days ago
  •  ...Expression is seeking an experienced Data Engineer to support the design, development, and operational deployment of scalable, AI-enabled data...  ...-growing small business Government contractors and a Top 20 Big Data Solutions Provider by CIO Review. We make sure to provide... 
    Big data
    For contractors
    Work at office
    Immediate start

    Expression Networks

    Arlington, VA
    4 days ago
  • Title: Data Engineer II Location: Arlington, VA (Onsite) Position Type: W2 contract Industry: Banking/Financials/Payments Required Education...  ...timely availability and accessibility of data. Leverage big data processing frameworks such as Apache Spark and Hadoop to build... 
    Big data
    Contract work
    Local area

    Accord Technologies Inc

    Arlington, VA
    2 days ago
  • $92.3k - $166.85k

     ...Responsibilities: Gather, clean, and validate data from multiple sources to ensure accuracy,...  ...sharing. Work closely with data engineers, business analysts, and other stakeholders...  ...based data platforms (AWS, Azure, GCP) and big data technologies. Knowledge of data governance... 
    Big data
    Full time
    Local area
    Immediate start
    Remote work

    Leidos

    Washington DC
    3 days ago
  •  ...strategic talent solutions to our clients world-wide. Position: Data Engineer II Location: Bellevue, WA 98004 Duration: 6 Months...  ...infrastructures: relational analytic DBMS, Elastic-Search, and Big Data EMR/EC2/Glue/Lambda What makes this role... 
    Big data
    Temporary work

    TekWissen LLC

    Washington DC
    2 days ago
  •  ...highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview We are seeking a highly...  ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python... 
    Big data
    Local area
    Remote work

    Ampcus, Inc

    Mc Lean, VA
    1 day ago
  •  ...Advisory practice. Responsibilities Leverage a variety of modern big data tools / approaches to solve complex business objectives...  ...translate between business & technical stakeholders) Develop data engineering designs that positively impacts business performance Qualifications... 
    Big data
    Local area

    Confidential

    Washington DC
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!