Big Data Engineer
Diverse Lynx
Role: Big Data Engineer - Python/Scala, Spark, Hadoop
Location: Arlington, VA (3 Days onsite/week)
Rate: $50-55/hr on c2c Job Summary:
• bility to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
• Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
• High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
• Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
• Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
• Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Location: Arlington, VA (3 Days onsite/week)
Rate: $50-55/hr on c2c Job Summary:
• bility to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
• Experience building robust and efficient data pipelines end-to-end with a strong focus on data quality
• High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
• Experience in building and deploying production-level data-driven applications and data processing workflows/pipelines and/or
• Implementing machine learning systems at scale in Java, Scala, or Python and deliver analytics involving all phases like data ingestion, feature engineering, modeling, tuning, evaluating, monitoring, and presenting
• Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Arlington, VA vacancy
- You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting. • Cleanse, manipulate and analyze large datasets (Structured and...Big data
Exaways Corporation
McLean, VA4 days ago - ...highly motivated candidate to join our talented Team. Job Title: Data Engineer. Location: McLean, VA. Overview:We are seeking a highly... ...extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python...Big dataLocal areaRemote work
- ...Amazon’s PXT Central Science team is seeking a Data Engineer to join a diverse group of economists and scientists responsible for accelerating... ...in Arlington, VA. This role offers exposure to cutting-edge big data tech and multidisciplinary problem solving. #J-18808-Ljbffr...Big data
Amazon
Arlington, VA15 hours ago - ...Big Data Engineer LOCATION Tysons, VA 22182 CLEARANCE TS/SCI Full Poly (Please note this position requires full U.S. Citizenship) KEY SUMMARY We are looking for a skilled and motivated Big Data Engineer to join our team and help build scalable, high-performance data systems...Big dataTemporary workFor contractorsImmediate startFlexible hours
Cymertek
Falls Church, VA1 day ago $110k - $160k
OverviewWe are looking for seasoned Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services... ...experience in Data Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL and NoSQL...Big data- Analytica is seeking a Databricks Data Engineer to support a high-profile program for a financial regulatory agency. This program entails developing... ....Experience with Databricks, Apache Spark, PySpark, or similar big data technologies.Experience with AWS cloud services such as S3...Big data
$180k - $200k
Job DescriptionEverforth ECS is seeking a Sr. Data and AI Engineer to work Hybrid.(Typically 1-2x per week in Arlington, VA office for team planning... ...and Data Architecture concepts, Data Warehousing and Big Data tools, Data Analytics and applicable knowledge of Data Science...Big dataWork at office$125k - $165k
...evolving technology landscape, an organization’s data has never been a more important aspect in... ...are looking for seasoned Senior Data Engineer to work with our team and our clients to... ...Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc....Big data$125k - $165k
...evolving technology landscape, an organization’s data has never been a more important aspect in... ...are looking for seasoned Senior Data Engineer to work with our team and our clients to... ...Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark,...Big data$62k - $141k
Data Engineer, MidThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more... ...than ever before. As a data engineer, you know that organizing big data can yield pivotal insights when it’s gathered from disparate...Big dataFull timeContract workPart timeWork at officeLocal areaRemote work$115k - $150k
...solutions and deliver stronger results for our clients.As a Senior Data Engineer, you will architect, build, and optimize scalable data... ...Data Factory)GCP (BigQuery, Dataflow)Hands-on experience with big data tools:Apache Spark, Kafka, Airflow, dbt, Snowflake, DatabricksExpertise...Big dataFull timeVisa sponsorship$132.1k - $178.8k
...and consume accurate and timely financial data. The team supports the global accounting... ...environment, relishes working with ambiguity, big data, UI components and enjoys the... ...responsibilitiesWorking with stakeholders and other engineering teams to identify and scope the right...Big dataFlexible hours$62k - $141k
Data EngineerThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial... ...today than ever before. As a data engineer, you know that organizing data can yield... ...maintaining scalable data stores that supply big data in forms needed for business analysis...Big dataFull timeContract workPart timeWork at officeLocal areaRemote work- ...Data Engineering-Big Data Engineering We are looking for an enthusiastic and motivated Data Engineer to support end-to-end data engineering activities and contribute to building scalable, cloud-based data solutions. The ideal candidate is eager to learn, has strong...Big data
EXL
Washington DC2 days ago - Job Description Job Description Data Engineer Top Secret clearance required to apply.7+ years of experience in database design and coding with big data. PowerBI development experience is highly desirable. Minimum Education: Bachelor's Degree.Big data
Bow Wave LLC
Arlington, VA2 days ago - ...and cost-effective solutions that meet the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering, Enterprise cloud services and solutions, PMO services, Innovation, R&D, Business Process and...Big data
- ...Senior Data Engineer We are seeking a seasoned Senior Data Engineer to join a dynamic team in Washington, DC. The ideal candidate will have... ...data across various platforms, leveraging cloud services and big data technologies. Responsibilities Design, develop, and...Big data
Samprasoft
Washington DC4 days ago - ...Big Data Engineer Location : Redmond, WA (Can be Remote but candidate should be from Redmond only) Primary Skills 1. Synapse, 2. Scala, 3. Spark/PySpark, 4. SQL, Scope, 5. Cosmos/ADLS Secondary and immediate skills...Big dataImmediate startRemote work
DMS Vision Inc
Washington DC3 days ago $120k - $225k
...Zachary Piper Solutions is currently seeking Data Engineers on our Professional Services team in McLean, VA. Are you a skilled Data Engineer... ...outcomes. Guide strategic customers through transformational big data initiatives and third‑party migrations, including end‑to‑...Big dataWork at officeZachary Piper Solutions
McLean, VA1 day ago$110k - $166k
...Senior Data Analytics Engineer – Role Overview At AIS, we are dedicated to providing our employees with diverse opportunities to grow their careers... ...applies advanced data modeling; leads robust ETL/ELT; uses big data technologies (e.g., Spark); enforces governance;...Big dataContract workAIS (Applied Information Sciences)
Washington DC1 day ago- ...Advisory practice.Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesRapidly... ...between business & technical stakeholders)Develop data engineering designs that positively impacts business performanceQualifications...Big dataLocal area
- ...motivated candidate to join our talented Team. Job Title: Senior IT Data Engineer Locations: NW Washington, DC Job Description: At least seven... ...: Ability to implement and manage cloud-based data and big data systems including: Amazon Aurora, Snowflake, Databricks, Amazon...Big data
Ampcus
Washington DC12 hours ago - Shift5 is seeking a Data Engineer to join our Product Engineering team in Arlington, Virginia. In this role, you will design, build, and maintain... ...engineering experience, with strong skills in programming and Big Data technologies. We offer a competitive salary, bonus...Big data
- ...KDA Consulting Inc. is seeking a highly skilled Data Engineer to design, build, and maintain scalable data pipelines and architectures supporting... ...with AWS cloud services, data engineering best practices, and big data technologies , with the ability to operate in a fast-...Big data
KDA CONSULTING INC
McLean, VA4 days ago - A leading consulting firm in the Washington, DC area is seeking a Data Engineer to design and develop data ingestion and cleaning processes using Python and Spark. The role requires 5+ years of big data experience, strong knowledge in data modeling, and the ability to communicate...Big data
- ...technology consulting firm is looking for a highly skilled Sr. Data Engineer to join their team in McLean, VA. The position demands extensive... ...engineering, focusing on AWS services, Python programming, and big data technologies. Responsibilities include managing data...Big data
- ...Data Engineer We are seeking a skilled Data Engineer with at least 5 years of experience designing, building, and maintaining scalable data... ...(e.g., PostgreSQL, MySQL, SQL Server) ~ Experience with big data processing frameworks (e.g., Spark, Hadoop) ~ Hands-on experience...Big data
VTG
McLean, VA1 day ago $110k - $115k
...Overview Join to apply for the Data Engineer role at Allnessjobs . This range is provided by Allnessjobs. Your actual pay will be based on... ...data migration perspective. Using programming skills to create big data pipelines that can deal with both structured and unstructured...Big dataFull timeZero hours contractWork at officeAllnessjobs
Washington DC3 days ago- Silverthorne Advisory Group is seeking a skilled Data Engineer to join our defense sector team. You will design, build, and maintain our Advana data infrastructure and ensure robust, scalable pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter...Big dataRemote job
- ...- and make a difference with us.Department Summary:MITRE’s Data Science and Engineering department is looking for qualified applicants to bring their... ...areas.Data EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, DaskData Storage...Big dataInternshipLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data center engineer Arlington, VA
- senior cloud data engineer Arlington, VA
- data infrastructure engineer Arlington, VA
- sr information security engineer Arlington, VA
- hadoop big data developer Arlington, VA
- data visualization developer Arlington, VA
- remote data engineer Arlington, VA
- etl data engineer Arlington, VA
- data engineer analytics Arlington, VA
- sr data engineer Arlington, VA