Senior Data Engineer: Scalable Pipelines & Spark Mastery
Shield Consulting Solutions
Shield Consulting Solutions, Inc. is seeking a Senior Data Engineer to design, build, and optimize analytics data pipelines for scalable, reliable processing. You will focus on end-to-end data ingress/egress, dataflow design, and Spark-based distributed processing to support complex analytics workloads. You will orchestrate workflows with Apache Airflow, work with SQL databases and big data formats, and ensure data quality and efficient processing across teams. #J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer: Scalable Pipelines & Spark Mastery in Annapolis, MD vacancy
- ...Nyla Technology Solutions is seeking a Software Engineer in Maryland with expert dataflow design and Spark-based processing to build scalable data pipelines for enterprise analytics. You will design, implement, and optimize end-to-end data ingress/egress, ensuring data...PipelineSenior
Nyla Technology Solutions
Annapolis, MD3 days ago - ...Solutions, Inc. is seeking a Software Engineer with an active TS/SCI w/Polygraph clearance to design and maintain data workflows using Apache Airflow, Python, and Spark. The role focuses on secure, scalable, and observable pipelines with collaboration across data...PipelineSenior16 hoursFull timeRemote work
Shield Consulting Solutions
Annapolis, MD3 days ago - ...LLC is seeking a Software Engineer with expertise in dataflow design and Spark-based processing to... ...and optimize analytics pipelines. The role demands a Top-... ...architect and optimize data ingress/egress pathways,... ...large datasets to deliver scalable solutions for mission-focused...PipelineSenior
Erias Ventures
Annapolis, MD3 days ago $230k - $240k
...This Senior Data Engineer role focuses on building and optimizing analytics data pipelines for efficient, scalable, and reliable processing. Responsibilities Design, implement, and optimize... ...pipeline performance Use Apache Spark for distributed processing aligned to...PipelineSeniorImmediate startShield Consulting Solutions
Annapolis, MD2 days ago- ...Captivation is seeking a senior software engineer to design, implement, and optimize data ingress/egress pathways for analytics workloads. You... ...Python and Java, leveraging Apache Spark and Airflow to build scalable data pipelines. Applicants must hold a Top Secret/SCI...PipelineSenior
Captivation
Annapolis, MD3 days ago $205k - $215k
...experience as a software engineer Bachelor’s degree in a technical... ...creating and maintaining data workflows and automation pipelines using Apache Airflow.... ...on building reliable, scalable, and observable workflow... ...engines including Apache Spark Experience with containerization...PipelineSenior16 hoursFull timeImmediate startRemote work$117.6k - $161.7k
Become a part of our caring community The Senior Data Engineer Designs, builds, and maintains data processing architectures and solutions... .... Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT processes supporting enterprise data and...PipelineSeniorFull timeTemporary workApprenticeshipWork at officeRemote workWork from homeHome office$186.07k - $218.9k
...about working at Coinbase. As a Senior Software Engineer on the Data Platform team within the Platform... ...foundational data storage and processing to scalable pipelines, frameworks, and internal... ...orchestration (Airflow), batch processing (Spark, SQL), streaming (Kafka), query...PipelineSeniorLocal area- Erias Ventures seeks a talented Enterprise - Cloud Software Engineer to join our analytics team in Annapolis Junction, MD. You will design... ..., and optimize high-performance analytic solutions using Spark, SQL, and SciPy within a cloud-based analytics environment. Responsibilities...Senior
- Shield Consulting Solutions, Inc. is seeking a senior software/data engineer with active TS/SCI w/Polygraph clearance to develop advanced data characterization and analytics pipelines. You will lead multiple software teams, select processes with customers, and ensure quality...PipelineSenior
$186k - $220k
...REQUIRED We are seeking a versatile, heavy-hitting Software Engineer with deep big data and cloud expertise to join our team in Annapolis Junction... ..., or high-speed data indexing frameworks. DevOps & CI/CD Pipelines: Familiarity with automated build and deployment pipelines...PipelineSeniorHourly payContract workWork experience placementImmediate startFlexible hoursNyla Technology Solutions
Annapolis, MD3 days ago- ...Erias Ventures seeks seasoned SWE professionals to design, implement, and support data visualization solutions. You will work on scalable data processing pipelines, cloud integrations, and collaborate across disciplines to deliver innovative analytics platforms. The role...PipelineSenior
Erias Ventures
Annapolis, MD3 days ago $152k - $180k
...CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED As a Data Visualization & Analytics Engineer on Team Nyla, you will bring your technical creativity... ..., curation, and identifying/resolving data errors or pipeline anomalies. Development Toolkit: Strong hands-on experience...PipelineSeniorHourly payContract workWork experience placementImmediate startFlexible hours$229k - $251k
Erias Ventures, LLC is looking for a Senior Software Engineer specialized in Linux, Bash, and Apache, based in Annapolis, MD. The role involves optimizing and designing data processing systems, requiring a top-secret security clearance. Candidates should possess a master...Senior$99k - $225k
...Data Scientist and Automation Engineer, Senior The Opportunity: Do you thrive in a mission-driven environment where modern... ...mission by designing advanced data workflows, scalable analytics solutions, and automated pipelines that strengthen data reliability and...PipelineSeniorFull timeContract workPart timeLocal areaRemote workBOOZ, ALLEN & HAMILTON, INC.
Davidsonville, MD13 hours ago$229k - $251k
...project. We are seeking engineers who wish to grow their careers... ...in dataflow design, data transport mechanisms, and Apache Spark based distributed... ...pathways to ensure efficient, scalable, and reliable processing... ...automation in CI/CD pipelines Experience with IaC (...PipelineSeniorHourly payTemporary workImmediate startFlexible hoursErias Ventures, LLC
Annapolis, MD4 days ago- ...performance analytics solutions that process large data volumes, using Spark/MapReduce and Python data libraries to deliver scalable insights. Ideal candidates have 14+ years of... ...clearance, and a proven ability to lead engineering teams while delivering mission-critical...
Erias Ventures
Annapolis, MD3 days ago $188k - $223k
...Machine Learning (AI/ML) Engineer to design, build, test,... ...—you will transform data science prototypes into production-ready, scalable AI solutions. You will... ...lifecycle: architecting data pipelines, selecting optimal... ...Skills Multi-Language Mastery: Advanced proficiency in...PipelineSeniorHourly payContract workWork experience placementImmediate startFlexible hoursShift workNyla Technology Solutions
Annapolis, MD3 days ago$213k - $233k
...HPC - Senior Software Engineer - Apache, Linux, Python ~ Annapolis Junction... ...and maintaining data workflows and automation pipelines using Apache Airflow. This... ...on building reliable, scalable, and observable... ...engines including Apache Spark Experience with containerization...PipelineSeniorHourly payExtra incomeTemporary workImmediate startRemote workFlexible hoursErias Ventures, LLC
Annapolis, MD4 days ago- ...Solutions Group, LLC is seeking a Systems Engineer to design, build, and deploy AI/ML... ...LLM-powered apps, predictive models, and data pipelines for mission-focused programs. The role... ...performance, security, reliability, and scalable software engineering, with exposure to...PipelineSenior
Intelliforce-IT Solutions Group, LLC.
Annapolis, MD3 days ago - ...Erias Ventures, LLC in Maryland seeks a Senior AI/ML Engineer to design, implement, and productize... ...challenges. You will lead model architecture, data pipelines, and deployment, collaborating with cross-functional teams to deliver scalable results. The role requires a Top-...PipelineSenior
Erias Ventures
Annapolis, MD3 days ago - ...Erias Ventures, LLC is seeking a Senior Software Engineer specialized in ML Deployment to move models from... ...end users and researchers, building robust CI/CD pipelines, and producing deployment best practices and documentation for scalable systems. #J-18808-Ljbffr...PipelineSeniorRemote work
Erias Ventures
Annapolis, MD3 days ago - ...Artificial Intelligence/Machine Learning 2 professional to design, train, and deploy scalable AI/ML models in a high-security environment. You will lead model architecture, data pipelines, and governance to meet customer requirements. You will work on a wide range of ML...PipelineSenior
$213k - $233k
HPC - Senior Software Engineer - Apache, Linux, Python Annapolis Junction... ...and maintaining data workflows and automation pipelines using Apache Airflow. This... ...on building reliable, scalable, and observable workflow... ...engines including Apache Spark Experience with containerization...PipelineSeniorHourly payExtra incomeTemporary workImmediate startRemote workFlexible hours- Seeking a senior Cloud Software Engineer 3 in Annapolis, MD to design, develop, and optimize large-scale Big Data cloud architectures and distributed systems. You will build backend processing, data ingestion pipelines, and analytics across multi-node Linux-based environments...PipelineSenior
- Intelliforce is seeking an experienced Systems Engineer to design, build, evaluate, and deploy... ...solve mission-critical problems with scalable, secure, and reliable AI systems. You... ...AI agents, and develop production data pipelines while keeping performance, latency, and...PipelineSenior
- Erias Ventures is seeking a Senior Software Engineer to deploy ML models and build scalable Python-based pipelines in a hybrid work setup. You will collaborate with end users and researchers to align development with real-world needs, and help move projects from prototype...PipelineSenior
$99k - $149k
...Total Visits, March 2026) Day to Day The Data Engineer's role at Indeed is to integrate data... ...the data lake data model and building scalable and efficient processes to populate or... ...reliable, trusted, and efficient data pipelines. This work directly contributes to our...PipelineWork experience placementLocal areaRemote work$225k - $245k
...perspectives to every project. We are seeking engineers who wish to grow their careers and want... ...in all aspects of model architecture, data pipeline interaction, and metrics application,... ...the AI/ML Engineer designs and creates scalable solutions for optimal performance. The...PipelineSeniorHourly payTemporary workImmediate startFlexible hoursErias Ventures, LLC
Annapolis, MD4 days ago$196k - $252k
...help teams work with complex data, automate analysis, and... ...science, and production software engineering. From building LLM-powered... ...models and production data pipelines, you will help take ideas from... ...reliability, security, and scalability in focus. What Makes This...PipelineSeniorImmediate startVisa sponsorshipThe Solutions Group Llc
Annapolis, MD4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer: Scalable Pipelines & Spark Mastery. Be the first to apply!
Related searches
- data systems engineer Annapolis, MD
- finance data engineer Annapolis, MD
- data engineer contract Annapolis, MD
- big data devops engineer Annapolis, MD
- sr data engineer Annapolis, MD
- senior data engineer Annapolis, MD
- entry level big data engineer Annapolis, MD
- data engineer machine learning Annapolis, MD
- data infrastructure engineer Annapolis, MD
- data engineering intern summer Annapolis, MD