Senior Data Engineer

$185k - $200k

Full-time

VivSoft Technologies

Job Title: SeniorData Engineer
Location: Remote
Position Type: Full-Time
Clearance Required: Secret Clearance
About the company:
At VivSoft, we aim to solve complex federal problems using emerging and open technologies in a collaborative and rewarding environment. VivSoft is a diverse team of strategists, engineers, designers, and creators experienced in building high-performance, effective software, with a focus on impactful organisational design and software delivery dynamics. We build secure Software Factories based on DoD reference designs and NIST Frameworks for Cloud and DevSecOps. These factories deliver AI/ML Applications, Data Science Platforms, Blockchain and Microservices for DoD, Healthcare and Civilian Agencies
Job Summary:
We are seeking a Senior Data Engineer to support a DoW program responsible for building and operating a modern, scalable, and secure data platform. This role will lead the design and optimization of an enterprise lakehouse architecture on AWS, leveraging Apache Iceberg, Apache Spark, and cloud-native technologies to enable advanced analytics, AI/ML initiatives, and operational reporting. The ideal candidate will possess deep expertise in large-scale data platforms, distributed processing, data governance, and cloud infrastructure while providing technical leadership and mentoring across engineering teams.
Key Responsibilities:
Architect, build, and manage a cloud-based lakehouse environment using Apache Iceberg, AWS S3, and AWS Glue Catalog.
Develop and optimize Apache Spark data pipelines on EMR and Kubernetes environments.
Design and implement event-driven data ingestion solutions using S3 events and Amazon SQS.
Optimize query performance across Athena, Trino, and Spark SQL environments.
Orchestrate data workflows and ETL pipelines using Apache Airflow.
Manage infrastructure deployment and automation using Terraform.
Develop, publish, monitor, and maintain data products and analytical dashboards.
Implement data quality, governance, lineage, access controls, and cost management best practices.
Create technical documentation, architectural designs, and operational runbooks.
Provide technical leadership and mentorship to junior engineering team members.
Required Skills:
Must possess an active Secret Clearance
8+ years of professional experience in Data Engineering or large-scale data platform development.
Expertise in Apache Spark, including performance tuning, partitioning, memory optimization, and handling data skew.
Strong proficiency in Python or Scala and advanced SQL development.
Experience with open table formats such as Apache Iceberg (preferred) or Delta Lake.
Strong understanding of distributed query engines, including Athena, Trino, and Spark SQL.
Hands-on experience with AWS services, including S3, Glue, EMR, Athena, EC2, SQS, and event-driven architectures.
Experience with Apache Airflow for workflow orchestration.
Proficiency with Terraform and Infrastructure as Code (IaC).
Experience working with Kubernetes environments.
Experience developing dashboards and data products using Grafana or similar visualization platforms.
Strong understanding of data quality, data governance, lineage, and access control frameworks.
Excellent technical leadership, mentoring, and stakeholder communication skills.
Ability to translate business, operational, and analytics requirements into scalable data platform solutions.
Strong collaboration skills with Data Scientists, AI Engineers, Cloud Engineers, and business stakeholders.
Proven ability to lead technical discussions and mentor junior engineers.
Excellent written and verbal communication skills.
Strong attention to detail regarding data quality, governance, lineage, security, and operational reliability.
Preferred Skills:
Experience operating and maintaining Apache Iceberg tables at enterprise scale.
Experience with Trino administration and performance optimization.
Knowledge of dbt or similar data transformation frameworks.
Experience with Helm and GitOps deployment methodologies.
Experience evaluating and implementing modern data visualization platforms beyond Grafana.
Familiarity with data catalog, metadata management, lineage, and governance tools.
AWS Data Analytics Certification and/or Certified Kubernetes Administrator (CKA).
Prior DoD, USAF, or Federal Government data platform experience.
Experience supporting AI/ML, data science, or advanced analytics workloads in cloud environments.
Benefits:
Comprehensive Medical, Dental, and Vision Plans (Healthcare benefits are 100% employer-paid for employees only)
Life Insurance
Paid Time Off (Flexible/Combined PTO, Bereavement Leave, 11 Company Paid Holidays)
401K Retirement Plan with employer match
Professional Development Training Reimbursement
Salary Range: $160K to $180K per Annually

Apply

Vacancy posted 9 days ago

Similar jobs that could be interesting for youBased on the Senior Data Engineer in Remote vacancy

Senior Data Engineer
$160k - $190k
...Senior Data Engineer | GCP, BigQuery & Data Platform I’m recruiting for a growing AdTech company looking for a Senior Data Engineer to take real ownership of its analytical data platform. This is not a role where you inherit a perfectly organized warehouse and spend...
Senior
Remote work
Averity
New York, NY
2 days ago
Senior Healthcare Data Engineer
Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:... ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,...
Senior
Contract work
Remote work
HAN Staffing
Iselin, NJ
2 days ago
Senior Data Engineer
...Senior Data Engineer (Microsoft Fabric / Azure) Location: Remote Employment Type: Full-Time About the Opportunity We're partnering with an established organization undergoing a significant transformation of its enterprise data infrastructure. They're looking...
Senior
Full time
Remote work
Talent
United States
3 days ago
Senior Data Engineer Databricks
$119k - $145k
...Position: Senior Data Engineer, Databricks Compensation: $119-$145k, depending on experience Location: Remote Inceed has partnered with a great company to help find a skilled Senior Data Engineer Databricks to join their team! This is an exciting opportunity...
Senior
Remote work
Inceed
Greenwood Village, CO
5 days ago
Senior Data Engineer
...Title: Senior Data Engineer Location: Tampa, FL 33624 or Remote Employment Type: W2 Contract to Hire, 3+ Months Work Authorization: U.S. Citizen or Permanent Resident Sponsorship: Not available. No C2C arrangements. Job Description Talent Groups is...
Senior
Permanent employment
Full time
Contract work
Remote work
Talent Groups
Tampa, FL
1 day ago
Senior Data Engineer
...Rotterdam 4.202 - 6.351 p.m. Innovatie: Jij bouwt en optimaliseert data-backendoplossingen die onze organisatie intelligenter en efficië... ...oplossingen te ontwikkelen en te implementeren.Als Data Engineer bij Croonwolter&dros ben jij verantwoordelijk voor het ontwerpen...
Senior
Full time
Work at office
Croonwolter&dros
Rotterdam, NY
6 days ago
Senior Data Engineer
...services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior Data EngineerLocation: McLean, VA (Remote)Summary: Our Data Engineering team is dedicated to integrating our client data and applications with client infrastructure....
Senior
Remote work
Ampcus
McLean, VA
6 days ago
Senior Data Engineer - Data Lake / AI
$170k - $200k
...We are seeking a Senior Data Engineer with strong experience across AWS or Azure data, data lakes, and AI/ML platform ingestion to join a newly formed data engineering team at one of the world’s largest and most prestigious law firms as it undergoes a major data and AI...
Senior
Full time
H1b
Remote work
Visa sponsorship
Onward Legal Innovation
Washington DC
5 days ago
Senior Data Engineer
$110k - $160k
...Senior Data Engineer – Enterprise Data Modeling Location: Remote – U.S. | Phoenix, AZ candidates preferred Compensation: $110,000–$160,000 Employment: Full-time About the Company A large, established organization is making a significant investment in...
Senior
Full time
Remote work
Harnham
Phoenix, AZ
2 days ago
Senior Data Engineer
...enterprise and federal clients across the United States. We hire engineers directly, invest in specialized training at our own cost, and... ...day one. About the Role :Revature is hiring experienced data engineers to join a large-scale Databricks platform build supporting...
Senior
Full time
Local area
Remote work
Relocation
Revature
Baltimore, MD
1 day ago
Senior Data Engineer
...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...Role: We are seeking an experienced Senior Data Engineer with 8+ years of expertise...
Senior
Full time
Remote work
Quantiphi
United States
3 days ago
Senior Data Engineer
$65 - $80 per hour
DescriptionKforce has a client that is seeking a Senior Data Engineer in Oakland, CA. The contract-duration for this role is 3-6 months. The position is mostly Remote. You should be able to come for occasional meetings in the Oakland office.Summary:The Data Engineer (Senior...
Senior
Contract work
Work at office
Remote work
KForce
Oakland, CA
4 days ago
Senior Data Engineer
$10k
...of users across the globe, we’ve become the most trusted way to find a relationship, for all. About the Role: As a Senior Data Engineer at Hinge, you will create essential data processes and contribute to components of a modern data pipeline that will be the foundation...
Senior
Full time
Work experience placement
Hinge
New York, NY
5 days ago
Senior Data Engineer
$180k - $220k
Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing...
Senior
Work at office
Remote work
Flexible hours
Shift work
2 days per week
1 day per week
Consortia
New York, NY
6 days ago
Senior Data Engineer
Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...
Senior
Remote work
Tredence
San Jose, CA
6 days ago
Senior Data Engineer
...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...Role: We are seeking an experienced Senior Data Engineer with deep expertise in...
Senior
Full time
Remote work
Quantiphi
United States
4 days ago
Senior Data & Machine Learning Engineer
...personalized ads powered by a self-learning recommendation engine. We're seed-stage and growing quickly. The... ...like owners. Debate is open and direct. We let data settle arguments. THE ROLE We're looking for a Senior Data & Machine Learning Engineer who can...
Senior
PatternIQ
New York, NY
4 days ago
Senior Data Engineer (Databricks)
...Senior Data Engineer With Databricks Remote, Anywhere in the Continental US Due to the nature of the role, this position requires U.S. Citizenship. Data Surge is disrupting the services industry with cutting-edge technology that brings together the very best...
Senior
Full time
Immediate start
Remote work
Data Surge
United States
3 days ago
Senior Data Engineer (Remote)
About the RoleAs Senior Software Engineer, you will collaborate closely with design, product and engineering experts to tackle real-world challenges... ...product teamLeverage critical thinking, experimentation, data, and industry best practices to implement desired business outcomesFacilitate...
Senior
Remote work
Kohl's
Menomonee Falls, WI
7 days ago
Senior Data Engineer | dbt, Snowflake & Data Transformation
...Eastern, Central, and Mountain time zones. You'll work with a modern data stack built around dbt, Snowflake, SQL, Python, and cloud-native... .... This fully remote role is ideal for a seasoned data engineer who wants to make a significant impact within a growing and highly...
Senior
Full time
Remote work
Motion Recruitment
Dallas, TX
5 days ago
Senior Data Engineer, gTech Users and Products
$156k - $226k
...architecture, technical roadmap, and priorities for large-scale data products, pipelines, and reporting systems within gUP.Scope... ...and scripts.Preferred qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related field.Experience integrating AI...
Senior
Google
Boulder, CO
6 days ago
Senior Data Engineer (dbt, Snowflake, Modern Analytics Stack)
...and supply chain technology organization that is expanding its data capabilities to support large-scale operations across North America... ...professional who enjoys owning the operational side of data engineering. The organization already has strong foundations in...
Senior
Full time
Remote work
Motion Recruitment
Dallas, TX
5 days ago
Senior Data Engineer, Consulting
...Senior Consultant, Data Engineering (L4) About Vivanti Vivanti is a home for high-performing technologists who drive measurable impact for clients. Our mission is to transform businesses and build a smarter, more connected world through the power of data, cloud,...
Senior
Full time
Work at office
Work from home
Flexible hours
Shift work
Vivanti Consulting
New York, NY
3 days ago
Senior Data Engineer - Financial Services & Insurance (Direct Hire/FTE)
...OneUS Technologies has partnered with a premier, globally recognized management and technology consultancy to identify talented Senior Data Engineers. Our client specializes in delivering complex, sector-focused strategy and transformation programs for the financial...
Senior
Permanent employment
Full time
Remote work
Monday to Thursday
Afternoon shift
OneUS Technologies LLC
United States
4 days ago
Remote Senior Data Engineer
$86 - $96 per hour
DescriptionKforce has a client that is seeking a Remote Senior Data Engineer.Summary:Our client is looking for a Senior Data Engineer with machine learning skills to build the data foundation behind our ML models. You will lead the design of scalable, well-governed data...
Senior
Remote work
KForce
Atlanta, GA
4 days ago
Senior Data Engineer
...Best Places to Work 4 years in a row! Job Summary The Data Engineer leads the design, development, and maintenance of scalable and... ...junior engineers, and drives innovation and best practices. The Senior Data Engineer collaborates cross-functionally to align data...
Senior
Full time
Work at office
Local area
Work from home
DOWC
Parsippany, NJ
1 day ago
Senior Reference Data Engineer
$150k - $190k
...Insurance and Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,... ...the Role: We are seeking a hands-on Senior Reference Data Tech Lead with 8+ years of professional software engineering experience to design, architect, and enhance...
Senior
Full time
Temporary work
Remote work
Worldwide
BIP US
New York, NY
1 day ago
Senior Data Infra Engineer
$175k - $221k
...feed ranking decision, every recommendation, every A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming pipelines at the core of that platform — someone who takes...
Senior
Full time
Local area
Work from home
News Break
Mountain View, CA
5 days ago
Senior Data Engineer
...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast...
Senior
Work at office
Remote work
Interactive Brokers
Chicago, IL
5 days ago
Senior HPC Data Storage Engineer (RHEL)
$140k - $160k
OverviewAMERICAN SYSTEMS, a 100% employee-owned federal government contractor, is seeking a Senior HPC Data Storage Engineer to manage and optimize high-performance storage supporting mission-critical scientific and technical computing for a specialized customer environment...
Senior
For contractors
Second job
Remote work
AMERICAN SYSTEMS
Arlington, VA
6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!