Principal Data Engineer
IVID TEK INC
Job Description
Job Description
Job Title: Principal Data Engineer
Job Description – Principal Data Engineer
Job Type: Contract W2
Location: Johnston, RI or Charlotte, NC or Boston,MA
Role Overview
Principal-level Java engineer to design and build enterprise-grade, real-time and batch data processing systems using Java, Spark, Kafka, and Microservices architecture. Strong focus on event-driven pipelines, API development (build + consume), and high-volume streaming platforms.
Key Responsibilities
• Architect, design, and implement enterprise-grade Java-based data platforms and distributed processing systems
• Build and maintain production-ready Spark applications (Java) for batch and real-time processing
• Design and evolve Kafka-based event streaming and ingestion pipelines
• Develop and consume REST APIs within microservices architecture
• Lead architecture ensuring scalability, reliability, and regulatory compliance
• Apply strong object-oriented design and engineering practices
• Mentor engineers on performance tuning and production readiness
• Design and implement MDM solutions (match, merge, survivorship logic)
• Ensure data quality, observability, and system stability
• Support production deployments and operational handoffs
Required Skills & Experience
• 10–12+ years experience in Java/backend or data engineering
• Hands-on experience building real-time data pipelines (Kafka, Spark Streaming/Flink)
• Solid knowledge of relational databases (Redshift, PostgreSQL, Snowflake) and NoSQL databases (MongoDB or similar)
• Strong Kafka and event-driven architecture experience
• Strong Microservices experience (Spring Boot, REST APIs)
• Experience in API development and API consumption
• Hands-on Spark experience (batch and streaming)
• Strong SQL and data modeling skills
• AWS experience (S3, Glue, EMR, Redshift)
• Experience in regulated/data governance environments
• CI/CD, Git, Docker/Kubernetes familiarity
Preferred
• Scala or Python experience
• Talend/DataStage exposure
• Data lake experience (Iceberg/Parquet)
• Frontend/API integration exposure
• Experience supporting large-scale production systems
Mandatory Screening Criteria
Candidates must have hands-on experience building real-time/event-driven data pipelines using Kafka and Spark/Flink, along with strong microservices and API development experience.
$192k - $240k
...wealth management. As AssetMark continues to invest in enterprise data capabilities, we are building a modern data platform that... ...strategy into execution. This role is accountable for building the engineering muscle behind our enterprise data platform: establishing strong...SuggestedFull timeWork at officeFlexible hours$65.5k - $134k
.... Senior Analyst - Financial Services Organization - AI and Data - Service Delivery Center EY is the only professional services... ...(trading, risk, compliance, or banking) Knowledge of prompt engineering and in-context learning optimization Familiarity with model fine...SuggestedFull timeSummer holidayFlexible hours- ...Vice President, Cloud Data Engineering About the Company Top-tier organization in the consumer services industry Industry Consumer Services Type Privately Held About the Role The Company is seeking a VP of Engineering to lead its dynamic and innovative...Suggested
- ...Wholesale Operations team is seeking a Technology Enablement Principal Engineer. The Wholesale Technology organization delivers technology... ...Identify and resolve systemic, enterprise-wide bottlenecks through data-driven insights and targeted interventions Translate...SuggestedFull timeWork experience placementWork at officeRelocation package
- About this role: Wells Fargo is seeking a Principal Engineer to help drive application simplification, including helping create frameworks to make the data center migration more efficient, define tools and processes to identify and prevent problems before they happen. Leveraging...SuggestedFull timeWork experience placementSecond jobShift work
- ...Data Center Sales Engineer HPC-Industrial, powered by Clean Harbors, is looking for a Data Center Sales Engineer to join their safety conscious team! The Sales Engineer has direct responsibility for profitable revenue growth throughout the designated areas of coverage...Full timeTemporary workFor contractorsLocal areaRemote work
- ...Sales Engineer Hoffman & Hoffman, Inc. is recruiting for a sales engineer to handle HVAC equipment sales. As the sales engineer, you will provide consulting engineers and contractors the tools to select and apply equipment from the industry's finest manufacturers of...For contractorsWork at officeFlexible hours
$84.63k - $112.84k
...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and... ...future of AI‑ready connectivity, join us today. The Role Engineers are expected to identify and design solutions for issues involving...Full timeTemporary workRemote work$84.63k - $112.84k
...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and... ...today. The Role Cybersecurity Incident Response Team (CIRT) Engineers at Lumen are on the front lines of protecting the systems that...Full timeTemporary workRemote workShift work$100k - $172.5k
...Description: We are searching for the best talent for a Principal Product Security Engineer to be located in Danvers, MA or Raritan, NJ. Remote work... ...including security plans, architecture diagrams, data flow diagrams, threat models, security requirements, Design...Full timeTemporary workWork at officeLocal areaImmediate startRemote work3 days per week- Champions Do More As one of the fastest-growing and most exciting brands in the industry, Crash Champions is the largest founder-led multi-shop operator (MSO) of high-quality collision repair service in the U.S. The company, which also operates the growing Crash Champions...Full timeRemote work
- ...Head of Engineering About the Company Develops, owns, and operates large-scale onsite energy assets. Industry Renewables & Environment Type Privately Held, Private Equity-backed About the Role The Company is seeking a Head of Engineering to serve...For contractorsRemote work
- ...Founding Head of Engineering, Agentic AI About the Company Reputable legal technology (LegalTech) company using AI to provide affordable legal services Industry Legal Services Type Privately Held About the Role The Company is seeking a Founding...
- ...Head of Engineering About the Company Promising provider of top-notch services Industry Consumer Services Type Privately... ...requires excellent problem-solving skills, the ability to make data-driven decisions, and a deep understanding of the latest industry...
- ...team of high-performing business professionals and leaders in engineering, R&D, product management and business development areas at our... ...partnering with Research & Development teams to identify engineering data requirements, develop test specifications, and translate...Permanent employmentImmediate startWork visa
$86.25k - $172.5k
...have an opportunity to contribute to the company’s success. As a Data Scientist within PNC's Anti-Money Laundering Analytics &... ...storytelling. May partner with Data Architects, Data Analysts, Data Engineers and Visualization Experts to develop data-driven solutions for...Full timeTemporary workPart timeWork experience placementWork at office- ...Head of Data Science & AI, Identity & Compliance About the Company Leading provider of financial technology (FinTech) solutions Industry Information Technology and Services Type Privately Held About the Role The Company is in search of a Head of...
- ...Head of Data Science and Advanced Analytics About the Company Globally renowned biopharmaceutical company Industry Pharmaceuticals Type Public Company About the Role The Company is in search of a Head of Data Science and Advanced Analytics to spearhead...
$159.97k - $188.2k
...you excel at—all from Day One. Job Description The AI Guardrails Engineering Director leads the strategy, architecture, and delivery of AI... ...optimization. Ensure alignment with enterprise requirements for security, data privacy, compliance, and Responsible AI practices. Drive cross-...Full timeTemporary workWork experience placementLocal area3 days per week- ...Job Description Job Description Senior Data Engineer – Data Architecture & Platform CPI Security, a national leader in residential and commercial security solutions, is seeking a Senior Data Engineer transitioning into Data Architecture to join us on our data transformational...Work experience placement
- ...Job Description Job Description Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused...Full timeFlexible hours
- ...Job Title: AWS Data Engineer Location: Charlotte, NC Job Type: Full-Time Experience: 8-10 Years Job Summary We are seeking an experienced AWS Data Engineer to design, build, and optimize scalable, event-driven data platforms on AWS. The ideal candidate...Full time
- ...Description Be Part Of A High-Performing Team: Join a technology team focused on building, modernizing, and supporting enterprise data integration solutions that help business and IT teams improve operational processes. This role sits within a collaborative Agile...Contract workWork at officeRemote work1 day per week
- ...*Director of Portfolio & Operations** to oversee supplier relationships, portfolio management, inventory planning, pricing support, data accuracy, and operational execution. This is a remote position open to candidates based anywhere in the United States, with a preference...Remote work
- ...Performing Team: Join a technology team supporting a leading financial services environment where data-driven systems, scalable applications, and reliable engineering practices are critical to business operations. This team works across technical and business groups...
$149.35k - $248.85k
...direct people management, this is your seat. Job Overview: As the Principal Engineer, Cloud Strategy Lead, you set and drive the multi-year... ...generation, automated PR review, MCP-backed agents for internal data, and conversational interfaces that let internal customers...Full timeWork experience placementWork from home- ...General HVAC Engineer II Industry: Commercial Real Estate (CRE) Reports to: Chief Engineer Location: Charlotte, NC Firm Overview... ...installation activities for properties assigned to them. Principal Responsibilities: Works closely with the Chief Engineer to...Contract workFor contractorsWork at officeShift work
- ...Head of Solutions Engineering About the Company Leading AI technology firm Industry Artificial Intelligence Type Privately... ...foundation lab, an AI-native enterprise firm, or an enterprise data platform. They must be comfortable with the dual remit of...
- ...Head of Product and AI Engineering About the Company Expanding behavioral science & market research technology company Industry... ...science and a deep understanding of AI, machine learning, and data-driven platforms, with a focus on large language models and modern...
- ...your own. We’re actively seeking a talented Director and Financial Engineer to join our Product Development Team in Newport Beach, CA; Omaha... ...into the product development cycle. Synthesize and integrate data and analysis into a cohesive story that drives insights and supports...Full timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Data Engineer. Be the first to apply!
- principal network engineer Charlotte, NC
- senior director engineering Charlotte, NC
- engineering director Charlotte, NC
- principal engineer Charlotte, NC
- director software engineering Charlotte, NC
- general engineer Charlotte, NC
- director data engineering Charlotte, NC
- principal data engineer Charlotte, NC
- senior chief engineer Charlotte, NC
- principal developer Charlotte, NC



