Principal Data Engineer
IVID TEK INC
Job Description
Job Description
Job Title: Principal Data Engineer
Job Description – Principal Data Engineer
Job Type: Contract W2
Location: Johnston, RI or Charlotte, NC or Boston,MA
Role Overview:
Principal-level Java engineer to design and build enterprise-grade, real-time and batch data processing systems using Java, Spark, Kafka, and Microservices architecture. Strong focus on event-driven pipelines, API development (build + consume), and high-volume streaming platforms.
Key Responsibilities:
- Architect, design, and implement enterprise-grade Java-based data platforms and distributed processing systems
- Build and maintain production-ready Spark applications (Java) for batch and real-time processing
- Design and evolve Kafka-based event streaming and ingestion pipelines
- Develop and consume REST APIs within microservices architecture
- Lead architecture ensuring scalability, reliability, and regulatory compliance
- Apply strong object-oriented design and engineering practices
- Mentor engineers on performance tuning and production readiness
- Design and implement MDM solutions (match, merge, survivorship logic)
- Ensure data quality, observability, and system stability
- Support production deployments and operational handoffs
Required Skills & Experience:
- 10–12+ years experience in Java/backend or data engineering
- Hands-on experience building real-time data pipelines (Kafka, Spark Streaming/Flink)
- Solid knowledge of relational databases (Redshift, PostgreSQL, Snowflake) and NoSQL databases (MongoDB or similar)
- Strong Kafka and event-driven architecture experience
- Strong Microservices experience (Spring Boot, REST APIs)
- Experience in API development and API consumption
- Hands-on Spark experience (batch and streaming)
- Strong SQL and data modeling skills
- AWS experience (S3, Glue, EMR, Redshift)
- Experience in regulated/data governance environments
- CI/CD, Git, Docker/Kubernetes familiarity
Preferred:
- Scala or Python experience
- Talend/DataStage exposure
- Data lake experience (Iceberg/Parquet)
- Frontend/API integration exposure
- Experience supporting large-scale production systems
Mandatory Screening Criteria:
Candidates must have hands-on experience building real-time/event-driven data pipelines using Kafka and Spark/Flink, along with strong microservices and API development experience.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Principal Data Engineer in Charlotte, NC vacancy
- ...Overseas Contractor with 11 to 15 years of expertise in Informatica MDM and Informatica Cloud MDM to lead and optimize enterprise Master Data Management solutions. Job Description: Lead the architecture design and implementation of Informatica MDM solutions including both...SuggestedFor contractorsOverseas
- Responsibilities: Leads and develops a team of managers, technical leads, and engineers, building a strong leadership bench and high-performing... ...development. Owns the end-to-end lifecycle of enterprise data products and platforms, including definition, development,...SuggestedFull time
$192k - $240k
...wealth management.As AssetMark continues to invest in enterprise data capabilities, we are building a modern data platform that... ...strategy into execution. This role is accountable for building the engineering muscle behind our enterprise data platform: establishing strong...SuggestedFull timeWork at officeFlexible hours$143.91k - $169.3k
...learn new skills and discover what you excel at—all from Day One.Job DescriptionWe are seeking an experienced Data Modeler, Designer, and Warehouse Engineer to lead data workstreams for a large-scale technology integration and transformation program within our Capital...SuggestedFull timeLocal area3 days per week- ...growth environment focused on modernization, scalability, and using data more effectively across disconnected business units A... ...platform connectivity Ability to lead and grow a team of Data Engineers Ability to enable AI use cases through a well-structured, scalable...Suggested
$120k - $160k
...business or technical experience, including people leadership and data expertise. We expect an undergraduate degree or an... ...graduate degree is preferred. We need experience leading data engineering teams and delivering scalable data solutions. We value experience...Full timeVanguard
Charlotte, NC5 days ago- ...The Manager, Data Engineering, is a technical leader within the DealCloud Services team, responsible for owning end-to-end delivery of client data migration engagements. This role combines hands‑on technical expertise with people leadership, driving delivery excellence...Local areaFlexible hours
Jobtailor
Charlotte, NC23 hours ago - ...government agencies, a list that spans across the country. Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine...Full timeVisa sponsorshipWork visa
Captech Consulting
Charlotte, NC1 day ago - The Manager, Data Engineering, is a technical leader within the DealCloud Services team, responsible for owning end-to-end delivery of client data migration engagements. This role combines hands‑on technical expertise with people leadership, driving delivery excellence...Local areaFlexible hours
$128k - $252.5k
...that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and develop... ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas...Local area- Who You’ll Work WithAt Slalom, we co-create custom software, data, and cloud products with clients who are ready to accelerate their... ...organizations that drive true change.Our Data Architecture & Engineering team sees data as the foundation for decision-making, artificial...Temporary workLocal area
$128k - $249k
...search for talented visionaries and your search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data Engineer contributes to the Enterprise Applications, Data, and AI Platforms group, designing scalable...Full timeTemporary workLocal areaRemote workFlexible hoursAfternoon shift$82.42k - $126.6k
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth and operational efficiency. We specialize in leveraging advanced AI and analytics to create innovative solutions that address complex...Full timeTemporary workRelocation- ...a premier Google Cloud partner helping organizations modernize data ecosystems, build real-time analytics capabilities, and responsibly... ...Foundation Models, and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data Engineering, Analytics, or...Full timeWork experience placementLive inWork at officeLocal area
$82.42k - $126.6k
...driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions...Full timeTemporary workRelocation$86.8k - $165.2k
...of the global market. Join us and help shape the future of aerospace and defense.We are seeking a skilled and highly motivated Data Engineer to join our Data & Analytics team in Collins Aerospace. In this role, you will be responsible for designing, developing, and maintaining...Contract workTemporary workWork experience placementWork at officeRemote workFlexible hours$117.2k - $175.8k
Sr Data Engineer - GE07BEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our...Full timeTemporary workWork at office3 days per week$60 - $66 per hour
DescriptionKforce has a client that is seeking a Senior Data Engineer in Charlotte, NC.Requirements* Minimum 8 years of hands-on data engineering experience in development using Python and Pyspark* Experience in AWS cloud services like Glue, Lambda, MSK (Kafka), S3, Step...$65 per hour
...work W2!DescriptionKey Responsibilities• Lead and mentor Oracle developers while providing technical guidance and best practices for data integration and ETL development.• Design, build, and support SSIS packages and data integration workflows across enterprise systems....Contract workTemporary work- About this role:Wells Fargo is seeking a Senior Data Engineer within the Commercial & Corporate & Investment Banking Technology (CCIBT) organization. The role resides in the Enterprise Counterparty Risk Technology (ECRT) team, which develops and supports technology solutions...Full timeWork experience placement
$80k - $133k
Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms, pipelines, and cloud-based analytics solutions. The...Full timeContract workFlexible hours$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...Local areaVisa sponsorship$30 - $35 per hour
Data Engineer- DatabricksLocation: Remote - CST HoursEmployment Type: Full-Time ConsultantDuration: Project Based Contract Through End of Year with Likely ExtensionWorking Hours- 12:00 AM - 9:00 AM Central Time (CT) M-F.Compensation- $30-35/hrAbout Us Slalom is a purpose...Full timeContract workLocal areaRemote workShift work$100.96k - $151.44k
Data Engineer - GE08AEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team...Full timeTemporary workWork at office3 days per week$130k - $176k
...sponsor or assume the sponsorship of an employment visa at this time”.Selective Insurance is seeking an energetic and collaborative Data Engineer Team lead to work on data and analytics projects supporting the Claims team within the Information Management group. This group...Work experience placement$107k - $147k
...QualificationsBachelors degree or equivalent in Computer Science, Engineering, or related field; or equivalent work experience. 5-7+ years of... ...code and integrating platforms to seamlessly exchange data or functionality. Robust knowledge of gathering data with client...Full timeWork experience placementWork at officeWork from home1 day per week- ...description:Designs and develops advanced technical cybersecurity data and analytics capabilities across both uniform and bespoke... ...priorities, and goals for the job area.Collaborates with product, engineering and operations teams to apply modern security practices in all...Permanent employmentFull timePart timeH1bWork visaShift workDay shift
$134.5k - $265.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...Local areaVisa sponsorship- We are seeking a skilled Data Engineer with strong handson expertise in Hadoop ecosystem technologies particularly in onpremise environments The ideal candidate will have deep experience working with PySpark HDFS and Hive and a solid understanding of largescale data processing...
- About this role:Within COO Technology, Wells Fargo is seeking a Lead Data Engineer to help shape and scale our cloud‑native data ecosystem. In this role, you will focus on Google Cloud Platform (GCP) services and frameworks, leading the design, build, and operation of reusable...Full timeWork experience placementWork at officeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Data Engineer. Be the first to apply!
Related searches
- principal network engineer Charlotte, NC
- senior director engineering Charlotte, NC
- civil engineer project manager Charlotte, NC
- principal developer Charlotte, NC
- principal engineer Charlotte, NC
- director data engineering Charlotte, NC
- principal infrastructure engineer Charlotte, NC
- principal security engineer Charlotte, NC
- senior civil engineer project manager Charlotte, NC
- director software engineering Charlotte, NC