Lead Data Engineer
Openkyber
Senior Data Engineer Charlotte, NC Position Overview We are seeking an experienced Senior Data Engineer to lead critical data infrastructure, database modernization, and migration initiatives supporting a next-generation application platform. This role will be responsible for building a scalable data foundation while transitioning large-scale legacy systems to a modern AWS cloud architecture. The ideal candidate brings deep expertise in PostgreSQL, Oracle-to-PostgreSQL migrations, AWS, data modeling, and real-time data processing . Key Responsibilities:
- Design and build PostgreSQL databases, schemas, and data models from the ground up , with a focus on performance, scalability, and maintainability.
- Lead large-scale Oracle-to-PostgreSQL migrations , moving databases from on-premises environments to AWS RDS PostgreSQL while maintaining data integrity and minimizing downtime.
- Analyze existing database schemas and recommend structural, performance, and scalability improvements.
- Build and optimize real-time data pipelines and products using Apache Kafka, Apache Flink, and Apache Hudi or similar lakehouse technologies.
- Design and implement Change Data Capture (CDC) and auditing solutions to track data changes, lineage, and historical activity.
- Develop normalized and denormalized data models supporting both OLTP and analytical workloads .
- Establish data validation and quality controls throughout migration and modernization efforts.
- Develop and maintain data catalogs, schema documentation, and architectural documentation for application and engineering teams.
- Partner with application developers, architects, infrastructure teams, and business stakeholders throughout modernization initiatives.
- Ensure appropriate data security, access controls, encryption, and compliance practices.
- Strong hands-on expertise with PostgreSQL , including database architecture, schema design, SQL, administration, performance tuning, and optimization.
- Demonstrated experience performing large enterprise database migrations ; Oracle-to-PostgreSQL experience is strongly preferred.
- Hands-on AWS experience, particularly RDS, EC2, networking, and security .
- Experience with Apache Kafka and Apache Flink for streaming and real-time data processing.
- Experience with Apache Hudi, Delta Lake, or comparable lakehouse technology .
- Strong understanding of relational database design and normalized/denormalized data modeling .
- Experience implementing CDC, audit logging, data lineage, and change-tracking solutions .
- Ability to evaluate legacy database structures and design improved schemas for modern applications.
- Strong technical documentation and stakeholder communication skills.
- AWS data services such as Glue, Lambda, and Step Functions .
- Data quality and validation frameworks.
- Terraform or CloudFormation .
- Application modernization or legacy platform replacement experience.
- Knowledge of data security, encryption, and regulatory requirements such as GDPR or HIPAA .
For applications and inquiries, contact:View email address on us.fitly.work
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in New York, NY vacancy
$135k - $180k
...million patients, Medidata offers industry-leading expertise, analytics-powered insights, and one of the largest clinical trial data sets in the industry. More than 1 million... ...including product, delivery, data science, engineering, partnerships, and biostatistics....SuggestedOngoing contractWork at officeLocal areaFlexible hoursDassault Systèmes
New York, NY19 days ago$250.8k - $286.2k
Senior Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers,...SuggestedFull timePart timeInternshipLocal area- Lead Data Engineer The Lead Data Engineer owns the NBA platform's data foundation on the Databricks Lakehouse. This role is responsible for the architecture, delivery, quality, governance, and operational reliability of the data products that power decision intelligence...SuggestedFor contractors
- ...Logicbroker, Inc. Logicbroker is the Agentic Commerce Orchestration Engine helping enterprise retailers, brands, suppliers, and... ...customers, and run smarter operations. Job Summary We are hiring a Lead Data Engineer to drive delivery across our analytics and data...SuggestedFor contractorsWork at officeRemote work
$170k - $220k
...platform. About the Role We are looking for a leader of the Coast data engineering team to shape our company's data culture and underlying... ...of our modern, cloud-native data platform. This is a chance to lead a small, high-leverage team and make a definitive impact, building...SuggestedWork at officeLocal areaRelocation packageFlexible hours- Lead Data Engineer This is a remote role that may only be hired in the following location(s): North Carolina, Arizona, Texas and Florida. We are seeking an experienced Lead Data Engineer to join our Data Platform Engineering Organization and lead the design, development...Remote work
- Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design, development,...Long term contractWork at office
- Lead Data Engineer Position: Lead Data Engineer Primary Skill: Databricks, PySpark, Data Factory, Azure Data Lake Storage, SQL, XML/JSON, SparkSQL, Azure Synapse/Azure SQL Data Warehouse Secondary Skill: COSMOS DB, Power BI Location: Maimi FL / 100% Remote Industry: Insurance...For contractorsRemote work
- Lead Data Engineer This is a remote role that may only be hired in the following location(s): North Carolina, Arizona & Texas. We are seeking a Lead Data Engineer with deep, hands-on experience designing, building, and operating production-grade data platforms. This role...Remote work
- Senior/Lead Data Engineer Remote - CST 50/hr on W2 Position Summary Seeking a hands-on Senior/Lead Data Engineer with 8+ years of experience to design, build, and support scalable cloud data solutions for healthcare reporting, analytics, and operational use cases. The...Remote work
$135k - $150k
New York, United States | Posted on 08/30/2023 The position of Lead Data Engineer is open in New YorkCity, New York, within the Insurance industry. The role offers flexiblework-from-home days while requiring occasional on-site presence for clientmeetings. The Lead Data...- Job Title:Lead Data Engineer - Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10-15 years...Contract work
- ## Lead Data EngineerApply: New York - 225 Liberty Street: Full time: Posted Today: R-5842**Venture outside the ordinary - TMX Careers... ...Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the...Full time
- Job Description Must Have: DBT Core, Snowflake and Python, AWS Airflow, Container services(Docker), Terraform Good to Have: BI tooling experience(Power BI or Tableau), understanding of Agile processes(Kanban or Jira) We need strong person as this position. Echo IT Solutions...
- ...position sits within the newly consolidated Data and Analytics (D&A) organization... ...data infrastructure, data governance, data engineering, data modeling, data analysis to business... ...intelligence, data science, and AI. The Lead Data Engineer is crucial to D&A USB’s Eligibility...Temporary workWork at officeLocal area3 days per week
$209k - $238.5k
...disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Senior Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a...InternshipLocal area- Job Title: Lead Data Engineer Location: Dallas, TX Client: Prodapt/ AT&T Project Duration: 12 months Job Type: Contract Work Arrangement: Onsite role - 5 days a week Interview: In person Job Summary We are seeking a highly skilled Technical Lead - ETL & Python...Contract work
- Lead Data Privacy Engineer We're building a world of health around every individual — shaping a more connected, convenient and compassionate health experience. At CVS Health®, you'll be surrounded by passionate colleagues who care deeply, innovate with purpose, hold ourselves...Full timeWork experience placementLocal area
- Lead Market Data Engineer - Systematic Data Join to apply for the Lead Market Data Engineer - Systematic Data role at Balyasny Asset Management L.P. The Lead Market Data Engineer will architect, build, and optimize the platforms that deliver high‑quality market data to...Full time
- Senior / Lead Data Engineer We are seeking a hands-on Senior / Lead Data Engineer to provide technical leadership for the platforms, pipelines, and data products that power analytics, applications, and investment decision-making across the firm. You will architect scalable...
$110k - $130k
...ETL Roles & Responsibilities The Snowflake Lead will serve as the onsite technical lead for CLEARBROOK s enterprise data platform, responsible for end to end Snowflake... ...hands on expertise in Snowflake, strong data engineering fundamentals, and the ability to integrate AI...$111.8k
Overview Lead Data Engineer | Build the Future of Data at GATX Remote (Chicago-area preferred) Founded in 1898 and headquartered in Chicago, IL, GATX Corporation (NYSE: GATX) is an industry leader with 125+ years of success - success that is powered by our people. We...Temporary workWork at officeRemote work$149.3k - $200.2k
...audiences experience sports, entertainment & news. The Product & Data Engineering team is responsible for end to end development for Disney’s... ...personalization, search, messaging and data. Job Summary As a Lead Data Engineer in the Data Platforms team, you will be partnering...Work experience placementWorldwide- We are seeking a highly motivated Engineering Consultant with experience in the Pharmaceutical or Life Sciences domain to work on data and analytics-driven initiatives. This role requires a blend of engineering expertise, domain understanding, and consulting capabilities...
- A technology solutions firm is looking for a Lead Data Engineer to work remotely on building end-to-end data solutions. The ideal candidate will design and maintain scalable data pipelines and collaborate with AI/ML teams. The position requires strong skills in Databricks...Remote job
- Lead Data Engineer This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Lead Data Engineer based in the United States. This role offers the opportunity to lead the design and evolution of modern...Full timeRemote work
- Data Engineering-Big Data Engineering As a technical lead, you will guide engineering teams, establish best practices, and ensure successful delivery across multiple workstreams while enabling data-driven decision-making across the enterprise. Responsibilities Data Engineering...
$148.14k - $214.76k
...retirement package to secure your future. Responsibilities Lead data design, prototype, and development of data pipeline architecture... .... Be a senior Individual contributor of the Data or Software Engineering teams. Be part of Technical Review Board along with Manager and...Remote jobFull timeFlexible hoursWeekend work$70 - $85 per hour
Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...Contract workLocal areaRemote workFlexible hours- Lead AWS Data Engineer Contract-to-hire 100% Remote Profile Summary: Lead Data and Analytics Engineer will be a senior member of data and analytics engineering chapter. This is a hands-on technology engineering leadership role focused on building AWS data & analytics engineering...Contract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches
- data capturer New York, NY
- data loss prevention analyst New York, NY
- data technician New York, NY
- data recovery New York, NY
- clinical data coordinator remote New York, NY
- health data New York, NY
- data analysis part time New York, NY
- data network cabling New York, NY
- data modeling New York, NY
- ai data New York, NY