Lead Data Engineer

Openkyber

Hi Associate, Greetings for the day, We have a position as a Senior Data Engineer - PySpark & Python role in Charlotte, NC. Please find the job description below for this position. Role: Senior Data Engineer - PySpark & Python

Location: Charlotte, NC

Duration: 24 Months

Key Responsibilities:

Design, develop, and optimise large-scale data pipelines using PySpark and Python.
Implement and adhere to best practices in object-oriented programming to build reusable, maintainable code.
Write advanced SQL queries for data extraction, transformation, and loading (ETL).
Collaborate closely with data scientists, analysts, and stakeholders to gather requirements and translate them into technical solutions.
Troubleshoot data-related issues and resolve them in a timely and accurate manner.
Leverage AWS cloud services (e.g., S3, EMR, Lambda, Glue) to build and manage cloud-native data workflows (preferred).
Participate in code reviews, data quality checks, and performance tuning of data jobs.

Required Skills & Qualifications:

Relevant experience in a data engineering or backend development role.
Experience working with AWS cloud ecosystem (S3, Glue, EMR, Redshift, Lambda, etc.).
Kafka
Strong hands-on experience with PySpark and Python, especially in designing and implementing scalable data transformations.
Solid understanding of Object-Oriented Programming (OOP) principles and design patterns.
Proficient in SQL, with the ability to write complex queries and optimise performance.
Strong problem-solving skills and the ability to troubleshoot complex data issues independently.
Excellent communication and collaboration skills.
Hands-on experience with AI Tools.

Thanks & Regards OpenKyber |Sr. Team Manager OpenKyber Inc McKinney, TX, 75069 Direct: X 1522 (Ext)

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Lead Data Engineer in Vermont vacancy

Data Engineer
$145.68k - $150k
Data Engineer (Remote) Green Mountain Power Corporation seeks a Data Engineer to collect, clean, and analyze large, complex datasets from multiple sources, including APIs, data streams, and databases, to generate actionable insights. Build, validate, and deploy machine...
Suggested
Remote work
Green Mountain Power
Colchester, VT
4 days ago
Data Engineer
$64.89k - $173.04k
...community at a time. Position Summary We are hiring a fully remote Data Engineer with strong SQL and Python experience to join our Data... ...register Kafka topics, update schemas, and ingest data, reducing lead times from weeks to minutes. Automated Monitoring & Incident Management...
Suggested
Hourly pay
Full time
Temporary work
Work experience placement
Local area
Remote work
CVS Health
Vermont
1 day ago
Data Engineer
...Join our growing data team at Green River as a Data Engineer. This role will support projects that matter by designing, building, and maintaining robust data infrastructure and workflows to support critical business operations and data-driven decision-making. Your work...
Suggested
Permanent employment
VALID8 Financial
Vermont
23 hours ago
Data Engineer
$64.89k - $173.04k
...of something bigger - helping to simplify health care one person, one family and one community at a time. Position Summary The Data Engineer will be responsible for delivering high quality modern data solutions through collaboration with our engineering, analysts, data...
Suggested
Hourly pay
Full time
Temporary work
Local area
Hispanic Alliance for Career Enhancement
Montpelier, VT
1 day ago
Sr Data Engineer
$130k
...A Day in the Life The Senior Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and workflows that support analytics, business intelligence, machine learning, and software products. This role partners closely with Data Scientists...
Suggested
Worldwide
The Hertz Corporation
East Montpelier, VT
3 days ago
Sr. Data Analytics Engineer
$165.56k - $188.09k
...Sr. Data Analytics Engineer Sr. Data Analytics Engineer Values & Innovation At Under Armour, we are committed to empowering those who... ...visualization and reporting requirements. Leverage industry-leading integration and analytics tools to build a modern data...
Local area
Remote work
Relocation
Under Armour
East Montpelier, VT
5 days ago
Data Analytics Engineer
$80k - $110k
...and team support. We are committed to delivering industry-leading experiences for our customers across commercial and industrial... ...service maintenance and repair. Job Summary As a Data Analytics Engineer at John W. Danforth Company, you will play a critical role...
Full time
For contractors
Flexible hours
EMCOR Group
Williston, VT
5 days ago
Data Engineer - Senior Manager
$124k - $280k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions... ...of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not...
H1b
PwC
East Montpelier, VT
2 days ago
Principal Sales Engineer - Data Modernization
$114.5k - $154.58k
...: We're looking for a Principal Sales Engineer who is not only passionate about technology... ...can successfully be the technical sales lead on software opportunities to progress and... ...prospective clients to understand their data integration challenges, especially around...
Full time
Remote work
Worldwide
Rocket Software
East Montpelier, VT
3 days ago
LEAD INFORMATION SECURITY ENGINEER (ISSO with PQC)
$105.79k - $141.05k
...trusted network for the AI-powered world, connecting people, data, and applications through our expansive fiber network and... ...based anywhere in the U.S. The Role At Lumen, the Lead Information Security Engineer owns the development, maintenance, and defensibility of...
Temporary work
Remote work
Lumen Inc
East Montpelier, VT
23 hours ago
Data Engineering Manager
Join to apply for the Data Engineering Manager role at Cedar Gate Technologies 5 days ago Be among the first 25 applicants Join to apply for... ...values and rewards innovative ideas, particularly those that lead to better outcomes for all. Join our rapidly expanding company...
Full time
Work at office
Local area
Remote work
Work visa
Flexible hours
Cedar Gate Technologies
Burlington, VT
4 days ago
Staff Data Scientist
$160k - $246k
...complex business questions and high-value data into trustworthy, production-grade... ...framing and analytical discovery to feature engineering, model development, production deployment... ...value, maintainability, and adoption. Lead the data-science workstream from concept...
Full time
Local area
Remote work
Work from home
Relocation
Relocation package
Flexible hours
General Motors
East Montpelier, VT
3 days ago
Machine Learning Engineer
$62k - $100k
...career where you can help shape the future of our industry. Job Description: Job Description About the Role As an AI Engineering team member, you will be instrumental in advancing new features and/or solutions from the Proof of Concept stage to full...
Local area
Worldwide
Crowe
Burlington, VT
23 hours ago
ENTRY LEVEL MACHINE LEARNING ENGINEER
...Entry Level Machine Learning Engineer SynergisticIT understands the complex nature of the job market and how difficult it can be to secure a position, especially for fresh graduates. Therefore, we assist and help tech-savvies to convert their passions into professions...
H1b
SynergisticIT
Montpelier, VT
3 days ago
Principal AI/ML Engineer
$296.3k - $423.9k
...We are looking for a Principal Technical Lead Manager (TLM) to lead the Trajectory Generation... ...You will lead a high-performing team of engineers building ML-driven trajectory generation... ...closely with teamsworking on: data, perception,simulation, safety validation...
Full time
Local area
Remote work
Work from home
Relocation
Relocation package
Flexible hours
General Motors
East Montpelier, VT
3 days ago
Senior Clinical Informaticist
$86.4k
...: Highmark Health Job Description : JOB SUMMARY This job promotes the understanding, integration, and use of healthcare data and information technology in support of scholarly research and addressing healthcare business challenges. Leveraging experience in...
For contractors
Work at office
Local area
Highmark Health
East Montpelier, VT
5 days ago
Data Engineer
$93.4k - $176.2k
...Pipeline Architect : Design, build, and maintain scalable end-to-end data pipelines using Databricks, Spark, and related technologies.... ...clients Experience with COTS and open-source data engineering tools such as ElasticSearch and NiFi Experience with Docker...
Full time
Live in
Work at office
Local area
Accenture Federal Services
Vermont
4 days ago
Senior Machine Learning Test Engineer
...Job Requisition ID # 26WD98377 Senior Machine Learning Test Engineer Location: United States East Coast Position Overview As... ...passionate about reliable, repeatable evaluation of ML models and data. Your skills span test strategy, automation, and a little MLOps,...
For contractors
Work at office
Remote work
Autodesk
East Montpelier, VT
4 days ago
Machine Learning Engineer (PhD Intern)
...and fulfillment. We use machine learning and Internet-scale data to elevate customer experience, improve efficiency, and reduce... ...and Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of search...
Remote job
Permanent employment
Work experience placement
Internship
Work at office
Work from home
Flexible hours
Instacart
Montpelier, VT
3 days ago
Machine Learning Operations Engineer
$60.67 - $95.52 per hour
...173 Job Description: Machine Learning Operations Engineers enable development end-to-end data science applications that apply predictive, prescriptive... ...both internal and external customers. Using industry leading data science and artificial intelligence (AI)...
Hourly pay
Full time
Work at office
Remote work
Flexible hours
Intermountain Health
East Montpelier, VT
3 days ago
Sr. Software Engineer (Data and Personalization)
$125k - $155k
...organization is on a multi-year journey to transform how we use Data and AI more strategically. Customer Data is at the heart of our... ...to drive personalized experiences responsibly. As a Software Engineer (Data and Personalization), you will develop and optimize data-driven...
Local area
Consumer Reports
Vermont
more than 2 months ago
NGA AI Engineer Manager
$73.5k - $212.28k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions... ...to the success of our Firm. You are expected to lead with integrity and authenticity, articulating our purpose...
H1b
PwC
East Montpelier, VT
2 days ago
Senior Life Sciences Knowledge Engineer
...Senior Life Sciences Knowledge Engineer Company: Norstella Location: Remote, United... ...Why Norstella? Norstella unites market-leading companies that all have a shared goal of... ...wider breadth of expertise, cutting-edge data solutions and expert advisory services alongside...
Full time
Temporary work
Work at office
Local area
Remote work
Flexible hours
Shift work
Norstella
East Montpelier, VT
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!