Lead Data Engineer
Yantran LLC
Job Description
Job Description
Job title : Senior Data Engineer
Location : Juno Beach , FL (Day one onsite)
Experience : 8 to 10
Year
Position Specific Description
The Senior Data Engineer Forecasting Platforms
Operations will support the development, integration, operational reliability, and continued modernization of data pipelines and applications within the AURA energy forecasting ecosystem.
This role combines strong data engineering capabilities with hands-on production application support. The position will focus primarily on building and maintaining scalable ETL/ELT pipelines, data integrations, databases, APIs, and automated data workflows supporting load, wind, and solar forecasting, while also providing secondary operational support for the cloud-based platforms and services responsible for producing and delivering forecasts to business customers.
The ideal candidate has a strong data engineering foundation but is also comfortable troubleshooting production applications, following data and application dependencies across systems, supporting cloud-hosted services, and responding to operational issues when necessary.
The position is intended to strengthen both the data engineering capacity and operational resiliency of the AURA forecasting team by developing broader technical ownership across the environment.
Key Responsibilities
Data Engineering
Integration
Design, develop, maintain, and optimize ETL/ELT pipelines supporting forecasting, telemetry, weather, market, asset, and operational data.
Develop and maintain automated data ingestion and transformation processes across APIs, databases, flat files, SFTP, cloud storage, and external data providers.
Build scalable and reusable Python and SQL-based data processing frameworks.
Support PostgreSQL and other relational database environments used by forecasting applications and analytical workflows.
Improve data pipeline monitoring, logging, restart ability, validation, and failure recovery.
Implement data-quality checks, reconciliation processes, and source-to-target validation.
Support onboarding and integration of new wind, solar, storage, and other generation assets into forecasting data pipelines.
Partner with Data Scientists to ensure reliable, timely, and well-structured data is available for model development, training, production forecasting, and performance analysis.
Support modernization and standardization of legacy data workflows and reduce manual or hard-coded processing wherever practical.
Forecasting Platform
Operational Support
Provide secondary technical support for production load, wind, and solar forecasting applications and associated data-delivery processes.
Troubleshoot production issues across application, data, database, cloud infrastructure, integration, and delivery layers.
Support AWS-hosted forecasting workloads and services such as S3, Lambda, ECS, EC2, CloudWatch, and related cloud resources.
Assist with application deployments, release validation, configuration changes, operational readiness, and post-deployment monitoring.
Support scheduled jobs, automated forecast processes, reporting services, and customer-facing forecast delivery workflows.
Assist with SFTP services, secure file transfers, SSH keys, directory configurations, and customer data-exchange processes.
Participate in incident response, root-cause analysis, change management, service-ticket resolution, and production support.
Maintain sufficient cross-functional knowledge to provide backup coverage for key forecasting platform responsibilities when the primary platform resource is unavailable.
Reliability, Automation
Documentation
Identify recurring manual processes and develop automation to improve reliability and reduce operational effort.
Establish effective monitoring and alerting for pipelines, scheduled processes, data feeds, and production forecasting applications.
Document system dependencies, troubleshooting procedures, support processes, recovery steps, and operational handoffs.
Participate in cross-training and knowledge-sharing activities to ensure critical systems have appropriate primary and backup technical coverage.
Support continuous improvement of the team's operational support model and technical resiliency.
Required Technical Experience
Strong experience designing, developing, and supporting enterprise ETL/ELT or data-integration pipelines.
Advanced SQL skills and experience with relational databases such as PostgreSQL, Oracle, SQL Server, or similar platforms.
Proficiency with Python for data processing, automation, integration, or application-support activities.
Experience integrating data from APIs, databases, flat files, cloud storage, SFTP, or other enterprise data sources.
Experience supporting production data pipelines, scheduled jobs, and troubleshooting failed processing workflows.
Experience working with AWS or comparable cloud environments.
Strong understanding of logging, monitoring, troubleshooting, root-cause analysis, and production-support practices.
Experience with Git-based source control and modern software-development practices.
Preferred Qualifications
Experience with AWS services including S3, Lambda, ECS, EC2, CloudWatch, Step Functions, or related services.
Experience with PostgreSQL/Aurora, Redshift, Databricks, Spark/PySpark, or similar data platforms.
Experience supporting CI/CD pipelines, application deployments, or cloud-hosted production applications.
Experience with SFTP administration, secure data exchange, SSH key management, or automated file-transfer processes.
Experience building data-quality, monitoring, reconciliation, and automated alerting frameworks.
Familiarity with energy markets, utility operations, renewable generation, SCADA/telemetry data, weather data, or load/wind/solar forecasting.
Experience supporting machine-learning or forecasting data pipelines is strongly preferred.
Experience working in Agile environments using tools such as Jira and Confluence.
Candidate Profile
The successful candidate should be a hands-on engineer who naturally follows problems across system boundaries rather than limiting troubleshooting to a single application or technology.
The strongest candidate will be able to move comfortably between:
source data pipeline database forecasting application cloud service delivery customer
and determine where a failure has occurred, how it should be corrected, and how recurrence can be prevented.
This role requires someone who can operate independently, document clearly, learn unfamiliar systems quickly, and balance planned engineering work with occasional production-support priorities.
The pay range for this role is ***k - ***k per annum including any bonuses or variable pay. *** also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.
*** is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities.
Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ***.
- ...Position Summary The Lead Data Engineer is responsible for defining, implementing, and maintaining the organization’s data architecture, platforms, data management practices, and reporting capabilities. This role serves as the technical owner of the organization’s data...Suggested
- ...Job Description Job Description Job Title : AWS Data Engineer with Dynamo DB Must Location: Juno Beach Florida (Day One onsite) Experinece : 10 Year Job Description Hands-on data engineering experience with proven track record of building production data...Suggested
- ...Overview We are seeking experienced Data Engineers to join a growing team supporting enterprise data initiatives for a leading energy company in Juno Beach, FL. This role will focus on designing, developing, and maintaining scalable data solutions that support critical...Suggested
- ...Senior Data Engineer Location: Juno Beach, Florida (Remote) Role Summary We are seeking a Senior Data Engineer to design and build the cloud data foundation supporting our key platforms. This role will develop the pipelines, storage architecture, data models,...SuggestedRemote work
- RESPONSIBILITIES: Kforce has a client that is seeking a Senior FME Data Integration Engineer in Juno Beach, FL. Summary: We are seeking an experienced Senior FME Data Integration Engineer to support enterprise data integration, transformation, and schema standardization...SuggestedHourly payContract work
- ...Job Description Job Description Join NextBrain as a Senior Data Engineer in Remote, FL Are you passionate about data engineering and eager to make a significant impact at a leading-edge company? NextBrain Off-Prem is looking for a talented Senior Data Engineer to...Remote work
- ...Job Description: NextEra Energy is seeking a Senior Data Scientist to develop, improve, and support forecasting solutions... ...forecasting and combines machine learning, weather analytics, data engineering, and production support. The candidate will build models, evaluate...Contract workShift work
- ...Job Description: The Senior Data Scientist - Geospatial serves as a technical leader responsible for designing and delivering advanced... ...and modeling solutions using geospatial data. This role leads complex spatial analytics efforts, mentors less-experienced data...
- ...Overview Data Scientist role at Apex Systems. Responsibilities Building tools and establishing infrastructure for an Excel, SQL database... ...Power BI Data Flows. (preferred) Experience in Utility, Engineering or Construction industries. Strong data base knowledge understanding...
- ...supports energy market analysis, forecasting, optimization, scenario evaluation, and data-driven operational decision-making. Position Summary The Data Science Platform & DevOps Engineer will engineer and operationalize the Python-based PSO analytics platform. The...
- ...operational forecasting use case.\n\t• Experience working with weather data and/or Numerical Weather Prediction (NWP) forecasts.\n\t•... ..., or similar libraries.\n\t• Strong knowledge of feature engineering, regression, ensemble modeling, backtesting, and forecast validation...
- ...Job Description Job Description Position- AWS Data Engineer with IAM Admin Location- Juno Beach, FL (Day1 Onsite) Position Summary The AWS Cloud Identity Engineer will design and implement the cloud and identity foundation for the PSO platform. The role...
- ...Energy Marketing is one of the nation’s leading electricity and natural gas marketers, and... ...influence Systems Integration & Data Analytics: Champion trading system transformation... ...Finance, Operations Research, Financial Engineering, Applied Mathematics, Economics, or...Full timeFor contractorsLocal areaRelocationShift work
- ...Job Description Job Description Job Title: Senior Data Scientist – Load & Renewable Generation Forecasting Location: Juno Beach... ..., renewable-energy analytics, machine learning, data engineering, and production support. The successful candidate will independently...Seasonal work
- ...Energy Marketing is one of the nation’s leading electricity and natural gas marketers, and... ...influence Systems Integration & Data Analytics: Champion trading system transformation... ...Finance, Operations Research, Financial Engineering, Applied Mathematics, Economics, or...Full timeFor contractorsLocal areaRelocationShift work
- ...Requisition ID: 94157 NextEra Energy Marketing is one of the nation’s leading electricity and natural gas marketers, and a key player in the... ...commodity estimates to create forecasts based on historical data analysis, multiple regression, number theory, logic, Monte Carlo...Full timeFor contractorsLocal areaRelocation
- ...Position Overview We are seeking a Data Scientist to leverage data, statistical analysis, and machine learning techniques to identify... ...models and analytical solutions. Collaborate with engineering, product, and business teams to understand requirements and deliver...
- ...using Docker, including Dockerfile optimization. Strong Python skills with experience in Poetry for dependency management, Pandas for data manipulation, and SQLAlchemy for ORM and database interaction. Skilled in building REST APIs with FastAPI and integrating FastAPI...Local area
- ...Job Description Job Description Data Science Platform DevOps Engineer Juno Beach, FL Onsite Project Overview The Power Systems Optimizer (PSO) platform supports energy market analysis, forecasting, optimization, scenario evaluation, and data-driven operational...
- ...Learn more at . OVERVIEW The Principal IT Security Engineer reports to the Sr. Manager of Information Security and serves as the technical lead for securing the company's enterprise IT environment across data centers, cloud platforms, corporate networks, endpoints,...Work experience placementLocal areaRemote work
- ...About the Role: As an Electrical Engineer specializing in the construction industry, you will play a critical role in designing, developing, and overseeing electrical systems that ensure safe, reliable, and efficient power distribution and generation. Your expertise...
- Job Description Job Description EEO: Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.
- ...Job Description Job Description POSITION: Senior Data Context Engineer LOCATION: Jupiter, FL. STATUS: Salary Exempt Position... ...data-driven decision-making. The Data Context Engineer Lead will collaborate with business stakeholders, application owners...
- ...Job Description Job Description Job Title: Senior Data Engineer Location: REMOTE Duration: 12 Months Role Summary We are seeking a Senior Data Engineer to design and build the cloud data foundation supporting NextBrain Off-Prem. NextBrain depends on large...Remote work
- ...personalized insights to empower individuals and organizations to make data-driven decisions, promoting longer, healthier lives. VOLO Health... ..., as an award-winning quantitative hedge fund. As an AI Engineer, you'll work at the intersection of engineering and real-world...Work at office
- ...Job Description Job Description Job Title: Data Science Location : Palm Beach , FL (Day One Onsite to Client Location) Experence... ...and trends " Build reusable data pipelines and feature engineering workflows " Work with SQL and/or cloud-based data warehouses...
- OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth... .../ ProvinceFloridaCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - US: 154522BRFull timeTemporary workRelocation
- ...% 5 days a week on-site . The hiring lead clarified that: • They prefer local candidates... ...Takeaway This is a senior, hands-on data/software role centered on database... ...Seeking a Senior Data Analyst / Data Engineer to design, develop, and maintain enterprise...Contract workLocal area
- ...Job Description Job Description Senior Data Engineer Forecasting Platforms & Operations Position Specific Description The Senior Data Engineer Forecasting Platforms & Operations will support the development, integration, operational reliability, and continued...Daily paidWork at officeShift work
- ...THE ROLE We are looking for an MLOps Engineer to deploy, scale, and monitor computer... ...professional experience in MLOps, DevOps, Data Engineering, Machine Learning, or... ...DO - Resource & Cost Optimization: Lead GPU compute efficiency and infrastructure...Work at officeRemote workRelocationVisa sponsorshipWork visaFlexible hours3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data analysis part time Juno Beach, FL
- data modeling Juno Beach, FL
- data Juno Beach, FL
- provider data management Juno Beach, FL
- data tech Juno Beach, FL
- clinical data coordinator remote Juno Beach, FL
- data network cabling Juno Beach, FL
- ai data Juno Beach, FL
- data loss prevention analyst Juno Beach, FL
- sap master data Juno Beach, FL





