Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer

Yantran LLC

Job Description

Job Description

Job title : Senior Data Engineer
Location : Juno Beach , FL (Day one onsite)
Experience : 8 to 10
Year
Position Specific Description
The Senior Data Engineer Forecasting Platforms
Operations will support the development, integration, operational reliability, and continued modernization of data pipelines and applications within the AURA energy forecasting ecosystem.
This role combines strong data engineering capabilities with hands-on production application support. The position will focus primarily on building and maintaining scalable ETL/ELT pipelines, data integrations, databases, APIs, and automated data workflows supporting load, wind, and solar forecasting, while also providing secondary operational support for the cloud-based platforms and services responsible for producing and delivering forecasts to business customers.
The ideal candidate has a strong data engineering foundation but is also comfortable troubleshooting production applications, following data and application dependencies across systems, supporting cloud-hosted services, and responding to operational issues when necessary.
The position is intended to strengthen both the data engineering capacity and operational resiliency of the AURA forecasting team by developing broader technical ownership across the environment.
Key Responsibilities
Data Engineering
Integration
Design, develop, maintain, and optimize ETL/ELT pipelines supporting forecasting, telemetry, weather, market, asset, and operational data.
Develop and maintain automated data ingestion and transformation processes across APIs, databases, flat files, SFTP, cloud storage, and external data providers.
Build scalable and reusable Python and SQL-based data processing frameworks.
Support PostgreSQL and other relational database environments used by forecasting applications and analytical workflows.
Improve data pipeline monitoring, logging, restart ability, validation, and failure recovery.
Implement data-quality checks, reconciliation processes, and source-to-target validation.
Support onboarding and integration of new wind, solar, storage, and other generation assets into forecasting data pipelines.
Partner with Data Scientists to ensure reliable, timely, and well-structured data is available for model development, training, production forecasting, and performance analysis.
Support modernization and standardization of legacy data workflows and reduce manual or hard-coded processing wherever practical.
Forecasting Platform
Operational Support
Provide secondary technical support for production load, wind, and solar forecasting applications and associated data-delivery processes.
Troubleshoot production issues across application, data, database, cloud infrastructure, integration, and delivery layers.
Support AWS-hosted forecasting workloads and services such as S3, Lambda, ECS, EC2, CloudWatch, and related cloud resources.
Assist with application deployments, release validation, configuration changes, operational readiness, and post-deployment monitoring.
Support scheduled jobs, automated forecast processes, reporting services, and customer-facing forecast delivery workflows.
Assist with SFTP services, secure file transfers, SSH keys, directory configurations, and customer data-exchange processes.
Participate in incident response, root-cause analysis, change management, service-ticket resolution, and production support.
Maintain sufficient cross-functional knowledge to provide backup coverage for key forecasting platform responsibilities when the primary platform resource is unavailable.
Reliability, Automation
Documentation
Identify recurring manual processes and develop automation to improve reliability and reduce operational effort.
Establish effective monitoring and alerting for pipelines, scheduled processes, data feeds, and production forecasting applications.
Document system dependencies, troubleshooting procedures, support processes, recovery steps, and operational handoffs.
Participate in cross-training and knowledge-sharing activities to ensure critical systems have appropriate primary and backup technical coverage.
Support continuous improvement of the team's operational support model and technical resiliency.
Required Technical Experience
Strong experience designing, developing, and supporting enterprise ETL/ELT or data-integration pipelines.
Advanced SQL skills and experience with relational databases such as PostgreSQL, Oracle, SQL Server, or similar platforms.
Proficiency with Python for data processing, automation, integration, or application-support activities.
Experience integrating data from APIs, databases, flat files, cloud storage, SFTP, or other enterprise data sources.
Experience supporting production data pipelines, scheduled jobs, and troubleshooting failed processing workflows.
Experience working with AWS or comparable cloud environments.
Strong understanding of logging, monitoring, troubleshooting, root-cause analysis, and production-support practices.
Experience with Git-based source control and modern software-development practices.
Preferred Qualifications
Experience with AWS services including S3, Lambda, ECS, EC2, CloudWatch, Step Functions, or related services.
Experience with PostgreSQL/Aurora, Redshift, Databricks, Spark/PySpark, or similar data platforms.
Experience supporting CI/CD pipelines, application deployments, or cloud-hosted production applications.
Experience with SFTP administration, secure data exchange, SSH key management, or automated file-transfer processes.
Experience building data-quality, monitoring, reconciliation, and automated alerting frameworks.
Familiarity with energy markets, utility operations, renewable generation, SCADA/telemetry data, weather data, or load/wind/solar forecasting.
Experience supporting machine-learning or forecasting data pipelines is strongly preferred.
Experience working in Agile environments using tools such as Jira and Confluence.
Candidate Profile
The successful candidate should be a hands-on engineer who naturally follows problems across system boundaries rather than limiting troubleshooting to a single application or technology.
The strongest candidate will be able to move comfortably between:
source data pipeline database forecasting application cloud service delivery customer
and determine where a failure has occurred, how it should be corrected, and how recurrence can be prevented.
This role requires someone who can operate independently, document clearly, learn unfamiliar systems quickly, and balance planned engineering work with occasional production-support priorities.
The pay range for this role is ***k - ***k per annum including any bonuses or variable pay. *** also offers benefits like medical, vision, dental, life, disability insurance and paid time off (including holidays, parental leave, and sick leave, as required by law). Ask our recruiters for more details on our Benefits package. The exact offer terms will depend on the skill level, educational qualifications, experience, and location of the candidate.
*** is an Equal Employment Opportunity employer. We promote and support a diverse workforce at all levels of the company. All qualified applicants will receive consideration for employment without regard to race, religion, color, sex, age, national origin or disability. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions with or without reasonable accommodations. Reasonable accommodations also are available in the hiring process for applicants with disabilities.
Candidates can request a reasonable accommodation by contacting the company ADA Coordinator at ***.

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Juno Beach, FL vacancy
  •  ...Position Summary The Lead Data Engineer is responsible for defining, implementing, and maintaining the organization’s data architecture, platforms, data management practices, and reporting capabilities. This role serves as the technical owner of the organization’s data... 
    Suggested

    MTech

    Jupiter, FL
    11 days ago
  •  ...Job Description Job Description Job Title : AWS Data Engineer with Dynamo DB Must Location: Juno Beach Florida (Day One onsite) Experinece : 10 Year Job Description Hands-on data engineering experience with proven track record of building production data... 
    Suggested

    Yantran LLC

    Juno Beach, FL
    22 days ago
  •  ...Overview We are seeking experienced Data Engineers to join a growing team supporting enterprise data initiatives for a leading energy company in Juno Beach, FL. This role will focus on designing, developing, and maintaining scalable data solutions that support critical... 
    Suggested

    Insight Global

    Juno Beach, FL
    2 days ago
  •  ...Senior Data Engineer Location: Juno Beach, Florida (Remote) Role Summary We are seeking a Senior Data Engineer to design and build the cloud data foundation supporting our key platforms. This role will develop the pipelines, storage architecture, data models,... 
    Suggested
    Remote work

    Apex Systems

    Juno Beach, FL
    3 days ago
  • RESPONSIBILITIES: Kforce has a client that is seeking a Senior FME Data Integration Engineer in Juno Beach, FL. Summary: We are seeking an experienced Senior FME Data Integration Engineer to support enterprise data integration, transformation, and schema standardization... 
    Suggested
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Juno Beach, FL
    2 days ago
  •  ...Job Description Job Description Join NextBrain as a Senior Data Engineer in Remote, FL Are you passionate about data engineering and eager to make a significant impact at a leading-edge company? NextBrain Off-Prem is looking for a talented Senior Data Engineer to... 
    Remote work

    Abacus Service Corporation

    North Palm Beach, FL
    20 days ago
  •  ...Job Description: NextEra Energy is seeking a Senior Data Scientist to develop, improve, and support forecasting solutions...  ...forecasting and combines machine learning, weather analytics, data engineering, and production support. The candidate will build models, evaluate... 
    Contract work
    Shift work

    US Tech Solutions

    Juno Beach, FL
    20 days ago
  •  ...Job Description: The Senior Data Scientist - Geospatial serves as a technical leader responsible for designing and delivering advanced...  ...and modeling solutions using geospatial data. This role leads complex spatial analytics efforts, mentors less-experienced data... 

    Delan Associates Inc

    Juno Beach, FL
    4 days ago
  •  ...Overview Data Scientist role at Apex Systems. Responsibilities Building tools and establishing infrastructure for an Excel, SQL database...  ...Power BI Data Flows. (preferred) Experience in Utility, Engineering or Construction industries. Strong data base knowledge understanding... 

    Apex Systems

    Juno Beach, FL
    2 days ago
  •  ...supports energy market analysis, forecasting, optimization, scenario evaluation, and data-driven operational decision-making. Position Summary The Data Science Platform & DevOps Engineer will engineer and operationalize the Python-based PSO analytics platform. The... 

    Apex Systems

    Juno Beach, FL
    2 days ago
  •  ...operational forecasting use case.\n\t• Experience working with weather data and/or Numerical Weather Prediction (NWP) forecasts.\n\t•...  ..., or similar libraries.\n\t• Strong knowledge of feature engineering, regression, ensemble modeling, backtesting, and forecast validation... 

    Insight Global

    Juno Beach, FL
    2 days ago
  •  ...Job Description Job Description Position- AWS Data Engineer with IAM Admin Location- Juno Beach, FL (Day1 Onsite) Position Summary The AWS Cloud Identity Engineer will design and implement the cloud and identity foundation for the PSO platform. The role... 

    Yantran LLC

    Juno Beach, FL
    22 days ago
  •  ...Energy Marketing is one of the nation’s leading electricity and natural gas marketers, and...  ...influence Systems Integration & Data Analytics: Champion trading system transformation...  ...Finance, Operations Research, Financial Engineering, Applied Mathematics, Economics, or... 
    Full time
    For contractors
    Local area
    Relocation
    Shift work

    NextEra Energy Resources

    Juno Beach, FL
    4 days ago
  •  ...Job Description Job Description Job Title: Senior Data Scientist – Load & Renewable Generation Forecasting Location: Juno Beach...  ..., renewable-energy analytics, machine learning, data engineering, and production support. The successful candidate will independently... 
    Seasonal work

    Mindlance

    North Palm Beach, FL
    22 days ago
  •  ...Energy Marketing is one of the nation’s leading electricity and natural gas marketers, and...  ...influence Systems Integration & Data Analytics: Champion trading system transformation...  ...Finance, Operations Research, Financial Engineering, Applied Mathematics, Economics, or... 
    Full time
    For contractors
    Local area
    Relocation
    Shift work

    NextEra Energy , Inc.

    Juno Beach, FL
    3 days ago
  •  ...Requisition ID: 94157 NextEra Energy Marketing is one of the nation’s leading electricity and natural gas marketers, and a key player in the...  ...commodity estimates to create forecasts based on historical data analysis, multiple regression, number theory, logic, Monte Carlo... 
    Full time
    For contractors
    Local area
    Relocation

    Florida Power & Light

    Juno Beach, FL
    1 day ago
  •  ...Position Overview We are seeking a Data Scientist to leverage data, statistical analysis, and machine learning techniques to identify...  ...models and analytical solutions. Collaborate with engineering, product, and business teams to understand requirements and deliver... 

    Leeds Professional Resources

    Palm Beach Gardens, FL
    12 days ago
  •  ...using Docker, including Dockerfile optimization. Strong Python skills with experience in Poetry for dependency management, Pandas for data manipulation, and SQLAlchemy for ORM and database interaction. Skilled in building REST APIs with FastAPI and integrating FastAPI... 
    Local area

    E-Solutions

    North Palm Beach, FL
    13 hours ago
  •  ...Job Description Job Description Data Science Platform DevOps Engineer Juno Beach, FL Onsite Project Overview The Power Systems Optimizer (PSO) platform supports energy market analysis, forecasting, optimization, scenario evaluation, and data-driven operational... 

    Yantran LLC

    North Palm Beach, FL
    22 days ago
  •  ...Learn more at . OVERVIEW The Principal IT Security Engineer reports to the Sr. Manager of Information Security and serves as the technical lead for securing the company's enterprise IT environment across data centers, cloud platforms, corporate networks, endpoints,... 
    Work experience placement
    Local area
    Remote work

    Florida Crystals

    West Palm Beach, FL
    3 days ago
  •  ...About the Role: As an Electrical Engineer specializing in the construction industry, you will play a critical role in designing, developing, and overseeing electrical systems that ensure safe, reliable, and efficient power distribution and generation. Your expertise... 

    Beowulf Electricity and Data

    West Palm Beach, FL
    4 days ago
  • Job Description Job Description EEO: Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.

    Mindlance

    North Palm Beach, FL
    22 days ago
  •  ...Job Description Job Description POSITION:  Senior Data Context Engineer LOCATION: Jupiter, FL.   STATUS: Salary Exempt     Position...  ...data-driven decision-making.  The Data Context Engineer Lead will collaborate with business stakeholders, application owners... 

    HANWHA POWER US LLC

    Jupiter, FL
    26 days ago
  •  ...Job Description Job Description Job Title: Senior Data Engineer Location: REMOTE Duration: 12 Months Role Summary We are seeking a Senior Data Engineer to design and build the cloud data foundation supporting NextBrain Off-Prem. NextBrain depends on large... 
    Remote work

    Mindlance

    North Palm Beach, FL
    22 days ago
  •  ...personalized insights to empower individuals and organizations to make data-driven decisions, promoting longer, healthier lives. VOLO Health...  ..., as an award-winning quantitative hedge fund. As an AI Engineer, you'll work at the intersection of engineering and real-world... 
    Work at office

    VOLO Health

    Jupiter, FL
    5 days ago
  •  ...Job Description Job Description Job Title: Data Science Location : Palm Beach , FL (Day One Onsite to Client Location) Experence...  ...and trends " Build reusable data pipelines and feature engineering workflows " Work with SQL and/or cloud-based data warehouses... 

    Yantran LLC

    West Palm Beach, FL
    22 days ago
  • OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data into actionable insights, driving business growth...  .../ ProvinceFloridaCompanyITL USA Interest GroupInfosys Limited Job RoleTechnology Consultant 2Career RoleTechnology Lead - US: 154522BR
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    West Palm Beach, FL
    1 day ago
  •  ...% 5 days a week on-site . The hiring lead clarified that: • They prefer  local candidates...  ...Takeaway This is a  senior, hands-on data/software role centered on  database...  ...Seeking a Senior Data Analyst / Data Engineer to design, develop, and maintain enterprise... 
    Contract work
    Local area

    Delan Associates, Inc

    Juno Beach, FL
    17 days ago
  •  ...Job Description Job Description Senior Data Engineer Forecasting Platforms & Operations Position Specific Description The Senior Data Engineer Forecasting Platforms & Operations will support the development, integration, operational reliability, and continued... 
    Daily paid
    Work at office
    Shift work

    Abacus Service Corporation

    North Palm Beach, FL
    22 days ago
  •  ...THE ROLE We are looking for an MLOps Engineer to deploy, scale, and monitor computer...  ...professional experience in MLOps, DevOps, Data Engineering, Machine Learning, or...  ...DO - Resource & Cost Optimization: Lead GPU compute efficiency and infrastructure... 
    Work at office
    Remote work
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours
    3 days per week

    AgileEngine

    West Palm Beach, FL
    19 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!