Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

Mindlance

Job Title: Senior Data Engineer

Location: REMOTE

Duration: 12 Months

Role Summary
We are seeking a Senior Data Engineer to design and build the cloud data foundation supporting NextBrain Off-Prem. NextBrain depends on large volumes of operational, engineering, analytical and contextual information. This role will develop the pipelines, storage architecture, data models, APIs and quality controls required to make that information securely and reliably available to NextBrain applications and AI capabilities. The ideal candidate combines modern AWS data engineering expertise with a strong understanding of data quality, time-series information and scalable data architectures.



Key Responsibilities
  • Design and implement the NextBrain cloud data architecture.
  • Build scalable ingestion, transformation, storage and serving pipelines on AWS.
  • Develop pipelines for operational, historical, engineering, application and contextual data.
  • Design data models optimized for analytical applications and AI consumption.
  • Establish appropriate storage patterns across relational, object, time-series and analytical data stores.
  • Develop APIs and services enabling NextBrain tools and agents to retrieve data consistently.
  • Establish automated data-quality validation, reconciliation and monitoring.
  • Implement metadata management, lineage, cataloging and data-governance practices.
  • Design appropriate mechanisms for data segregation and access control.
  • Optimize data pipelines for scalability, performance, reliability and cost.
  • Partner with operational subject-matter experts to validate the meaning and quality of source data.
  • Support migration of relevant information from document-based repositories into structured cloud-hosted data services.
  • Collaborate with AI/ML engineers to create reliable datasets, feature pipelines, retrieval mechanisms and knowledge sources.
  • Establish reusable data integration patterns that accelerate onboarding of additional NextBrain use cases and sites.


Required Qualifications
  • Bachelor's degree in Computer Science, Data Engineering, Engineering or a related field.
  • 5+ years of data engineering experience.
  • Strong Python and SQL skills.
  • Hands-on experience building production data pipelines in AWS.
  • Experience with AWS data technologies such as S3, Glue, Lambda, RDS/Aurora, Redshift, Athena, Kinesis or equivalent technologies.
  • Experience with ETL/ELT architecture and orchestration frameworks.
  • Strong knowledge of relational and non-relational database design.
  • Experience implementing automated data-quality processes.
  • Experience building APIs or data services.
  • Understanding of data governance, lineage, security and access-control principles.


Preferred Qualifications
  • Experience with time-series data.
  • Experience with streaming/event-driven architectures.
  • Experience with industrial IoT, SCADA, historians or operational technology data.
  • Experience with energy-generation assets such as solar, battery storage, wind or conventional generation.
  • Experience designing data architectures supporting AI/ML and generative AI applications.
  • Experience with vector databases and retrieval architectures.
  • Experience working with high-volume telemetry datasets.


What Success Looks Like
NextBrain applications should have a trusted, governed and scalable way to access data, with substantially less application-specific data plumbing and clear visibility into data quality when results do not match expected plant behavior.



EEO:
"Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans."
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in United States vacancy
  •  ...Job Description Description: At CSpring, we believe in the power of data to drive decisions and real-world impact. We’re a purpose-driven consulting firm specializing in data strategy, data engineering, and data analytics. Our clients span the public and private sectors... 
    Senior
    Permanent employment

    CSpring

    Springfield, IL
    13 days ago
  •  ...Job Title: Senior AWS Data Engineer Experience: 8+ Years Skills: AWS Glue, Lambda, Pyspark, Python Location: Fort Mill, SC Job Description : Develop migration workflows based on the approved metadata extraction design. Implement support for full... 
    Senior
    Full time

    Coforge

    Fort Mill, York County, SC
    2 days ago
  • Job ID: 21061868Reference Number: 24-00028Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-05Company: HAN StaffingDE
    Senior

    HAN Staffing

    Iselin, NJ
    2 days ago
  • Job ID: 21057342Reference Number: 24-00019Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-04Company: HAN StaffingData Engineer
    Senior

    HAN Staffing

    Iselin, NJ
    2 days ago
  •  ...Responsibilities: Develop, manage, organize, store, and analyze enterprise data and data systems. Participate in all phases of the software...  ..., development, testing, and QA. Collaborate closely with engineering teams to design and implement scalable data solutions.... 
    Senior
    Full time

    Apexon

    Parsippany, NJ
    1 day ago
  • $160k - $190k

     ...Senior Data Engineer | GCP, BigQuery & Data Platform I’m recruiting for a growing AdTech company looking for a Senior Data Engineer to take real ownership of its analytical data platform. This is not a role where you inherit a perfectly organized warehouse and spend... 
    Senior
    Remote work

    Averity

    New York, NY
    2 days ago
  • $110k - $150k

     ...SENIOR DATA ENGINEER – ENTERPRISE DATA MODELING HYBRID IN PHOENIX, AZ $110,000 – $150,000 BASE + BENEFITS The Opportunity We're partnering with a large enterprise organization modernizing its data platform and looking for a Senior Data Engineer with strong... 
    Senior

    Harnham

    Phoenix, AZ
    1 day ago
  • $51 - $69 per hour

    DescriptionKforce's client in Kansas City, MO is looking for a Senior Databricks Engineer who has successfully completed enterprise-scale data warehouse migrations, possesses deep DLT Meta and Medallion Architecture expertise, can translate Teradata business logic into... 
    Senior
    Contract work

    KForce

    Kansas City, MO
    1 day ago
  •  ...Looking for Data Engineer in Redmond, WA . US Citizen only . Responsibilities 1. Ingest and process data from Salesforce (Investments), Dynamics 365 & Coupa (Finance), Workday (HR), Concur (Operations), and external program/partner data (e.g., Health, Education).... 
    Senior
    Full time

    Sophus IT Solutions

    Redmond, WA
    2 days ago
  •  ...Job Title: Senior Data Engineer Location: Washington, DC (Onsite Job) Employment Type: Full Time Must-Haves ~4+ years of hands-on Data Engineering experience ~ Experience delivering multiple production-grade cloud data platform implementations ~ Advanced... 
    Senior
    Full time

    Galent

    Washington DC
    1 day ago
  •  ...Job Duties:-• Experience: 8–10 years in Data Engineering and Data Analysis. • Informatica Expertise: Strong hands-on experience in Informatica PowerCenter/IDQ for ETL design, development, and optimization. • PySpark Development: Advanced skills in PySpark for large... 
    Senior
    Full time

    ThoughtStorm

    Cleveland, OH
    1 day ago
  •  ...Role: Data Engineer Engagement: Fixed-term contract Location: Chicago, IL (hybrid) About the Role The role will design and deliver data pipelines, data model and AI-ready data products for our Leasing data platform, with structured deliverables. Responsibilities... 
    Senior
    Fixed term contract

    TechNET

    Chicago, IL
    5 days ago
  • Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:...  ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,... 
    Senior
    Contract work
    Remote work

    HAN Staffing

    Iselin, NJ
    2 days ago
  • THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham... 
    Senior
    Work at office

    Harnham

    Boston, MA
    6 days ago
  •  ...Job Title- Senior Data Engineer Location, Denver, Colorado Job Type- Full Time AWS Data Services PostgreSQL AWS Glue Apache Spark / PySpark SQL Data Modeling ETL/ELT Development Microsoft SQL Server Design, develop, and maintain... 
    Senior
    Full time

    Maveric Systems Limited

    Denver, CO
    4 days ago
  •  ...Senior Data Engineer | Medical Device Startup | San Diego, CA (Hybrid, 3+ days onsite) A venture-backed startup developing a novel wearable medical device is hiring a Senior Data Engineer. The company is running multiple clinical trials leading toward a pivotal FDA... 
    Senior
    Full time

    BioTalent

    San Diego, CA
    1 day ago
  •  ...Position: Senior Data Engineer – Clinical Data Harness & Synthetic Data(Only w2) Location : Edina, MN or Chicago, IL (Hybrid) Minimum 12+ Years of Experience required. Job Summary Seeking a hands-on Senior Data Engineer with strong Databricks experience and... 
    Senior
    Full time
    Shift work

    Astir IT Solutions, Inc.

    Chicago, IL
    1 day ago
  • TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...
    Senior
    Full time

    Gen Digital

    Tempe, AZ
    6 days ago
  •  ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Senior Data EngineerLocation - Mount Laurel, NJ (Day 1 Onsite)Job Description:Senior Data Engineer with 10 + years of experienceWorked on ETL, Azure, Databricks, Informatica, Oracle... 
    Senior
    Work at office

    SRI Tech

    Mount Laurel, NJ
    6 days ago
  •  ...Connect Search is working with a large manufacturer who is seeking multiple AWS Data Engineers with strong Python, Pandas, SQL, and ETL pipeline development experience. The ideal candidate will have a proven background building scalable data pipelines, performing complex... 
    Senior
    Full time
    2 days per week

    Connect Search, LLC

    Chicago, IL
    1 day ago
  •  ...and construction of scalable management systems, ensure that all data systems meet company requirements, and also research new uses...  ...practices. • Integrate up-and-coming data management and software engineering technologies into existing data structures. • Develop set... 
    Senior
    Full time
    Work experience placement

    OpTech

    Cincinnati, OH
    3 days ago
  •  ...MDM Lead Engineer — Semarchy xDM Client: Asset Management Firm Location: New York City — Hybrid, 3 days onsite per week Employment...  ...MDM Lead Engineer to support our end-client's Client Master Data team. This individual will serve as the technical owner of the Master... 
    Senior
    Full time
    3 days per week

    Tiger Advisory

    New York, NY
    3 days ago
  •  ...advancement opportunities from within the organization across multiple locations in the US, South America, and India. Role: Senior Data Engineer Location: Plantation, FL (On-site) About the Role We are seeking an experienced Senior Data Engineer – EDI Claims... 
    Senior
    Full time
    Flexible hours

    NationsBenefits

    Plantation, FL
    2 days ago
  •  ...Senior Data Engineer (Microsoft Fabric / Azure) Location: Remote Employment Type: Full-Time About the Opportunity We're partnering with an established organization undergoing a significant transformation of its enterprise data infrastructure. They're looking... 
    Senior
    Full time
    Remote work

    Talent

    United States
    3 days ago
  •  ...more than 40 years and has earned repeated recognition for both its healthcare content and workplace culture. Job Title - Senior Data Engineer Location - Hybrid in Montvale, NJ — 3 days per week onsite Role Type - 6–12 month contract Must Have Skills:... 
    Senior
    Contract work
    3 days per week

    Covenant HR

    Montvale, NJ
    4 days ago
  •  ...As a Senior Data Engineer you will own the design and delivery of complex data engineering solutions that power enterprise analytics, AI, and reporting capabilities. Reporting to the Lead Data Engineer, you will drive technical decisions, set engineering standards, and... 
    Senior
    Full time

    PRI Technology

    New York, NY
    4 days ago
  •  ...A rapidly growing global financial services firm is looking for a Senior Data Engineer as they expand their Enterprise Data Team in the US. With over 3,000 employees globally and more than $2B in annual revenue, the business is continuing to expand its product offering... 
    Senior
    Full time

    twentyAI

    New York, NY
    3 days ago
  •  ...Hiring: Lead Data Engineer - Databricks Important Visa: USC and GC only Location: Manhattan, New York (Onsite) JD: Role Overview Client is seeking a Lead Data Engineer with deep hands-on expertise in Databricks, SQL, Python, and PySpark to design... 
    Senior
    Full time

    Wise Skulls

    Manhattan, KS
    1 day ago
  •  ...Senior Data Engineer Fort Mill, SC Responsibilities: Design, develop, and maintain ETL processes to extract, transform, and load data from various sources into Snowflake. Utilize AWS services such as Airflow and Glue for orchestration and data processing tasks... 
    Senior
    Full time

    Coforge

    Fort Mill, York County, SC
    3 days ago
  • Senior to Principal Data Engineer (SQLserver, Financial Services), Boston, MA. Hybrid, min 3 days week in office, 135k to 175k base on experienceCompensation Commensurate with experience, EOE, diverse highly educated culture Candidates must be a U.S. citizen or national... 
    Senior
    Permanent employment
    Contract work
    Work at office
    Local area
    3 days per week

    BlueSkyClarity

    Boston, MA
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!