Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Middle Big Data Engineer

N-iX

Middle Data Engineer

N-iX is seeking a proactive and skilled Middle Data Engineer to join our vibrant and collaborative team. In this role, you will be responsible for designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. You will work closely with cross-functional stakeholders to deliver scalable, reliable, and secure data solutions that support data-driven decision-making across the organization.

The ideal candidate has a strong foundation in cloud-based data engineering, modern data architectures, and a passion for solving complex data challenges, particularly in regulated and data-intensive domains.

Required Qualifications
  • 3+ years of professional experience in data engineering or a closely related field.
  • Strong proficiency in Python and PySpark for data processing and pipeline development.
  • Solid experience working with big data and distributed processing technologies.
  • Hands-on experience with cloud-based data engineering services (AWS, Azure, or GCP).
  • Strong understanding of data modeling, ETL/ELT concepts, and data pipeline architecture.
  • Experience designing and maintaining reliable, scalable data workflows.
  • Ability to work effectively in cross-functional, collaborative environments.
  • English level at least Upper-Intermediate.
Nice to Have
  • Experience in the pharmaceutical or life sciences domain.
  • Prior hands-on experience with Palantir Foundry.
  • Familiarity with data governance frameworks and regulated data environments.
  • Experience working with complex, large-scale datasets.
Key Responsibilities
  • Collaborate with cross-functional teams (engineering, analytics, product, and business stakeholders) to understand data requirements and translate them into scalable technical solutions.
  • Design, implement, and maintain end-to-end data pipelines in Palantir Foundry, ensuring data integrity, reliability, and performance.
  • Develop and maintain Ontology Objects, data models, schemas, and flow diagrams to support consistent and reusable data assets.
  • Build, optimize, and support ETL/ELT pipelines to collect, process, and integrate data from multiple sources into downstream systems and applications.
  • Apply data governance, security, and access control best practices to protect sensitive and regulated data.
  • Monitor pipeline performance, identify bottlenecks, and implement improvements to reduce latency and improve efficiency.
  • Troubleshoot and resolve data pipeline issues to ensure continuous availability and accuracy of data.
  • Maintain clear technical documentation and effectively communicate design decisions and technical solutions.
  • Stay up to date with emerging technologies, tools, and industry trends, proactively suggesting improvements to data engineering practices.
Technologies & Tools

You will work with (but are not limited to):

  • Palantir Foundry
  • Python
  • PySpark
  • SQL
  • TypeScript
  • Big data technologies (e.g. Apache Spark, Hadoop, Kafka, BigQuery)
  • Cloud data services (e.g. AWS Glue, Azure Data Factory, Google Cloud Dataflow)

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Middle Big Data Engineer in United States vacancy
  •  ...Middle Data Engineer (Azure Databricks) Miratech helps visionaries change the world. We are a global IT services and consulting company that...  ...~ Solid understanding of distributed data processing and big data concepts ~ Experience working with Delta Lake and Lakehouse... 
    Big data
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    United States
    1 day ago
  • $95 per hour

     ..., 11147688, 111476899 Role Senior SW Engineer - Java Work location Dallas, Tx Rates...  ...• Experience in distributed systems and big data technologies (Hadoop, Hive, Spark, etc.)...  .... Legal name (First Name, Middle name and Last Name): Location (City and... 
    Big data
    For contractors
    Relocation

    Redolent

    Richardson, TX
    3 days ago
  • $122k

     ...Transmission and Distribution Engineering organization is responsible for...  ...department the Reliability Data team is on point for a key role...  ...role will be placed towards the middle or entry point of the range,...  ...generates infrastructure that allows big data to be accessed and... 
    Big data
    Work at office
    Remote work
    2 days per week
    3 days per week

    PG&E Corporation

    Oakland, CA
    1 day ago
  • $150k

     ...Project overview The project involves migrating production data pipelines from legacy environments into a modern,...  ...compliance. Position overview We are looking for a Middle-Senior Data Engineer with AI experience and a strong background in building scalable... 
    Suggested
    3 days per week

    DataArt

    New York, NY
    1 day ago
  •  ...backed by our market-leading data and technology. We invest heavily...  ...Europe, Asia Pacific and the Middle East, and have $1.0 trillion...  ...are seeking a talented ETL Data Engineer with strong experience in...  ...priorities. Familiarity with big data technologies, machine learning... 
    Big data
    Work experience placement
    Shift work

    Hamilton Lane

    Conshohocken, PA
    1 day ago
  • $155k

     ...Transmission and Distribution Engineering organization is responsible for...  ...department the Reliability Data team is on point for a key role...  ...role will be placed toward the middle or entry point of the range, the...  ...on infrastructure that allows big data to be accessed and... 
    Big data
    Work at office
    Remote work
    2 days per week
    3 days per week

    PG&E Corporation

    Oakland, CA
    6 days ago
  • $37.5 - $59.62 per hour

     ...Transmission and Distribution Engineering organization is responsible for...  ...department the Reliability Data team is on point for a key role...  ...role will be placed toward the middle or entry point of the range, the...  ...infrastructure that allows big data to be accessed and analyzed... 
    Big data
    Hourly pay
    Apprenticeship
    Work at office
    Remote work
    2 days per week
    3 days per week

    PG&E Corporation

    Oakland, CA
    6 days ago
  • $140k

     ...Transmission and Distribution Engineering organization is responsible for...  ...department the Reliability Data team is on point for a key role...  ...role will be placed toward the middle or entry point of the range, the...  ...infrastructure that allows big data to be accessed and analyzed... 
    Big data
    Work at office
    Remote work
    2 days per week
    3 days per week

    PG&E Corporation

    Oakland, CA
    1 day ago
  • $149.2k - $201.8k

     ...Virtual First Data Engineer Dropbox is a Virtual First company. For this role, we are hiring...  ...up and plan to leverage the most recent Big Data technologies. If you enjoy building...  ...offers between the minimum up to the middle of the range. Dropbox uses the zip code... 
    Big data
    Remote work
    Worldwide

    Dropbox

    United States
    10 hours ago
  •  ...Big Data Engineer Location: Mountain View, CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink) ~5+ years experience with Java or Scala ~ Strong experience working with microservices... 
    Big data

    Kasmo Global

    Mountain View, CA
    7 days ago
  •  ...Big Data Developer This role requires a seasoned developer having 8+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem esp. Spark and handling massive data sets. The role also required to optimize existing... 
    Big data

    Omni Inclusive

    Phoenix, AZ
    4 days ago
  •  ...Software Engineer The Software Engineer position will be responsible for hands-on development as well as lead the development of Next Generation Enterprise solutions for Global eCommerce. SE will be responsible for application development in support of the multi-platform... 
    Big data

    Samprasoft

    Sunnyvale, CA
    3 days ago
  • $140k - $200k

     ...leader in digital assets and data center infrastructure, delivering...  ...North America, Europe, the Middle East, and Asia. To learn more...  ...Are Galaxy is hiring two Data Engineers - one Associate (3+ years of experience...  ...expert on data pipelining and big data processing frameworks,... 
    Big data
    Work at office
    Local area
    Flexible hours

    Crypto Pro Network

    New York, NY
    1 day ago
  •  ...Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience with... 
    Big data
    Full time
    Immediate start

    JConnect Infotech

    Costa Mesa, CA
    2 days ago
  •  ...~ Expert in Spark, Python scripting and strong in SQL ~5+ years processing large datasets on big data platform such as SPARK; Python EMR; Hadoop on AWS ~5+ years of experience architecting and building scalable Reporting and Advance Analytics solutions using... 
    Big data

    3B Staffing LLC

    Beaverton, OR
    18 hours ago
  •  ...Big Data Engineer (MongoDB & Cassandra) We are seeking a skilled Big Data Engineer with strong experience in MongoDB and Cassandra to design, develop, and manage large-scale data systems. The ideal candidate will work on building scalable data solutions, handling high... 
    Big data

    Staffing the Universe

    New York, NY
    2 days ago
  •  ...Job title COGNIZANT LOOKING FOR BIG DATA ENGINEER Job summary BigData Engineer Primary Skill Set • 4+ years of experience working on data engineering teams related to BigData and Teradata • Expert knowledge of SQL NoSQL and Python • Good experience with Apache Spark ecosystem... 
    Big data
    Shift work

    Avani Technology Solutions

    Irving, TX
    a month ago
  •  ...Big Data Engineer Location: Adolfo Alsina, Argentina Job Duration: Fulltime Work Mode: Remote We are seeking a forward-thinking Big Data Engineer based in Adolfo Alsina, Argentina to architect and optimize secure, high-performance data ecosystems. In this role... 
    Big data
    Full time
    Remote work

    E-Solutions

    United States
    3 days ago
  • $50 - $60 per hour

     ...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience...  ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for... 
    Big data
    Relocation

    Omega Solutions

    Santa Clara, CA
    18 hours ago
  • You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting. • Cleanse, manipulate and analyze large datasets (Structured and... 
    Big data

    Exaways Corporation

    McLean, VA
    3 days ago
  •  ...Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano, TX This is a W2 position that requires candidates to be onsite for 2-3 days in a week (Hybrid role). Required Skills: Hadoop Java Spark SQL Nice to Have:... 
    Big data
    2 days per week
    3 days per week

    TriOptus LLC

    Plano, TX
    2 days ago
  •  ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms... 
    Big data
    Full time

    Syntricate Technologies

    New York, NY
    2 days ago
  •  ...Role: Big Data Engineer Location: Irving TX Duration: 5+ Months Job Description: Minimum 5+ years of experience in IT industry with 2+ years of experience in Big Data implementing complete Hadoop solutions along with Scala Knowledge on complete Hadoop... 
    Big data
    Work experience placement

    Avani Technology Solutions

    Irving, TX
    11 days ago
  •  ...Big Data Engineer Location: Hybrid in Iselin, NJ (3 days onsite) We can take relocation candidates as long as they can relocate and do an onsite interview Overview We are seeking an experienced Big Data Developer with strong Python expertise and hands-on experience... 
    Big data
    Relocation

    RIT Solutions

    Iselin, NJ
    2 days ago
  •  ...Our client, a premier investment bank, is looking for a Big Data Engineer to join their growing team in Chicago, IL.  Currently our client spends a lot of time trying to answer client's questions by logging in to several disparate data sources. It is estimated each support... 
    Big data
    For contractors

    Liniumit

    Chicago, IL
    4 days ago
  •  ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and... 
    Big data
    Work experience placement

    Purple Drive

    New York, NY
    4 days ago
  •  ...Carolina Duration: Long Term Required: • Degree in a technology related field (e.g. Engineering, Computer Science, etc.). • 8+ years of experience in implementing data engineering solutions in data analytics space • 3+ years of experience in developing data... 
    Big data

    Samprasoft

    Durham, NC
    3 days ago
  •  ...Key Responsibilities: Design and implement scalable big data solutions tailored to NDUS's needs. Maintain and enhance existing...  ...3 Years Expert proficiency of data engineering creation in Microsoft Fabric Required 1... 
    Big data

    My3Tech Inc

    United States
    4 days ago
  •  ...Big Data Engineer We are looking for a Big Data Engineer. Please let me know if interested. Big Data Engineer with Java/AWS Plano, TX (Hybrid role, looking for nearby candidates) W2 Contract Only Big data engineer with AWS experience / Java Python - combination... 
    Big data
    Contract work

    Syntricate Technologies

    Plano, TX
    2 days ago
  •  ...Big Data Engineer Costa Mesa , CA or PHX or Bay Area Contract Job Responsibilities 10+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop... 
    Big data
    Contract work

    Lorven Technologies

    Costa Mesa, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Middle Big Data Engineer. Be the first to apply!