Middle Big Data Engineer
N-iX
Middle Data Engineer
N-iX is seeking a proactive and skilled Middle Data Engineer to join our vibrant and collaborative team. In this role, you will be responsible for designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. You will work closely with cross-functional stakeholders to deliver scalable, reliable, and secure data solutions that support data-driven decision-making across the organization.
The ideal candidate has a strong foundation in cloud-based data engineering, modern data architectures, and a passion for solving complex data challenges, particularly in regulated and data-intensive domains.
Required Qualifications
- 3+ years of professional experience in data engineering or a closely related field.
- Strong proficiency in Python and PySpark for data processing and pipeline development.
- Solid experience working with big data and distributed processing technologies.
- Hands-on experience with cloud-based data engineering services (AWS, Azure, or GCP).
- Strong understanding of data modeling, ETL/ELT concepts, and data pipeline architecture.
- Experience designing and maintaining reliable, scalable data workflows.
- Ability to work effectively in cross-functional, collaborative environments.
- English level at least Upper-Intermediate.
Nice to Have
- Experience in the pharmaceutical or life sciences domain.
- Prior hands-on experience with Palantir Foundry.
- Familiarity with data governance frameworks and regulated data environments.
- Experience working with complex, large-scale datasets.
Key Responsibilities
- Collaborate with cross-functional teams (engineering, analytics, product, and business stakeholders) to understand data requirements and translate them into scalable technical solutions.
- Design, implement, and maintain end-to-end data pipelines in Palantir Foundry, ensuring data integrity, reliability, and performance.
- Develop and maintain Ontology Objects, data models, schemas, and flow diagrams to support consistent and reusable data assets.
- Build, optimize, and support ETL/ELT pipelines to collect, process, and integrate data from multiple sources into downstream systems and applications.
- Apply data governance, security, and access control best practices to protect sensitive and regulated data.
- Monitor pipeline performance, identify bottlenecks, and implement improvements to reduce latency and improve efficiency.
- Troubleshoot and resolve data pipeline issues to ensure continuous availability and accuracy of data.
- Maintain clear technical documentation and effectively communicate design decisions and technical solutions.
- Stay up to date with emerging technologies, tools, and industry trends, proactively suggesting improvements to data engineering practices.
Technologies & Tools
You will work with (but are not limited to):
- Palantir Foundry
- Python
- PySpark
- SQL
- TypeScript
- Big data technologies (e.g. Apache Spark, Hadoop, Kafka, BigQuery)
- Cloud data services (e.g. AWS Glue, Azure Data Factory, Google Cloud Dataflow)
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
- ...Middle Data Engineer (Azure Databricks) Miratech helps visionaries change the world. We are a global IT services and consulting company that... ...~ Solid understanding of distributed data processing and big data concepts ~ Experience working with Delta Lake and Lakehouse...Big dataFull timeInternshipRemote workRelocation
$95 per hour
..., 11147688, 111476899 Role Senior SW Engineer - Java Work location Dallas, Tx Rates... ...• Experience in distributed systems and big data technologies (Hadoop, Hive, Spark, etc.)... .... Legal name (First Name, Middle name and Last Name): Location (City and...Big dataFor contractorsRelocation$122k
...Transmission and Distribution Engineering organization is responsible for... ...department the Reliability Data team is on point for a key role... ...role will be placed towards the middle or entry point of the range,... ...generates infrastructure that allows big data to be accessed and...Big dataWork at officeRemote work2 days per week3 days per week$150k
...Project overview The project involves migrating production data pipelines from legacy environments into a modern,... ...compliance. Position overview We are looking for a Middle-Senior Data Engineer with AI experience and a strong background in building scalable...Suggested3 days per week- ...backed by our market-leading data and technology. We invest heavily... ...Europe, Asia Pacific and the Middle East, and have $1.0 trillion... ...are seeking a talented ETL Data Engineer with strong experience in... ...priorities. Familiarity with big data technologies, machine learning...Big dataWork experience placementShift work
$155k
...Transmission and Distribution Engineering organization is responsible for... ...department the Reliability Data team is on point for a key role... ...role will be placed toward the middle or entry point of the range, the... ...on infrastructure that allows big data to be accessed and...Big dataWork at officeRemote work2 days per week3 days per week$37.5 - $59.62 per hour
...Transmission and Distribution Engineering organization is responsible for... ...department the Reliability Data team is on point for a key role... ...role will be placed toward the middle or entry point of the range, the... ...infrastructure that allows big data to be accessed and analyzed...Big dataHourly payApprenticeshipWork at officeRemote work2 days per week3 days per week$140k
...Transmission and Distribution Engineering organization is responsible for... ...department the Reliability Data team is on point for a key role... ...role will be placed toward the middle or entry point of the range, the... ...infrastructure that allows big data to be accessed and analyzed...Big dataWork at officeRemote work2 days per week3 days per week$149.2k - $201.8k
...Virtual First Data Engineer Dropbox is a Virtual First company. For this role, we are hiring... ...up and plan to leverage the most recent Big Data technologies. If you enjoy building... ...offers between the minimum up to the middle of the range. Dropbox uses the zip code...Big dataRemote workWorldwide- ...Big Data Engineer Location: Mountain View, CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink) ~5+ years experience with Java or Scala ~ Strong experience working with microservices...Big data
- ...Big Data Developer This role requires a seasoned developer having 8+ years of experience in Big Data, Java. The ideal candidate will be having sound knowledge of big data ecosystem esp. Spark and handling massive data sets. The role also required to optimize existing...Big data
- ...Software Engineer The Software Engineer position will be responsible for hands-on development as well as lead the development of Next Generation Enterprise solutions for Global eCommerce. SE will be responsible for application development in support of the multi-platform...Big data
$140k - $200k
...leader in digital assets and data center infrastructure, delivering... ...North America, Europe, the Middle East, and Asia. To learn more... ...Are Galaxy is hiring two Data Engineers - one Associate (3+ years of experience... ...expert on data pipelining and big data processing frameworks,...Big dataWork at officeLocal areaFlexible hours- ...Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience with...Big dataFull timeImmediate start
- ...~ Expert in Spark, Python scripting and strong in SQL ~5+ years processing large datasets on big data platform such as SPARK; Python EMR; Hadoop on AWS ~5+ years of experience architecting and building scalable Reporting and Advance Analytics solutions using...Big data
- ...Big Data Engineer (MongoDB & Cassandra) We are seeking a skilled Big Data Engineer with strong experience in MongoDB and Cassandra to design, develop, and manage large-scale data systems. The ideal candidate will work on building scalable data solutions, handling high...Big data
- ...Job title COGNIZANT LOOKING FOR BIG DATA ENGINEER Job summary BigData Engineer Primary Skill Set • 4+ years of experience working on data engineering teams related to BigData and Teradata • Expert knowledge of SQL NoSQL and Python • Good experience with Apache Spark ecosystem...Big dataShift work
- ...Big Data Engineer Location: Adolfo Alsina, Argentina Job Duration: Fulltime Work Mode: Remote We are seeking a forward-thinking Big Data Engineer based in Adolfo Alsina, Argentina to architect and optimize secure, high-performance data ecosystems. In this role...Big dataFull timeRemote work
$50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience... ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for...Big dataRelocation- You will be able to apply advanced Data Engineering and Machine learning skills to solve real world challenges in building applications that help the company build better models and do advanced reporting. • Cleanse, manipulate and analyze large datasets (Structured and...Big data
- ...Software Engineer (Big Data) Duration: 3-6 Months CTH Location: Houston/Plano, TX This is a W2 position that requires candidates to be onsite for 2-3 days in a week (Hybrid role). Required Skills: Hadoop Java Spark SQL Nice to Have:...Big data2 days per week3 days per week
- ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms...Big dataFull time
- ...Role: Big Data Engineer Location: Irving TX Duration: 5+ Months Job Description: Minimum 5+ years of experience in IT industry with 2+ years of experience in Big Data implementing complete Hadoop solutions along with Scala Knowledge on complete Hadoop...Big dataWork experience placement
- ...Big Data Engineer Location: Hybrid in Iselin, NJ (3 days onsite) We can take relocation candidates as long as they can relocate and do an onsite interview Overview We are seeking an experienced Big Data Developer with strong Python expertise and hands-on experience...Big dataRelocation
- ...Our client, a premier investment bank, is looking for a Big Data Engineer to join their growing team in Chicago, IL. Currently our client spends a lot of time trying to answer client's questions by logging in to several disparate data sources. It is estimated each support...Big dataFor contractors
- ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and...Big dataWork experience placement
- ...Carolina Duration: Long Term Required: • Degree in a technology related field (e.g. Engineering, Computer Science, etc.). • 8+ years of experience in implementing data engineering solutions in data analytics space • 3+ years of experience in developing data...Big data
- ...Key Responsibilities: Design and implement scalable big data solutions tailored to NDUS's needs. Maintain and enhance existing... ...3 Years Expert proficiency of data engineering creation in Microsoft Fabric Required 1...Big data
- ...Big Data Engineer We are looking for a Big Data Engineer. Please let me know if interested. Big Data Engineer with Java/AWS Plano, TX (Hybrid role, looking for nearby candidates) W2 Contract Only Big data engineer with AWS experience / Java Python - combination...Big dataContract work
- ...Big Data Engineer Costa Mesa , CA or PHX or Bay Area Contract Job Responsibilities 10+ years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra, , Python, Hadoop...Big dataContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Middle Big Data Engineer. Be the first to apply!
- bi data engineer United States
- staff data engineer United States
- data visualization developer United States
- data science developer United States
- senior data center engineer United States
- sr information security engineer United States
- IT data engineer United States
- junior big data engineer United States
- entry level big data engineer United States
- data engineer contract United States

