Big Data/Spark Principal Architect
Software Technology Inc
Big Data/Spark Principal Architect
Location: Remote
Duration: Full-time
Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation.
Years Of Experience: 15 to 20 Years
Job Description:
Handson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data Quality, Good understanding of data operations. AWS or Azure cloud. Should have experience with solutioning & consulting (MUST HAVE).
Roles & Responsibilities:
Design/develop big data pipelines using Spark (batch/streaming) and other related technology stacks.
- ...Job Title: BigData/Spark Principal Architect Location: Remote, USA About the Role: We are seeking an experienced and hands... ...role demands strong design and architecture skills for big data systems, along with proven solutioning and consulting experience...PrincipalBig dataRemote work
$144.2k - $288.4k
...Distributed Systems Architect We're building a world of health around... ...across distributed systems, big‑data platforms, and application... ...using platforms such as Apache Spark, Databricks, and Apache Kafka... ...Architect, Staff Engineer, Principal Engineer, or equivalent, with...PrincipalBig dataHourly payFull timeTemporary workRemote work- ...Associate Principal Engineer – Cloud Platform The Associate... ..., scalable, and secure data architecture strategies... ...Proven experience architecting and implementing... ...frameworks such as dbt, Python, Spark SQL, and SQL. Deep... ...-on experience with big data technologies like...PrincipalBig dataRemote work
- ...Senior Principal Architect Innovate in collaboration with technologists across JPMorganChase... ...solutions for processing large data volumes with low latency and high throughput... ...with data engineering and big data technologies (Spark, Flink, Hadoop ecosystem) Familiarity...PrincipalBig data
$159.12k - $258.57k
...Technology, Digital and Data Job Description: Your... .... Caterpillar Inc. seeks Principal Digital Architect at its facility located at 5... ...systems. Implement data lakes, big data transformations, cloud... ...processing systems such as Apache Spark, Flink, Akka, Storm; (8)...PrincipalBig dataPart timeFlexible hours- ...A company is looking for a Principal Architect, Endpoint Privilege Management. Key Responsibilities Set the technical vision and architectural... ...(AWS, Azure, or GCP) Hands-on experience architecting big data and analytics platforms Solid understanding of microservices...PrincipalBig dataRemote work
- ...the next generation of the EPM platform, the full-time remote Principal Architect will set the technical vision, drive architectural decisions... ...(AWS, Azure, or GCP) Hands-on experience architecting big data and analytics platforms Proficient in microservices and cloud...PrincipalBig dataFull timeRemote work
- ...Role: Principal Architect/Engineer Location: Remote/US Duration: 6+ Months... ...Architecture / Engineering (Azure Functions, ADF, Data Bricks, API Development, Service Bus,... ...code (Terraform preferred) Nice to Have - AWS, Big Data and/or Cloud certificationsPrincipalBig dataRemote work
- ...As a Principal Architect, you'll be the driving force behind the next generation of our autonomous... ...implementation of ML model pipelines, including data ingestion, training, validation,... ...understanding of data architecture and big data technologies (e.g., data lakes, streaming...PrincipalBig data
- A leading healthcare company is seeking a Principal Architect - Distributed Systems to lead architectural and engineering efforts for its Vulnerability... ...background in designing large-scale distributed systems and big-data platforms, as well as proficiency in languages like Java and...PrincipalBig dataRemote job
$270k - $320k
...empower people to transform complex data into clear and actionable insights... ...made up of industry-standard big data processing frameworks like Apache Spark, Apache Airflow, Iceberg with just... ...environments. We are seeking a Principal Staff Engineer with a strong technical...PrincipalBig dataWork from homeWorldwideRelocationFlexible hours- ...bespoke solutions powered by data and technology for several Fortune... ...and dynamic Solution Architect in Data Engineering to play a... ...~12+ years of experience in Big Data, data warehouse, data analytics... ...manipulation languages such as Spark, Scala, Impala, Hive SQL, Apache...PrincipalBig dataLocal areaRemote work
- ...bespoke solutions powered by data and technology for several Fortune... ...and dynamic Solution Architect in Data Engineering to play a... ...~12+ years of experience in Big Data, data warehouse, data analytics... ...manipulation languages such as Spark, Scala, Impala, Hive SQL, Apache...PrincipalBig dataFull timeRemote work
- Principal Agentic AI Engineer / Architect at AI CoE (f/m/d) We help the world run better. At SAP, we keep it simple... ...and industry‑leading skills in Data Science and Data Engineering as well... ...working with vast amounts of data in a Big Data setup, professional Data Engineering...PrincipalBig data
$184k - $202.83k
Position Summary The Principal Architect is a senior strategic technical role responsible for designing... ...with AI engineering developers, client data and product teams to deliver robust,... ...microservices with analytics platforms and big data pipelines. Ensure compliance with...PrincipalBig dataWork at officeFlexible hours- ...Data Engineer Location: McLean VA (Onsite Hybrid Model) Duration: 9-12 Months || Extension... ...have programming experience in Python, Spark for data processing and analysis. Must... ...ingestion Programming experience in Big Data platform using Hadoop platform Present...PrincipalBig data
- ...to design, develop and maintain Enterprise Data Platform and other software development.... ...components including (but not limited to) Kafka, Spark, Cassandra, Mesos, Kubernetes, Akka and... ...· Advanced experience with Big Data processing using Apache Hadoop/Spark...Big data
- ...Numpy , Pandas , Scikit-Learn • Hands-on experience in Big Data , Cloudera Distribution 7.x, RDBMS • Hands-on... ...Hadoop components Sqoop , Hive , Solr , MR , Impala , Spark , Spark SQL ., HBase . • Strong experience working in Real...Big data
- ...requiring significant expertise in data management and architecture, specifically... ...Prior experience working in big data technologies like Hadoop Spark Kafka Snowflake certifications SnowPro Core SnowPro Advanced Architect Required Skills: Snowflake. Additional...Big dataContract work
- ...Palantir Foundry Architect Mandatory Skills: Architect with experience... ..., implement, and optimize data-driven solutions using Palantir... ...Palantir Foundry. Optimize Spark-based workloads and ensure performance... ...Data Engineering, Cloud, and Big Data; 3+ years in Palantir...Big data
- ...Job Title: Power BI Architect Location: Charlotte, NC (Hybrid) Duration: 12+ Months... ...Pluses: • Knowledge of Big Data Architectures and Cloud computing • Experience... ...Experience with Hadoop/Hive, Neo4J, Apache Spark, Kafka and MongoDB is a plus • Experience...Big dataContract work
$144.2k - $288.4k
...Enhancement seeks a Distributed Systems Architect to lead the technical architecture of the... ...in large-scale distributed systems and big-data integration. Responsibilities include technical... ...experience with platforms like Apache Spark and Databricks. The role offers a...Big data$220k - $235k
Splash Financial is seeking a Principal Data Engineer to design a scalable, high-performance data platform. Applicants... ...background in data engineering with proficiency in big data technologies like Hadoop and Spark. The ideal candidate will possess over 10 years of experience...PrincipalBig dataRemote job- ...What is in it for you? s a Data Architect you will be a part of an Agile team to build healthcare applications... ...solutions. rchitect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and...Big data
- ...Data Lakehouse Engineer Experience: 7 to 10 Yrs Must have experience with similar... ...administration Transitioning on-premise big data platforms to scalable cloud-based platforms... ...Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have hands-...Big data
- ...works on everyday include: Large scale data analysis: Solving problems involving... ...Disruptor, OpenHFT Chronicle, Elasticsearch, Spark, Redis, Ansible, and Docker. You will help... ...Experience with ETL and machine learning ("big data" and analytics) ~ Front-end...PrincipalBig dataWork experience placement
- ...SENIOR TECHNOLOGY AND DATA ARCHITECT LEADS 2.Job summary Lead projects in the planning Design and documentation of... ...design principles TOGAF is preferred - Experience with Big Data technologies like Apache Hadoop HBase Spark Hive - Agile Development experience SDLC Tools...Big dataSecond jobShift work
- ...ETL Architect Data Engineer Work Location: ONSITE - Warren, NJ Responsibilities: Alphalab... ...that integrate seamlessly with big data platforms and support largescale data... ...Cloud and big data technologies Hadoop Spark ~ Knowledge of API development realtime...Big data
- ...implementing, and maintaining scalable, high-performance data solutions using Teradata technologies. The successful candidate... ...(AWS, Azure) and hybrid architectures Knowledge of big data technologies (Hadoop, Spark) and data governance frameworks Familiarity with...Big dataImmediate start
- ...Databrick Architect With Mdm Exp We are seeking highly skilled Databrick... ..., Cloud ETL tools to join our data team. The ideal candidate will... .... Leverage PySpark/Spark and SQL to transform and process... ...Understanding of Spark and PySpark for big data processing. Experience...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data/Spark Principal Architect. Be the first to apply!
- sr data modeler United States
- data center architect United States
- enterprise data architect United States
- senior data modeler United States
- remote data architect United States
- database designer United States
- salesforce data architect United States
- data architect United States
- hadoop big data architect United States
- azure data architect United States

