Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data/Spark Principal Architect

Software Technology Inc

Big Data/Spark Principal Architect

Location: Remote

Duration: Full-time

Mandatory Skills - Spark, SCALA, Kafka, Streaming, technical architecture, Data Bricks, Data Engineering, data quality, Data Governance. Presales, Client Relationship, Presentation.

Years Of Experience: 15 to 20 Years

Job Description:

Handson with Spark (dataframe), Spark SQL, Databricks, AWS Glue, Scala/Spark or PySpark, Kafka or another streaming technology. Good learning & cross skilling ability. Design & Architecture of big data systems. Experience in ETL, Data Governance, Data Quality, Good understanding of data operations. AWS or Azure cloud. Should have experience with solutioning & consulting (MUST HAVE).

Roles & Responsibilities:

Design/develop big data pipelines using Spark (batch/streaming) and other related technology stacks.

Vacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Big Data/Spark Principal Architect in United States vacancy
  •  ...Job Title: BigData/Spark Principal Architect Location: Remote, USA About the Role: We are seeking an experienced and hands...  ...role demands strong design and architecture skills for big data systems, along with proven solutioning and consulting experience... 
    Principal
    Big data
    Remote work

    Trispoke Managed Services Pvt Ltd

    United States
    14 hours ago
  • $144.2k - $288.4k

     ...Distributed Systems Architect We're building a world of health around...  ...across distributed systems, big‑data platforms, and application...  ...using platforms such as Apache Spark, Databricks, and Apache Kafka...  ...Architect, Staff Engineer, Principal Engineer, or equivalent, with... 
    Principal
    Big data
    Hourly pay
    Full time
    Temporary work
    Remote work

    Oak St. Health

    United States
    1 day ago
  •  ...Associate Principal Engineer – Cloud Platform The Associate...  ..., scalable, and secure data architecture strategies...  ...Proven experience architecting and implementing...  ...frameworks such as dbt, Python, Spark SQL, and SQL. Deep...  ...-on experience with big data technologies like... 
    Principal
    Big data
    Remote work

    Exelixis

    United States
    3 days ago
  •  ...Senior Principal Architect Innovate in collaboration with technologists across JPMorganChase...  ...solutions for processing large data volumes with low latency and high throughput...  ...with data engineering and big data technologies (Spark, Flink, Hadoop ecosystem) Familiarity... 
    Principal
    Big data

    Chase

    Tampa, FL
    1 day ago
  • $159.12k - $258.57k

     ...Technology, Digital and Data Job Description: Your...  .... Caterpillar Inc. seeks Principal Digital Architect at its facility located at 5...  ...systems. Implement data lakes, big data transformations, cloud...  ...processing systems such as Apache Spark, Flink, Akka, Storm; (8)... 
    Principal
    Big data
    Part time
    Flexible hours

    Caterpillar

    Peoria, IL
    1 day ago
  •  ...A company is looking for a Principal Architect, Endpoint Privilege Management. Key Responsibilities Set the technical vision and architectural...  ...(AWS, Azure, or GCP) Hands-on experience architecting big data and analytics platforms Solid understanding of microservices... 
    Principal
    Big data
    Remote work

    Virtual Vocations Inc

    United States
    22 hours ago
  •  ...the next generation of the EPM platform, the full-time remote Principal Architect will set the technical vision, drive architectural decisions...  ...(AWS, Azure, or GCP) Hands-on experience architecting big data and analytics platforms Proficient in microservices and cloud... 
    Principal
    Big data
    Full time
    Remote work

    Virtual Vocations Inc

    United States
    5 days ago
  •  ...Role: Principal Architect/Engineer Location: Remote/US Duration: 6+ Months...  ...Architecture / Engineering (Azure Functions, ADF, Data Bricks, API Development, Service Bus,...  ...code (Terraform preferred) Nice to Have - AWS, Big Data and/or Cloud certifications
    Principal
    Big data
    Remote work

    Zortech Solutions

    United States
    3 days ago
  •  ...As a Principal Architect, you'll be the driving force behind the next generation of our autonomous...  ...implementation of ML model pipelines, including data ingestion, training, validation,...  ...understanding of data architecture and big data technologies (e.g., data lakes, streaming... 
    Principal
    Big data

    Texas State Library and Archives Commision

    Redwood City, CA
    3 days ago
  • A leading healthcare company is seeking a Principal Architect - Distributed Systems to lead architectural and engineering efforts for its Vulnerability...  ...background in designing large-scale distributed systems and big-data platforms, as well as proficiency in languages like Java and... 
    Principal
    Big data
    Remote job

    CVS Health Corporation

    Phoenix, AZ
    2 days ago
  • $270k - $320k

     ...empower people to transform complex data into clear and actionable insights...  ...made up of industry-standard big data processing frameworks like Apache Spark, Apache Airflow, Iceberg with just...  ...environments. We are seeking a Principal Staff Engineer with a strong technical... 
    Principal
    Big data
    Work from home
    Worldwide
    Relocation
    Flexible hours

    Cloudera

    Alviso, CA
    2 days ago
  •  ...bespoke solutions powered by data and technology for several Fortune...  ...and dynamic Solution Architect in Data Engineering to play a...  ...~12+ years of experience in Big Data, data warehouse, data analytics...  ...manipulation languages such as Spark, Scala, Impala, Hive SQL, Apache... 
    Principal
    Big data
    Local area
    Remote work

    Tiger Analytics Inc.

    Jersey City, NJ
    23 days ago
  •  ...bespoke solutions powered by data and technology for several Fortune...  ...and dynamic Solution Architect in Data Engineering to play a...  ...~12+ years of experience in Big Data, data warehouse, data analytics...  ...manipulation languages such as Spark, Scala, Impala, Hive SQL, Apache... 
    Principal
    Big data
    Full time
    Remote work

    Tiger Analytics Inc.

    Jersey City, NJ
    more than 2 months ago
  • Principal Agentic AI Engineer / Architect at AI CoE (f/m/d) We help the world run better. At SAP, we keep it simple...  ...and industry‑leading skills in Data Science and Data Engineering as well...  ...working with vast amounts of data in a Big Data setup, professional Data Engineering... 
    Principal
    Big data

    SAP SE

    New Bremen, OH
    2 days ago
  • $184k - $202.83k

    Position Summary The Principal Architect is a senior strategic technical role responsible for designing...  ...with AI engineering developers, client data and product teams to deliver robust,...  ...microservices with analytics platforms and big data pipelines. Ensure compliance with... 
    Principal
    Big data
    Work at office
    Flexible hours

    Coalfire Systems, Inc.

    Chicago, IL
    3 days ago
  •  ...Data Engineer Location: McLean VA (Onsite Hybrid Model) Duration: 9-12 Months || Extension...  ...have programming experience in Python, Spark for data processing and analysis. Must...  ...ingestion Programming experience in Big Data platform using Hadoop platform Present... 
    Principal
    Big data

    Samprasoft

    McLean, VA
    2 days ago
  •  ...to design, develop and maintain Enterprise Data Platform and other software development....  ...components including (but not limited to) Kafka, Spark, Cassandra, Mesos, Kubernetes, Akka and...  ...· Advanced experience with Big Data processing using Apache Hadoop/Spark... 
    Big data

    ClifyX

    San Jose, CA
    1 day ago
  •  ...Numpy , Pandas , Scikit-Learn • Hands-on experience in Big Data , Cloudera Distribution 7.x, RDBMS • Hands-on...  ...Hadoop components Sqoop , Hive , Solr , MR , Impala , Spark , Spark SQL ., HBase . • Strong experience working in Real... 
    Big data

    3B Staffing LLC

    Sunnyvale, CA
    1 day ago
  •  ...requiring significant expertise in data management and architecture, specifically...  ...Prior experience working in big data technologies like Hadoop Spark Kafka Snowflake certifications SnowPro Core SnowPro Advanced Architect Required Skills: Snowflake. Additional... 
    Big data
    Contract work

    Samprasoft

    Warren, NJ
    2 days ago
  •  ...Palantir Foundry Architect Mandatory Skills: Architect with experience...  ..., implement, and optimize data-driven solutions using Palantir...  ...Palantir Foundry. Optimize Spark-based workloads and ensure performance...  ...Data Engineering, Cloud, and Big Data; 3+ years in Palantir... 
    Big data

    Omni Inclusive

    Cary, NC
    3 days ago
  •  ...Job Title: Power BI Architect Location: Charlotte, NC (Hybrid) Duration: 12+ Months...  ...Pluses: • Knowledge of Big Data Architectures and Cloud computing • Experience...  ...Experience with Hadoop/Hive, Neo4J, Apache Spark, Kafka and MongoDB is a plus • Experience... 
    Big data
    Contract work

    Lorven Technologies

    Charlotte, NC
    4 days ago
  • $144.2k - $288.4k

     ...Enhancement seeks a Distributed Systems Architect to lead the technical architecture of the...  ...in large-scale distributed systems and big-data integration. Responsibilities include technical...  ...experience with platforms like Apache Spark and Databricks. The role offers a... 
    Big data

    Hispanic Alliance for Career Enhancement

    Raleigh, NC
    1 day ago
  • $220k - $235k

    Splash Financial is seeking a Principal Data Engineer to design a scalable, high-performance data platform. Applicants...  ...background in data engineering with proficiency in big data technologies like Hadoop and Spark. The ideal candidate will possess over 10 years of experience... 
    Principal
    Big data
    Remote job

    I did my part and supported the Regular Toilet

    Cleveland, OH
    1 day ago
  •  ...What is in it for you? s a Data Architect you will be a part of an Agile team to build healthcare applications...  ...solutions. rchitect and implement big data processing solutions using Databricks, leveraging Apache Spark for data transformation, ETL processes, and... 
    Big data

    PamTen

    Chicago, IL
    8 hours ago
  •  ...Data Lakehouse Engineer Experience: 7 to 10 Yrs Must have experience with similar...  ...administration Transitioning on-premise big data platforms to scalable cloud-based platforms...  ...Data Ecosystems (e.g., EMR, EKS, Hadoop, Spark, Hudi, Kafka/Kinesis) Must have hands-... 
    Big data

    InterSources

    Charlotte, NC
    1 day ago
  •  ...works on everyday include: Large scale data analysis: Solving problems involving...  ...Disruptor, OpenHFT Chronicle, Elasticsearch, Spark, Redis, Ansible, and Docker. You will help...  ...Experience with ETL and machine learning ("big data" and analytics) ~ Front-end... 
    Principal
    Big data
    Work experience placement

    Roberts Recruiting

    Boston, MA
    1 day ago
  •  ...SENIOR TECHNOLOGY AND DATA ARCHITECT LEADS 2.Job summary Lead projects in the planning Design and documentation of...  ...design principles TOGAF is preferred - Experience with Big Data technologies like Apache Hadoop HBase Spark Hive - Agile Development experience SDLC Tools... 
    Big data
    Second job
    Shift work

    3B Staffing LLC

    Jersey City, NJ
    5 days ago
  •  ...ETL Architect Data Engineer Work Location: ONSITE - Warren, NJ Responsibilities: Alphalab...  ...that integrate seamlessly with big data platforms and support largescale data...  ...Cloud and big data technologies Hadoop Spark ~ Knowledge of API development realtime... 
    Big data

    Samprasoft

    Warren, NJ
    2 days ago
  •  ...implementing, and maintaining scalable, high-performance data solutions using Teradata technologies. The successful candidate...  ...(AWS, Azure) and hybrid architectures Knowledge of big data technologies (Hadoop, Spark) and data governance frameworks Familiarity with... 
    Big data
    Immediate start

    Artech

    Plano, TX
    1 day ago
  •  ...Databrick Architect With Mdm Exp We are seeking highly skilled Databrick...  ..., Cloud ETL tools to join our data team. The ideal candidate will...  .... Leverage PySpark/Spark and SQL to transform and process...  ...Understanding of Spark and PySpark for big data processing. Experience... 
    Big data

    United IT

    Iselin, NJ
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data/Spark Principal Architect. Be the first to apply!