Big Data Platform Staff Engineer
Careers Integrated Resources Inc
Big Data Platform Staff EngineerJob Title: Big Data Platform Staff Engineer Duration: 6 Months Location: Santa Clara, CAJob Description: As a core developer, you will be part of the team that focuses on the next generation Clients' Big Data Platform. Your primary responsibility includes developing big data tools that facilitate various consumers (users or programs), in terms of optimizing or automating the system. In particular, you will be developing tools for handling big data metadata, extracting metadata and importing them into Clients' big data platform, and synchronizing metadata across several metastores. You will also be developing algorithms to analyze query workload and generate recommendations (advisors) on optimizing the various system components and structures. You will also perform testing, analyzing, and optimizing the Big Data Platform performance. The position involves strong problem-solving and analytical nature, and excellent verbal and written communication skills.Requirements: BS or higher degree in Computer Science or related field. 5+ years of software development experience, including performance analysis. Strong SQL knowledge (JDBC) in query processing, optimization and execution, query performance, Explain, database tooling Spark/SparkSQL is a big plus Excellent coding skills in Scala/Java and scripting languages; UI skill a big plus Hands-on experience in Big Data Components/Frameworks, such as Hadoop, Spark, HBase, HDFS, Hive, NoSQL databases etc. Experience in other distributed system components, such as Solr, Elasticsearch, Logstash, Kibana, Kafka, REST API, etc. is a plusKey Responsibilities: Develop tools that extract/import/synchronize metadata· Develop tools that analyze query workload, derives common workload characteristics, generates recommendations for optimizing the system usage, and measures the benefits (advisors) Analyze performance and scalability of the system, typically across a variety of software configurations Testing (and automated testing) of developed code
- Intuit’s Dev360 team seeks an experienced data platform engineer to architect scalable, fault-tolerant big-data platforms and enable data-driven decisions. You will work with Product, Engineering, and Central Data Lake teams to ensure extensibility, data governance, and...Big data
$163k - $253k
...smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more.... ...ranging from hyper-scale data centers, to big data processing, to software defined... ...with focus in Computer Science, Computer Engineering, Electrical Engineering or equivalent.Strong...Big dataWork at officeFlexible hoursSamsung Semiconductor
San Jose, CA4 days ago$163k - $253k
...smartphones, electric vehicles, hyperscale data centers, IoT devices, and so much more.... ...ranging from hyper-scale data centers, to big data processing, to software defined virtualized... ...are looking for a dynamic, self-motivated engineer to develop and support our cutting-edge...Big dataFlexible hoursSamsung Semiconductor
San Jose, CA4 days ago$200k - $230k
...user conversion. The ideal candidate will collaborate closely with data scientists and product managers while also maintaining robust... ...and Java, and familiarity with technologies such as Kubernetes and big data tools. This hybrid role offers a competitive compensation package...Big dataSamsung
Mountain View, CA3 days ago$189k - $301k
...electric vehicles, hyperscale data centers, IoT devices, and so... ...hyper-scale data centers, to big data processing, to software... ...storage.We are looking for a Sr Staff Engineer who lives at the intersection... ...direction across inference, platform, and hardware teams. This is...Big dataFlexible hoursShift workSamsung Semiconductor
San Jose, CA9 days ago- ...QA EngineerWe are seeking an experienced QA engineer who can lead our test automation efforts for our big data platform. You are a self-motivated professional who demonstrates the ability to quickly grasp new technologies, products and use cases. You will help design,...Big dataRemote work
Netpace
Santa Clara, CA3 days ago - ...Apple Inc. in Sunnyvale, California, is seeking a Software Engineer for Reliability Engineering in AiDP. You will build and operate multi-tenant platforms for GenAI, ML, inference and big data across hybrid environments. Responsibilities include maintaining scalable...Big data
Apple
Sunnyvale, CA17 hours ago $160k - $185k
...networking solutions for Data Center, Cloud Computing... ...Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC... ...passionate, and committed engineers, technologists, and... ...join us.Job Summary:The Staff System Engineer position... ...Intel/AMD/Nvidia platform architecture, CPU interface...Big dataWorldwideSupermicro
San Jose, CA8 days ago$170k - $200k
...storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/... ..., passionate, and committed engineers, technologists, and business leaders... ...-list templates.•Train internal staff on system operation,...Big dataFor contractorsWorldwideSupermicro
San Jose, CA6 days ago$175k - $210k
...storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/... ..., passionate, and committed engineers, technologists, and business leaders... ...We have an immediate need for a Staff Hardware Design Engineer to join...Big dataWork at officeImmediate startWorldwideSupermicro
San Jose, CA5 days ago$176.5k - $262.35k
...completion of payments on our platform on behalf of our customers.We... ...communities.Job Summary:The Venmo Data Infrastructure team supports... ...leadership role for an engineer who will serve as the Kafka subject... ...Hands-on experience with related big data infrastructure — AWS S3,...Big dataFull timeWork at officeLocal areaImmediate startFlexible hoursPayPal
San Jose, CA4 days ago$200k - $322k
...how you can make a lasting impact on the world.This Senior Staff Client Platform Engineer role is a high-impact technical leadership position... ...dedication to the end-user experience, with a history of using data and feedback to drive user-focused platform improvements.Experience...Full timeNvidia
Santa Clara, CA7 days ago$181.2k - $317.1k
Company DescriptionIt all started when engineer Fred Luddy wrote code that... ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the... ...looking for a seasoned IC5 Senior Staff Engineer with deep expertise in...Permanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per weekServiceNow
Santa Clara, CA6 days ago$176.5k - $262.35k
...completion of payments on our platform on behalf of our... ...Job Summary The Venmo Data Infrastructure team... ...from more experienced staff Follows well-established... ...leadership role for an engineer who will serve as the... ...experience with related big data infrastructure - AWS...Big dataWork at officeLocal areaFlexible hoursPayPal
San Jose, CA3 days ago$185k - $215k
...shapes the way we move. The next big milestone in our sight is to... ...role, you will operate as a Staff AI Systems Engineer, setting technical direction... ..., control, and vehicle platform layers. Integrate automated... ...best practices for log data structures, automated analytics...Big dataWork experience placementLocal areaWorldwideBosch Group
Sunnyvale, CA2 days ago$190.9k - $334.1k
...Description It all started when engineer Fred Luddy wrote code that automated... ...reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the... ...About the team: As a Senior Staff Software Engineer with the Data Platform...Permanent employmentWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per weekServiceNow
Santa Clara, CA1 day ago$237k - $260k
...most demanding AI workloads. We focus on first-principles engineering across silicon, systems, and networking—where performance,... ...Overview This is a full-time, on-site role for a Senior Staff Platform Engineer located in Santa Clara, CA. The engineer will own end...Full timeImmediate startUpscale AI
Santa Clara, CA4 days ago$175k - $200k
...storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/... ..., passionate, and committed engineers, technologists, and business leaders... ...Supermicro seeks an experienced Staff Data Center Electrical Engineer...Big dataWorldwideSuper Micro Computer
San Jose, CA8 days ago$202k - $223k
...About the role Muon Space is hiring a Staff Spacecraft Platform Engineer to be a senior technical owner of our spacecraft bus — the reusable architecture... ...cross-disciplinary system trades (mass, power, thermal, data, cost) and platform requirements development and flow-...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per weekArcTern Ventures
San Jose, CA4 days ago$185k - $200k
...networking solutions for Data Center, Cloud Computing... ...Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC... ...passionate, and committed engineers, technologists, and... ...skilled and experienced Staff Data Center Controls Engineer... ...emerging controls platforms, automation...Big dataFor contractorsWorldwideSupermicro
San Jose, CA5 days ago$165k - $200k
...networking solutions for Data Center, Cloud Computing... ...Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC... ...passionate, and committed engineers, technologists, and... ...join us. Job Summary:As Staff Data Center Solutions Engineeryou... ...and GPUaaS platforms, including Agentic AI tooling...Big dataWorldwideSuper Micro Computer
San Jose, CA8 days ago- DoorDash is seeking a Data Governance professional to join their team in Sunnyvale, California... ..., you will work on building robust data platforms and establishing policies to ensure high-... ...in Computer Science, experience in Big Data infrastructure, and familiarity with...Big dataFull time
$214.67k - $322k
...About the Team Cloud Infrastructure Engineering is a critical engineering discipline and... ...drive safety, health and uptime of our platform, and the ability to remedy unforeseen problems... ...deployment, maintenance and scaling of big data and machine learning platforms (e.g.,...Big dataFor contractorsOKX Group
San Jose, CA3 hours ago$184.7k - $277.6k
...Software Engineer, Platform Reliability Engineering, AiDP Sunnyvale, California, United States Corporate Functions AI & Data Platforms (AiDP) is IS&T's engine for AI-powered innovation. The... ...spanning ML, GenAI, inference, and big data—enabling teams across the company...Big dataRelocationApple Inc.
Sunnyvale, CA4 days ago$155k - $230k
...Fortanix: In today's world, where data spreads across various clouds and... ...information safe. Our unified data security platform addresses vulnerabilities in hybrid... ...: We are looking for a Senior/Staff Infrastructure & Platform Engineer to help architect, build, and...Temporary workH1bWorldwideFortanix
Santa Clara, CA17 hours ago- ...Bloom Energy is seeking a Staff Cloud Engineer to join our Cloud Engineering and Infrastructure team in San Jose, CA. You will design, build... ...hybrid infrastructure supporting enterprise apps and AI/data platforms. Lead IaC with Terraform and CloudFormation, champion...Full time
Devopsroles
San Jose, CA3 days ago $188k - $274k
...to technical expert within a significant area of manufacturing engineering (e.g., automation, test, process development, DFX).Help define... ...delivering unparalleled performance, efficiency, and scale.As s Staff Manufacturing Engineer for thermal products, you will be a technical...WorldwideGoogle
Sunnyvale, CA5 days ago$202k - $223k
...About the role Muon Space is hiring a Staff Spacecraft Platform Engineer to be a senior technical owner of our spacecraft bus - the reusable architecture... ...cross-disciplinary system trades (mass, power, thermal, data, cost) and platform requirements development and flow-...Permanent employmentFull timeTemporary workWork at officeRemote workFlexible hours3 days per week- ...storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/... ..., passionate, and committed engineers, technologists, and business leaders... ...is seeking an experienced Staff Systems Validation Engineer to join...Big dataRemote workWorldwide
Supermicro
San Jose, CA18 hours ago - ...PayPal Staff Software Engineer - Promotions Platform in San Jose. You will lead the design and development of React-based web applications that empower PayPal and Venmo marketers to build and manage campaigns across various offer types, raising the bar for engineering...
PayPal
San Jose, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Platform Staff Engineer. Be the first to apply!
- finance data engineer Santa Clara, CA
- data engineer contract Santa Clara, CA
- big data devops engineer Santa Clara, CA
- sr data engineer Santa Clara, CA
- senior data engineer Santa Clara, CA
- entry level big data engineer Santa Clara, CA
- principal data engineer Santa Clara, CA
- etl data engineer Santa Clara, CA
- data engineer manager Santa Clara, CA
- director data engineering Santa Clara, CA