Senior Spark Engineer
My3Tech Inc
Senior Spark Engineer
This is a senior-level role to create the first POC around their planned use for Spark. Strong experience doing setup and configuration. Strong ability to setup the Spark cluster, establish best practices and work through lead level functions to get it set up correctly for function, integration and performance.
Technical skills required:
- Spark cluster configuration and performance
- Presto configuration and performance
- pySpark and Spark based ML and Python notebooks
- Kubernetes
- Kafka/Pulsar familiarity helpful
- Devops automation Python, ansible, terraform etc.
- Oracle database performance + S3/Spark/Presto integration
- Some knowledge of Hadoop infrastructure
- Able to write shell script / python glue as needed
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Spark Engineer in United States vacancy
- 1. Job Title : Sr Bigdata & Spark Engineer 2. Job Summary : PFB 3. Shift : General 4. Roles & Responsibilities :PFB 5. Demand requires Travel? :NO 6. Certification(s) Required :NO Skill Set : HDFS Spark Hive MapReduce Scala JAVA Linux Spring SVN/GIT HBase Detailed Job...SeniorWork experience placementSecond jobFlexible hoursShift work
Avani Technology Solutions
Phoenix, AZ16 days ago - ...Smile Digital Health is seeking a Senior DataOps Engineer for a remote role in the US. This position is crucial for managing the data analytics... ...Responsibilities include automating CI/CD workflows and operating Spark-based systems. The company emphasizes its commitment to...SeniorRemote work
TryApplyNow
New York, NY3 days ago - Solita Oy is looking for a Senior Data Engineer & Databricks Specialist to join their team in Germany. This role offers a start-up style atmosphere... ...4 years in data engineering and is proficient in Apache Spark, SQL, and fluent in both German and English. Solita fosters...Senior
$86k - $140k
...Services is seeking a skilled professional for a role in Austin, Texas. The ideal candidate will possess strong experience in Apache Spark with Scala and excellent leadership skills. Responsibilities include acting as a primary onsite coordinator and fostering effective...Senior- A leading organization in the data and technology sector is seeking a Sr. Data Engineer (Apache Spark) to enhance their data solutions. This role involves consulting on complex software engineering tasks, developing frameworks, and collaborating with teams to meet deliverables...Senior
$110.7k - $171.8k
Visa is seeking a Senior Data Engineer in Austin, Texas. This hybrid role focuses on designing and optimizing scalable data pipelines and supporting... ...a relevant field, and a strong grasp of tools like Apache Spark and SQL. The estimated salary range is $110,700 to $171,800...Senior- Role: Sr Spark Engineer with Databricks I Location: Minneapolis, MN/Hybrid/Remote Duration: 6+ Months Experience: 7- 9 Years Must Have Skills: • ADF • Spark • Scala • Azure Data Bricks • SnowflakeSeniorRemote work
Zortech Solutions
Minneapolis, MN1 day ago - ...SR.BIGDATA ENGINEER WITH PYTHON SPARK SQL SHELL SCRIPTING. working experience in Big Data technologies (Hadoop Spark Kafka MAPR (plus) HDFS Spark Hive MapReduce Scala JAVA Linux Spring HBase ) Proven track record of architecting designing and implementing • Experience...SeniorWork experience placement
Avani Technology Solutions
Phoenix, AZa month ago $100k - $125k
Tata Consultancy Services is looking for an experienced SRE with Data Engineer skills in Phoenix, Arizona. The role requires in-depth knowledge of the Hadoop ecosystem, cloud platforms, and robust analytical skills. Candidates are expected to design scalable big-data solutions...Senior- ...Sr. Spark + Hive Engineers 5+ years of IT experience. 2+ years of hands-on Spark experience is required. Strong background in Scala or Java programming. Experience with Hadoop – deep understanding of internals of Hadoop, Hive, Oozie, MapReduce, Sqoop. Should be proficient...SeniorWork experience placement
ClifyX
Sunnyvale, CA11 hours ago - ...Job Title: Senior ETL Engineer Location: Remote Required Skills (minimum 5 years) IBM DataStage (or similar) Event Streaming: Kafka/Kafka stream and spark stream, etc. Cloud experience - this is future. DB2, SQL Server - this is current....SeniorRemote work
HCL Global Systems
Minneapolis, MN11 hours ago - ...Position: Senior Data Engineer Location: Jersey City, NJ (2-3 times per week) Responsibilities Work with developers and... ...Familiarity with other big data technologies (Hadoop, Spark, Kafka, etc.). Experience with version control systems...Senior
Futran Tech Solutions Pvt. Ltd.
Jersey City, NJ2 days ago - ...in Computer Science or equivalent Strong development and coding experience in one or more programming languages such as Java, Scala, Spark, and Python Expertise in Data Structures, Algorithms, and Concurrency Experience with Micro‑services Architecture, multi‑threading,...Senior
Framework Ventures
New York, NY3 days ago - ...rewarding 10% 401k match. Join a team that values your unique spark and empowers you to solve real-world challenges using bleeding-... ...technology. The Role Our client is seeking a Dataflow Engineer to design, implement, and manage complex data pipelines and...SeniorFor contractors
stanleyreid.com
Annapolis, MD3 days ago - ...Job Title Data Engineer Job Summary We are looking for a skilled Data Engineer to design, build, and maintain scalable... ...Microsoft Experience with big data technologies: Apache Spark Hadoop Kafka Familiarity with data warehousing...Senior
Ova Technologies
Alpharetta, GA11 hours ago - ...team solving these complex problems, then Rotary and Mission Systems is the place for you. THE WORK We are seeking a talented engineer to report directly to the Manager of RF & Microwave Engineering. The Sr RF Engineer will significantly contribute to the design...SeniorFlexible hours
Lockheed Martin
Moorestown, NJ11 hours ago $150k - $190k
...both safe, fast, observable, and boring. We are looking for a Senior Engineer who thinks like a platform builder first. We are shifting from... ...bridging Snowflake and Databricks Hands-on Databricks or Spark Kubernetes experience Snowflake certification(s) Azure...SeniorRemote workShift workDatavant
Jefferson City, MO5 days ago$59.53 - $67.53 per hour
...Genesis10 is currently seeking a Senior Containerization Engineer - Hybrid position with a Global Financial Institution located in Charlotte, NC.... ...Familiarity with big data technologies such as Apache Spark, Hadoop, or Kafka Experience with cloud platforms such...SeniorHourly payPermanent employmentContract workGenesis10
Charlotte, NC12 days ago$113.05k - $218.15k
...heavier atomic nuclei which are steered into collisions. Beyond sparking scientific discoveries in a new frontier of fundamental... ...Collider (EIC) directorate has an opening in the RF Group for a Senior SRF Engineer with experience in surface processing and clean assembly of...SeniorFor contractorsWork at officeWork from homeNight shiftWeekend work1 day per weekBrookhaven LAB
Upton, NY1 day ago- ...military base, Ditto's peer-to-peer sync engine ensures devices stay connected and data stays... ...future of edge data synchronization as a Senior Software Engineer at Ditto! We are... ...Curiosity. Adaptability. And a genuine spark for what we're building. So if you...SeniorRemote workFlexible hours
Ditto
United States3 days ago $136k - $218.5k
NVIDIA’s invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. More recently, GPU deep learning ignited modern AI — the next era of computing — with the GPU acting as the brain...Senior$150.4k - $190.2k
...is truly sustainable. If the idea of building out the future sparks your imagination and intersects with your skills, we'd love to meet you. Role Overview Pebble is seeking a Senior HV & Drivetrain Engineer to own the design, integration, and continuous improvement of...SeniorFlexible hours- ...Data Engineer Location: Hybrid onsite (Mclean, VA) Duration: 6-12 Months – (With possible extension) Must Haves Overall... ...years SQL – 3 years Python (building data pipeline) – 3 years Spark – 3 years Big Data/Hadoop Unix/Shell Scripting...Senior
Samprasoft
McLean, VA3 days ago $100k
...Splunk, Elastic), big data/data lake query platforms (e.g. Apache Spark), or relational database. ~ Programming experience with at... ...financial, and/or other benefits. Location The Galvanick engineering team is based in Seattle. Given that we are an early-stage...SeniorPermanent employmentWork at officeRelocationGalvanick
Seattle, WA20 days ago$168k - $264.5k
...reinvented itself over two decades. Our invention of the GPU in 1999 sparked the growth of the PC gaming market, redefined modern computer... ..., high performance op-amps etc. Work closely with mask design engineers to deliver the physical design as well as work with...Senior- ...Senior Engineer- DevOps Location: Phoenix, AZ or Scottsdale, AZ Duration: Full Time Job Description: DevOps, AWS EKR, EMR, Lake Formation... ...with AWS EMR internals and big data ecosystem tools (Spark, Hive, Presto). • 3+ years of experience in big data environments...SeniorFull time
JConnect Infotech
Scottsdale, AZ3 days ago $130.8k - $241k
At Deloitte, Forward Deployed Engineers (FDE) don't just build AI solutions, they help clients... ...ends on 10/12/2026. Work you'll do As a Senior Snowflake FDE, you will work side by side... .... Data engineering experience with Spark, Airflow/dbt, streaming, data modeling or...SeniorVisa sponsorship- ...assignment for the duration of the assignment period. Must Haves: 3 years of Spark, 2 years in SQL, Python Qualifications: ~ Bachelor’s degree in Computer Science, Engineering, Data science or a related quantitative field. ~5-6 years of relevant experience...Senior
Samprasoft
McLean, VA3 days ago - ...Senior DeltaV Engineer at Novo Nordisk Engineering If you're energized by designing and delivering DeltaV solutions in large-scale pharma projects... ...can read more about the benefits we offer here. Did we spark your curiosity? If you're ready to join our passion, let's...SeniorCasual workRemote work
NNE
United States1 day ago - ...got the power to energize Your career and spark YOUR Work/Life Balance through... ...an inclusive meaningful career in power engineering design at Mesa Associates, Inc. Mesa... ...voltage levels from 34.5K to 500kV. As a Senior Engineer, this individual will be expected...SeniorWork at officeWork from homeVisa sponsorshipWork visa
Mesa Associates, Inc.
Knoxville, TN6 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Spark Engineer. Be the first to apply!
Related searches
- senior game producer United States
- senior manager process engineering United States
- senior manufacturing engineer United States
- senior director fp&a United States
- senior manager clinical operations United States
- senior community manager United States
- senior optical engineer United States
- senior lead project manager United States
- senior manager quality engineering United States
- senior device engineer United States