Data Engineer with Scala/Spark and Java
Comtech LLC
Data Engineer With Scala/Spark And Java
Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.
Job Description
Primary Skills:
- Big Data experience
- 8+ years exp in Java, Python and Scala
- With Spark and Machine Learning (3+)
- Data mining, Data analysis
Roles and Responsibilities:
- Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
- Work closely with our engineering team to integrate and build algorithms
- Process unstructured data into a form suitable for analysis – and then do the analysis.
- Support business decisions with ad hoc analysis as needed
- Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
- Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
- Establish and maintain effective processes for validating and updating predictive models
- Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
- Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
- Perform statistical analysis to prioritize in order to maximize success
- Identify areas for improvement, communicating action plans
- Perform strategic data analysis and research to support business needs
- Identify opportunities to improve productivity via sophisticated statistical modeling
- Explore data to identify opportunities to improve business results
- Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
- Gain understanding of business needs and necessary analysis where appropriate through internal discussion
Qualifications
Bachelors or Masters in related field
Additional Information
All your information will be kept confidential according to EEO guidelines.
- ...focused on developing and operating large-scale big data platforms in Sunnyvale, CA. The ideal... ...will have 3+ years of experience in software engineering, particularly with technologies like Java, Scala, and Apache Spark, and be skilled in optimizing performance and...JavaFull timeLocal area
$147.4k - $272.1k
...Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering... ...strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between...Java- ...We are actively looking for Data Engineers (Java/spark) for Sunnyvale, CA or Bentonville, AR Job Title: Sr Data Engineer (Java/spark)... ...modeling & data migration protocols You have experience with Trino, Big Query , Apache Pinot You have experience...JavaContract workImmediate start
- ...Data Engineer GCP Sunnyvale, California, United States Job Title: Data Engineer Location: Sunnyvale Ca Visa: USC/GC/H... ...Airflow pipeline development GCP dataproc/ BQ Expertise Hive/Spark Python/Java expertise (scala) GoogleAds Expertise is a plus (campaign/adsgroups...JavaH1b
- ...Overview: AWS Data Engineers Location- San Jose /Costa Mesa CA Experience- 3-6... ...on and good coding skills, preferably with Java, Scala or Python ~ Data Structures, Algorithm... ...~ Java/Scala, SQL, Python ~ Spark, Hive, Presto ~ Airflow (Preferred...JavaWork experience placement
- ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern data... ...analytics and ML use cases, with strong fundamentals in data modeling... .... ~ Experience in Python, Scala, or Java. ~ Hands-on experience with Spark, Kafka, and Airflow (or similar...Java
- ...update from client for this data engineer role / Request-ID: 13145-1 _... ...Sunnyvale, CA Also look someone with retail clients experience in... ...for Senior Data Engineer with Spark, Scala, GCP experience.... ...programming languages: Python, Java, Scala, etc. • Experience...Java
- ...related 2. 3+ years of solid Java and 2+ years experience in... ...support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase 3. Hands on experience with Unix, Teradata and other... ...databases. Experience with @Scala a plus. 4. Strong communication...JavaFull time
$50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration:... ...Hadoop, Hive, Kafka, Spark Batch and streaming. ~ Exp. with Cassandra. ~ Exp. with... ...search ~ Experience with Java/J2EE & Web Services, Scala/ Python is good to... ...Exp US Exp. Big Data Exp. Current Location...JavaRelocation- ...Job Title: Data Engineer. Location: Sunnyvale, CA. Duration... ...and development experience with relational or MPP databases... ...with Big-Data platforms like Spark, Dremio, Hadoop, MapReduce,... ...Hive etc. ~ Experience with Java, Scala, and Python. ~ Experience...JavaLong term contract
- ...Position: Data Engineer II Location: Sunnyvale, California Duration... ...and systems. Collaborate with cross-functional teams to... ...languages such as Python, Java, or Scala. Experience with data processing... ...frameworks like Apache Spark or Hadoop. Strong...JavaFull timeContract work
- ...Role description Senior Data Engineer Lead I - Data... ...communities in which we live. With us, you'll create a boundless... ...software tools such as Haddop, Spark, Kafka, etc. * Experience... ...languages such as Python, Scala, C++, Java, and Go Experience with Continuous...Java
- ...developer in Sunnyvale, California. This role requires over 5 years of software development experience with strong data engineering skills and proficiency in Python and Java, along with knowledge of relational databases like Oracle and MySQL. The candidate should have...Java
- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines... ..., and loading using Spark (PySpark/Scala) and streaming technologies (Kafka,... ...in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (...Java
$147.4k - $272.1k
...are seeking an exceptional engineer with a background in large scale... ...engineering team that drives Apache Spark’s state-of-the art features... ...-edge technologies to build data intensive systems, designing... ...with JVM languages (Scala or Java preferred), Golang, or Swift...JavaRelocation$99k - $232k
...Specialty/Competency: Data, Analytics & AI... ...in data and analytics engineering focus on leveraging advanced... ...client expectations. With your growing knowledge... ...languages such as Python, Java, or Scala - Familiarity with... ...like Hadoop, Spark, or Kafka is a plus...JavaFull timeH1b- Apple Inc. is seeking a Software Data Engineer for the Apple Games App Data Engineering team in Cupertino, California... ...applications using technologies like Apache Spark, as well as a strong background in Scala or Java. This role includes the opportunity for growth within...Java
$200k - $220k
...Job Summary We are looking for a Data DevOps Engineer with 8+ years of experience to join our ML... ...Experience in setting up multitenant Spark & Kafka clusters. Experience... ...Strong skills in at least Python, Scala or Java. Experience in cleaning, processing...JavaWork at officeRemote workFlexible hours$156k - $316.8k
...Own foundational targeting data and platform capabilities with high availability, accuracy... ...foundational targeting rule engine, access control & auditing... ...hands-on with big data stack (Spark/Hive/Kafka/Flink/Airflow, etc.) - Proficient in Java/Scala/Python; solid engineering...JavaTemporary workLocal area$147.4k - $272.1k
...designed to connect players with incredible games, foster... ...We are seeking a software data engineer to join the Apple Games App... ...applications using Apache Spark or Apache Flink. 5+ years... ...programming experience in Scala (preferred) or Java. Experience with Big data:...JavaRelocation$143k - $286k
...experience. As the Senior Engineering Manager for Agentic Data, you will be at the... ...retrieval, and enriched with the necessary business logic... ...Kafka Streams, Flink, or Spark Streaming). Semantic & AI... ...Rigor: Fluency in Python, Java, or Scala, with a deep engineering...JavaPermanent employmentFull timeTemporary workPart timeFlexible hours$200k - $220k
...communicates. Job Summary We are looking for a Data DevOps Engineer with 8+ years of experience to join our ML... ...Experience in setting up multitenant Spark & Kafka clusters. Experience running... .... Strong skills in at least Python, Scala or Java. Experience in cleaning, processing,...JavaWork at officeRemote workFlexible hours$320k
NVIDIA Gruppe is seeking a Distinguished Engineer for the Apache Spark Acceleration group. This role... ...accelerated Apache Spark, while engaging with open source communities. The ideal... ...systems, and proficiency in C++, Java, and Scala. The position offers a competitive salary...Java- ...Huawei Data Lake Cloud Services Developer As a core member, you... ...Distributed storage and query engine for heterogeneous data sources... ...~ Excellent coding skills in Java or C++ ~ Hands-on experience... ...Components/Frameworks, such as Hadoop, Spark, HBase, HDFS, Hive, NoSQL, and...JavaFor contractors
$45 - $60 per hour
...Responsibilities The Ads Data Team builds and manages... ...to provide students with hands-on experience in... .../Machine Learning Engineers and other stakeholders... ...languages such as Python, Java, Go etc. 4. Solid understanding... ...(e.g. Apache Hadoop, Spark, Kafka, Flink) and...JavaHourly paySummer workInternshipLocal area- ...Overview Need local candidates only. This position is for a Data Engineer with up to 2 years of experience and a Master’s degree. Responsibilities... ...degree in a related field. Experience with PySpark, Hadoop, Scala, and ETL. Preferred Background in machine learning....Local area
- Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities...
$212.8k
...Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem Location: San Jose... ...storage foundation and combine it with the powerful computing... ...in programming languages such as Java, C++, and Scala, with strong coding and problem-solving...JavaTemporary workLocal areaFlexible hours- ...networking technology company in Santa Clara is seeking a Data DevOps Engineer with 8+ years of experience to join their ML/AI team. The role... ...should have strong programming skills in Python, Scala, or Java. This position offers a competitive salary and a flexible...JavaRemote jobFlexible hours
$173.5k - $331.05k
...Senior Data Engineer & Architect Location: San Jose, CA Job Type... ...standards. You'll collaborate closely with Data Scientists, Analytics... ...distributed systems (e.g., Spark, Beam). Work with Data Scientists... .... Proficiency in Scale or Java, plus experience Python & SQL...JavaFull timeTemporary workLocal areaWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with Scala/Spark and Java. Be the first to apply!
- data engineering intern summer San Jose, CA
- senior data integration developer San Jose, CA
- data engineer contract San Jose, CA
- data science developer San Jose, CA
- senior data center engineer San Jose, CA
- software data engineer San Jose, CA
- hadoop big data developer San Jose, CA
- data developer San Jose, CA
- remote data engineer San Jose, CA
- sr data engineer San Jose, CA

