Data Engineer with Scala/Spark and Java
Comtech LLC
Company Description
Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.
Job Description
Primary Skills:
- Big Data experience
- 8+ years exp in Java, Python and Scala
- With Spark and Machine Learning (3+)
- Data mining, Data analysis
Roles and Responsibilities:
- Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
- Work closely with our engineering team to integrate and build algorithms
- Process unstructured data into a form suitable for analysis – and then do the analysis.
- Support business decisions with ad hoc analysis as needed
- Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
- Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
- Establish and maintain effective processes for validating and updating predictive models
- Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
- Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
- Perform statistical analysis to prioritize in order to maximize success
- Identify areas for improvement, communicating action plans
- Perform strategic data analysis and research to support business needs
- Identify opportunities to improve productivity via sophisticated statistical modeling
- Explore data to identify opportunities to improve business results
- Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
- Gain understanding of business needs and necessary analysis where appropriate through internal discussion
Qualifications
Bachelors or Masters in related field
Additional Information
All your information will be kept confidential according to EEO guidelines.
Summary
- Type: Contract
- Function: Information Technology
- Experience level: Executive
- Industry: Information Technology And Services
- ...Data Solutions EngineerManager Note: I am looking for a candidate who is very strong with Spark SQL and Scala programming.Data Solutions Engineer Responsibilities: As a part of our Big Data Product team,... ...programming experience in Scala, Java or PythonExperience with...JavaWork experience placement
- ...security, and enterprise content/data management services. We... ...EngineerSan Jose, CA3 +(with possibility of extension)•... ...• 8+ years exp in Java, Python and Scala• With Spark and Machine Learning (3+)•... ...).• Work closely with our engineering team to integrate and build...Java
- ...Big Data Developer (Spark)Greetings for the day! My name is Suneetha from Testing Xperts, we are a global staffing, consulting and technology... ...monthsInterview: Phone and SkypeJob description:Spark and Scala, Java, Hadoop MRUnixDesired years of experience: 10-12 years of experienceEducation...JavaWorldwide
- ...Hadoop DeveloperThis engineer should come from the... ...will be in support of data curation, ingestion,... ...and Hive is required with understanding of partitioning... ...strong knowledge of Spark on either Python or Scala. Basic Spark... ...such as ftp/scp/ssh/Java/Python/SQL/etc. Our Enterprise...Java
- ...Sr Data Engineer With GCP, Spark, PythonSunnyvale, CA (Onsite) Long TermRequirements:GCP Experience• 2+ years of recent GCP experience• Experience... ....• Experience with programming languages: Python, Java, Scala, etc.• Experience with scripting languages: Perl, Shell,...Java
$184.7k - $324.8k
..., it benefits everyone.The Data Products Engineering team is seeking versatile data... ...critical pipelines, with strong ownership of quality... ...batch execution contexts using Spark, Kafka, and Iceberg- Deliver... ...languages (for example Scala, Java, or Python) and ease with picking...JavaRelocation$184.7k - $324.8k
...better. Apple Services Engineering's Device Compute... ...Analytics team provides the data foundation for Apple's... ...performing team, work with colleagues across... ...will build and run the Spark pipelines, design the... ...formatsProficiency in Java or Scala, and strong SQLExperience...JavaRelocation- ...Big Data EngineerSan Jose, CA (Remote)ExperianNeed 8 years of experience and... ...or more programming languages like Java, Scala or PythonGood experience with distributed systems like Hadoop, HDFs and No SQL databasesExperience in Spark, Hive or PrestoExperience with AWS cloud...JavaRemote work
$224k - $356.5k
...looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in data... .... You will work with the open source community... ...CUDA.Experience coding in Scala, Java, and/or C++.NVIDIA is widely...JavaFull time$184.7k - $324.8k
...Infrastructure (MSI) team is an engineering organization under the... ...factory sites.As an AI Data & Infrastructure Engineer with the MSI team, you will... ...SQL, with proficiency in Java or Scala preferred.Experience with... ...streaming data pipelines using Spark (PySpark), Kafka, Airflow...JavaRelocation$184.7k - $324.8k
...software in the world?The Core Data & Intelligence organization... ...Data and Applied AI Engineer with a strong background in distributed... ...-scale data pipelines with Spark and other distributed data... ...in at least one of Java, Python or Scala, with strong SQL skills.Deep...JavaWork experience placementRelocation$184.7k - $324.8k
...help shape how AI and modern data engineering & analytics come together to... ..., or ML engineering, with the last 3+ years building and... ...SQL engine (Trino, Presto, Spark) as in the model-serving layer... ...high-level language (Python, Scala, Java, or Go), strong SQL, and the...JavaRelocation- ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases....Java
- ...Sr Data Engineer (Java/spark)Location: Sunnyvale, CA or Bentonville, AR (Hybrid) Job Type: ContractRate: DOE* W2 candidates are strongly preferred... ...modeling & data migration protocolsYou have experience with Trino, Big Query, Apache PinotYou have experience with data...JavaImmediate start
$184.7k - $324.8k
...streams of multimodal data (including structured,... ...By enriching this data with language and embedding... ...seeking an experienced Data Engineer with deep expertise in... ...including Apache Spark Strong experience... ...proven experience with Scala, Java Hands-on experience...JavaRelocation$117k - $234k
...and deploy scalable, intelligent data solutions that support millions of... ...and act on this data. Partner with engineering, AI/ML, and product teams to ensure... ...clean, testable code in Python, Java, or Scala; experience with PySpark/Spark for distributed data processing....Java- Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob... ...and systems.Collaborate with cross-functional teams to... ...programming languages such as Python, Java, or Scala.Experience with data processing frameworks like Apache Spark or Hadoop.Strong knowledge of...JavaFull time
$150.4k - $277.6k
...everyone.The Apple Ads Data Governance team develops... ...leverage advanced data engineering and machine learning... ...involves collaborating with cross-functional teams... ...experience in Python, Java, Rust or similar languages... ...tuning of Datahub, Apache Spark, Flink, Hive, Hadoop/...JavaRelocation$143k - $286k
...PermanentCompany: WalmartStaff Data Engineer designs and builds high-... ...Engineers reliable systems with predictable latency, throughput... ...and markets.Optimize Spark, Kafka, BigQuery, Dataproc,... ...Airflow.Strong Python skills plus Java or Scala proficiency.Knowledge of data...JavaFull timeTemporary workPart time- ...skills and experience — talk with your recruiter to learn more.... ...refactoring, and optimizing real-time data processing applications using... ...applications using Apache Spark. Migrating real-time data... ..., Apache Flink, Apache Spark, Java or Scala (preferably Scala). Seniority...JavaContract work
- ...Job TitleRequired Skills: Java, Python, Scala, API development, GQL, Node.js, Hadoop, Hive, Spark using Scala, Vertex AI, Presto/Trino, Kubernetes, Automic, Airflow and Data Lake concepts, Luigi, Experience with stream-processing systems: Storm, Spark-Streaming, etc....Java
$150.4k - $277.6k
...Senior Data EngineerImagine what you could do here. At Apple... ...are seeking an exceptional engineer with a background in large scale... ...engineering team that drives Apache Spark's state-of-the art features... ...with JVM languages (Scala or Java preferred), Spark, Golang, or...JavaRelocation$65 per hour
...platforms. We partner with startups and Fortune 50... ...currently looking for a Data Engineer to support our client in... .... 3+ years of hands-on Java development experience.... ...including: Hive, Spark, Impala, HBase, Apache... ...Experience with Java, Scala, and Python development...JavaLong term contractLocal area$149.2k - $249k
...critical in building the data infrastructure to... ...an AI Data & Knowledge Engineer, you will develop infrastructure... ...development experience with cloud database environments... ...languages like Python, Java, R and open-source... ...processing like Hadoop and Spark.Experience building data...JavaRelocation$184k - $287.5k
...Senior Systems Software Engineer for the Apache Spark Acceleration group. GPU accelerated data processing has moved... ...accelerate Apache Spark with an open source plugin... ...on Kubernetes: the Java REST API, the Spark Connect... ...workload router in Scala and Java, including interoperability...JavaFull timeRemote work$72k - $108k
Data Engineer The Role UST is searching for a Data Engineer with spark and streaming skills builds real-time, scalable data pipelines... ...and loading using Spark (PySpark/Scala) and streaming technologies (... ...BigQuery, Apache Airflow, Spark/Java/ PySpark Nice to have: GCP,...JavaFull timeTemporary workPart timeWork at officeLocal areaFlexible hours- ...Atlassian is looking for a Data Engineer to join our Data Engineering team... ...practices, drive the approach with which we use data, develop backend... ...skills using Python or Java.Working knowledge of relational... ...scalable data pipelines using Spark (SparkSQL) with Airflow scheduler...JavaWork at officeLocal area
- ...Java Developer With ScalaLocation: Sunnyvale, CAPosition Type: Full TimeSalary: DOE US Citizen, Green Card and GC EAD Only... ...7-8 yearsSkills:Java/J2EE, Open source frameworks and tools, Comfortable with development in Scala.Good to have - Knowledge of Apache Spark...JavaH1bVisa sponsorship
- ...development experience in Big Data, NoSQL Databases. Strong development Experience in Storm, Spark, HDFS, Hive and Big Data related... ...components.Deep Understanding of JAVA, Linux/Unix.Analysis and... ...analytics.Ability to work and liaison with teams across business units....Java
- ...development experience in Big Data, NoSQL Databases. Strong development Experience in Storm, Spark, HDFS, Hive and Big Data related... ...components.Deep Understanding of JAVA, Linux/Unix.Analysis and... ...analytics.Ability to work and liaison with teams across business units....JavaPermanent employmentFull timeH1b
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with Scala/Spark and Java. Be the first to apply!
- entry level big data engineer San Jose, CA
- big data engineer San Jose, CA
- senior data engineer San Jose, CA
- big data cloud engineer San Jose, CA
- senior data center engineer San Jose, CA
- junior data engineer remote San Jose, CA
- data engineer machine learning San Jose, CA
- director data engineering San Jose, CA
- data engineer San Jose, CA
- data engineer graduate San Jose, CA


