...Strong expertise in design and development on cloud data warehouses like Snowflake, Redshift, BigQuery and Big-Data platforms like Spark, Dremio, Hadoop, Hive
+ Proficiency in design and development of custom ETL pipelines using SQL and scripting languages (Python/ Shell...
Suggested
Worldwide
Relocation
...and load balancer configurations.
+ - Knowledge of RDBMS concepts including databases, tables is a plus.
+ - Knowledge of Apache Spark is a plus.
+ - Knowledge of containerization (Docker, Kubernetes, vagrant and micro-services) is a plus.
+ - Participation in an...
Suggested
Relocation
...plus:
+ - Practical knowledge of cloud infrastructure and implementation of scalable automation solutions (e.g. Kubernetes, AWS, Spark, Celery, Postgres, RabbitMQ)
+ - Practical knowledge of system integration issues in hardware design
+ - Exposure to sampled systems...
Suggested
Relocation
...Requirements**
+ While the following are not necessary, these skills would be advantageous:
+ Experience with big data technologies like Spark, HDFS, Iceberg or any distributed data storage.
+ Knowledge of Continuous Integration and Continuous Delivery, along with the...
Suggested
Relocation
...Elastic Search etc.)
+ Expertise in NoSQL datastores ( e.g Cassandra )
+ Proficiency in data processing technologies (e.g Kafka, Spark, Flink )
+ Experience designing scalable micro services.
+ Familiarity with cloud paradigms ( e.g AWS )
+ Demonstrated ability to...
Suggested
Worldwide
Relocation
...Experience with data acquisition tools (e.g. SQL), data mining and data visualization. Familiarity with big data technologies eg: Hadoop, Spark, Hive. Strong background in machine learning libraries and frameworks such as Scikit Learn, TensorFlow, PyTorch Familiarity with...
Suggested
Worldwide
Relocation
...+ Proficiency working with large datasets, cloud database platforms and SQL.
+ Working experience in but not limited to Hadoop, Spark/PySpark, Hive, Kafka and NoSQL databases a plus.
+ Experience in applying ML techniques in manufacturing and testing space is a major...
Suggested
Work experience placement
Relocation
...solving skills and self-driven
· Excellent expertise in Object oriented programming Java.
· Experience in distributed systems like Spark and Kafka.
· Experience in Data Catalog tools like DataHub.
· Good understanding of AWS Cloud ( S3 , RDS, IAM, Docker,...
Suggested
Hourly pay
Holiday work
Contract work
Temporary work
For contractors
Local area
Worldwide
...product or academic-research
+ Track record of building data science solutions
+ Some experience in data processing / modelling using Spark
+ Familiarity with distributed data platforms
+ Working knowledge of data science production process (unit tests, data pipelines...
Suggested
Relocation
...present data to the customer
+ Proficiency in SQL and experience with at least one major data analytics platform, such as Hadoop, Spark, or Snowflake.
+ Experience in maintaining data definitions, data quality rules, data lineage, and data dictionary
+ Hands-on experience...
Suggested
Relocation
...commercial and/or open-source large-scale data processing, ML training and inference, storage frameworks, and platforms such as Apache Spark, Apache Flink, Ray, etc
+ Experience optimizing frameworks and infrastructure that leverage large-scale GPU-accelerated hardware...
Suggested
Work experience placement
Relocation
...cloud platforms like AWS, GCP, or Azure, and Monitoring tool like Grafana, and CI/CD like airflow, gitlab, and Big Data management like Spark, Kafka.
+ A thought leader having a good balance of business acumen, domain and technical expertise.
+ Excellent presentation,...
Suggested
Worldwide
Relocation
...complex requirements from business communities.
+ 5+ years of work experience with large scale technologies such as Single Store, Spark, Microservices, Kafka, etc.
+ Proficiency in the Agile software development lifecycle.
+ Fundamental grasp of computer science basics...
Suggested
Temporary work
Work experience placement
Relocation
...Working knowledge and experience with big data.
~ Strong working knowledge of Python, SQL, and Git. Basic knowledge of SQL databases, Spark, data warehousing, and shell scripting.
~ Candidate must have solid competency in statistics and the ability to provide value-...
Suggested
Contract work
Immediate start
Start working today
...experience training and evaluating ML models with accurate pipelines and metrics
+ Proficiency in working with distributed system, Hadoop, Spark, etc.
+ Proven programming skills, with proficiency in Python, Java, etc.
+ Proficient in design, implementation and maintenance...
Suggested
Relocation
...people we're looking for:
Have a growth mindset and wants to be part of a high performing and understanding team
Is a positive spark, doesn't take things too seriously, but is still professional and values personal connections
Up for a challenge, you thrive in a...
Casual work
Flexible hours
Weekend work
...driven.
Requirements:
Excellent expertise in Object-oriented programming Java.
Experience in distributed systems like Spark and Kafka.
Experience in Data Catalog tools like Datahub.
Good understanding of AWS Cloud (S3, RDS, IAM, Docker,...
Contract work
...teams to understand the requirements and translate them into technical solutions.Key Qualifications
Exceptional skills in Scala and Spark
Hands on experience with data processing technologies, ETL processes and feature engineering
A track record of developing...
Contract work
Immediate start
...analytics
problem solving skills and self-driven
expertise in Object oriented programming Java.
in distributed systems like Spark and Kafka.
in Data Catalog tools like DataHub.
understanding of AWS Cloud ( S3 , RDS, IAM, Docker, Kubernetes)....
Hourly pay
Holiday work
Contract work
Temporary work
Local area
...experience must
Job Description:
O Data Infrastructure Kubernetes / EKA on AWS / Kube on GCP / Cluster build / OS installation / Spark Jobs / Flink / Snowflake / Schedulers / Multi tired storage (S3 / Glacier Equal)
O Responsible for overall program management...
Full time
...fantastic user experiences!
**Key Qualifications**
+ Expert understanding in Linux based systems and deep expertise in Hadoop/YARN/Spark based technologies
+ Hands on experience with AWS /EMR, S3, Glue, Athena and Kubernetes Infrastructure
+ Expertise in designing,...
Relocation
...Language Models, Reinforcement Learning, TensorFlow, and PyTorch
+ Experience building big data pipelines with Hadoop, Java, Scala, and Spark
+ Familiarity with A/B experimentation and data/data-driven product development
+ Experience leading technical aspects for...
Worldwide
Relocation
...data processing for Siri and Search. You will build a unified and groundbreaking data processing framework on device and server using Spark, and/or Flink. You will collaborate closely with other teams to transform raw data from device into useful datasets for Machine...
Relocation
...Messages, Lookup, etc. - Building end-to-end production system including query understanding and ranking to power search - Utilizing Spark, Hadoop MapReduce, Hive, Impala to perform distributed data processing
**Education & Experience**
MS or PhD in Computer Science,...
Relocation
...experience with SRE and Big Data/
O Data Infrastructure Kubernetes / EKA on AWS / Kube on GCP / Cluster build / OS installation / Spark Jobs / Flink / Snowflake / Schedulers / Multi tired storage (S3 / Glacier Equal)
O Responsible for overall program management...
Full time
Immediate start
...chants, songs and perform skits in opening and closing ceremonies.
Seek out opportunities to lend your skills and experience to spark joy at camp.
Receive ongoing coaching to grow your instruction and operations experience:
Receive paid online training before...
Full time
Work experience placement
Summer work
Seasonal work
Local area
Outdoor
Shift work
Sunday
Monday to Friday
...CI/CD.
+ Familiarity with containerization, cloud platforms such as AWS or GCP, and data pipeline technologies such as Kafka and Spark.
**Description**
Design and develop tools for functional integration tests, including developing mocks and managing test data libraries...
Relocation
...+ 5+ years of industry experience working with batch or streaming distributed data processing technologies (e.g. Hadoop, MapReduce, Spark, Flink, Kafka, Presto, etc.) for building efficient & large-scale data pipelines.
+ 3+ years of data modeling experience designing...
Relocation
...communicating information (e.g. Tableau, Superset, ggplot).
+ You have engineered information out of massive and complex datasets (e.g. Hive, Spark, Druid).
+ You have proven experience in SQL and at least one programming language (e.g. Python, R, Scala) and are comfortable...
Relocation
...our security posture. We embrace the use of open source technologies including Kubernetes, Ranger for secured compute platform and Spark, Flink, Trino, Iceberg for data processing. RESPONSIBILITIES INCLUDE: - Define and drive technical vision, roadmap, and strategy for...
Relocation