Get new jobs by email
- ...Scala/ Spark Developer Duration: Long term Location: Broadway, NY 3 days onsite Mandatory Skills: Big Data, Scala, Spark, Core Java Experience: As a Spark Scala Developer, you will play a critical role in the design, development, deployment and optimization of data...Suggested
- ...analytics. Job Description Mandatory ·3+ years of experience with Apache NiFi programming ·3+ years of experience with Apache Hadoop and Spark ecosystems of open-source tools. Our data processing and modeling pipelines are built using Hortonworks platform (HDP) ·2+ years...SuggestedPermanent employmentFull time
- ...approaches to build solutions or break down technical problems Develops secure high-quality production code, and reviews and debugs code... .../ technologies: Terraform, EMR, EKS/ECS, Lambda, RDS, S3 and Spark Experience with SQL, Linux/Unix shell and scripting Proficient...Suggested
$133k - $185k
...software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service... ...: EMR, EKS/ECS, Lambda, RDS, Terraform. Experience with Spark and SQL. Overall knowledge of the Software Development Life Cycle...Suggested- Overview Software Engineer III - Java, Scala, Spark, AWS role at JPMorganChase . This position is within Corporate Technology and involves... ...by software code development. Gather, analyze, synthesize, and develop visualizations and reporting from large data sets to support...Suggested
- Quantifind is seeking a Senior Platform Engineer to enhance our Apache Spark pipeline, which generates risk signal results from diverse data sources. You will define and deliver data services and machine learning infrastructure, contributing to the backend that powers our...SuggestedRemote workFlexible hours
- ...from idea to implementation. We believe in active mentoring and developing excellence. We collaborate to find the best answers for our... ...understanding of distributed computing frameworks (e.g., Spark, Hadoop). Exposure to version control systems like Git and CI/CD pipelines...SuggestedLocal areaFlexible hours
- ...leading financial institution in building and optimizing large-scale data processing systems. This role involves working with Hadoop and Spark to ingest, transform, and analyze high-volume market and trading data. The engineer will contribute to the development and maintenance...Suggested
- ...of documents at scale. Contribute to improving and extending our Spark-based distributed data processing pipeline. Help enhance our... ...building data pipelines with distributed compute frameworks like Hadoop. Spark, or Dask Knowledge of Linux/Unix systems, Docker/Kubernetes...SuggestedFull time
$158.6k - $181k
...Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full... ...experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL) ~2+ year experience working on real...SuggestedFull timePart timeInternshipH1bLocal area$90k - $130k
...Experience building and enhance Scala framework and Spark experience Design and develop automated testing framework to perform data validation.... ...high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka. Collaborate with application...SuggestedFull time$45 - $49 per hour
...Full Stack Developer Location: Jersey City, NJ - hybrid onsite Salary Range: $45-49/hr Required Skills & Qualifications... ...Boot Experience with RESTful services and Oracle databases Knowledge of Kafka, Big Data technologies like Hadoop, Sqoop, and Spark...Suggested- ...is part of the job family responsible for developing and maintaining innovative software... ...dashboards. Design and Development of ETL/Hadoop, including stored procedures, queries, performance... ...-scale data sources using SQL, Hadoop, Spark, Hive, Snowflake, Databricks, Teradata or...SuggestedTemporary work
- ...and deliver value for advertisers of all sizesfrom small app developers to big, global brands. Because when advertising is done right... ...contexts such as real-time, near real-time, and batch using Spark, Hadoop, Kafka, Cassandra and beyond. - Collaborate with a team of world...SuggestedRelocation
- ...the business and its technical teams, contractors, and vendors. Develops secure and high-quality production code, and reviews and... ...data lake platforms, such as AWS Redshift, Glue, Databricks, Spark/Hadoop, and Snowflake. Familiarity with workflow orchestration tools...SuggestedFull timeFor contractors
- Job Title Job Description: This is where the detailed job description goes. It provides an overview of the role, responsibilities, and expectations. It's important to highlight the key skills and qualifications required for the position. Key Responsibilities: Here...Remote work
- ...customers Design AWS Data Lake implementations Design and Develop AWS Data Quality and Governance solutions Become a deep... ...Tooling, Services & Libraries: Airflow, Kafka, Parquet, Spark, Metaflow, Git, Hadoop Relevant AWS Services AWS Infrastructure Scripting: CloudFormation...Full timeRemote work
- ...container, and OS deployment, scaling, and management. Ability to develop in multiple programming languages such as Python, Bash, or... ...desired. Experience with big data technologies like: Hadoop, Accumulo, Ceph, Spark, NiFi, Kafka, PostgreSQL, ElasticSearch, Hive, Drill,...
- ...knowledge of object orientated programming and constructing algorithms. Knowledge of big data tools and frameworks such as Apache Spark, Hadoop, Kafka and Elasticsearch. A USA Citizen, Resident, Green card holder or possess a valid H1B. Achieved a very good degree in...Currently hiringH1b
- ...we are EvolutionaryScale’s mission is to develop artificial intelligence to understand biology... ...processing pipelines using tools like Spark and Ray, for acquiring biology datasets.... ...processing systems using technologies such as Hadoop, Spark, or Ray. Knowledge of streaming...H1bVisa sponsorship
- ...experience delivering Java / JEE Business Solutions 2. Experience in Building Microservices 3. 3+ years’ experience developing solution on Hadoop/Spark 4. 4+ years developing on an RDBMS such as PostgreSQL, MySQL or Oracle 5. Design, build and maintain near real-...
$160k - $220k
...in Manhattan. Your role and responsibilities will include: Developing data infrastructure to ingest, sanitize and normalize a broad... ...of databases and large-scale data processing frameworks like Hadoop or Spark and the ability to evaluate which tools to use on the job A...Work at officeFlexible hours- ...pipelines with data processing frameworks like Scalding, Scio, Storm, Spark, and the Google Cloud Platform. Leverage best practices in... ...heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, and Cassandra. You are knowledgeable about data modeling...
- ...premise with distributed computing and emerging technologies. Develops secure and high-quality production code, and review and debug... ...building ETL/Data Pipeline and data platforms (e.g., Databricks, Spark/Hadoop, and Snowflake). Knowledge of workflow orchestration tools (e....
$240k - $280k
...established AI/ML and Search organization, you will be instrumental in developing and optimizing advanced models to enhance our ultra-low-... ...in Python and proficiency with distributed frameworks (Spark, Hadoop), SQL, and cloud infrastructure. Experience with ML packages...Summer workWorldwide$104.29k
...and deployment of desktop and web-based software solutions. Develop, design, and deploy desktop and web-based software solutions... ...distributed big data management and analysis systems including Hadoop, Spark, and Cassandra. Develop and Implement mapping systems that...Part time- ...leveraging AWS, Azure, and Google Cloud Platform services. Develop data lake, data warehouse, and real-time streaming solutions... ...Cassandra, etc.). Proficiency in big data & analytics frameworks (Spark, Kafka, Hadoop). Experience with ETL/ELT tools (Informatica, Talend, dbt,...Hourly payLong term contractPermanent employmentContract workLocal area
$90 - $110 per hour
Overview Python Developer (Core Python) with Heavy Data - Newark, NJ. A large asset manager is looking for this role. Local... ...and work as a team Desired Skills: Experience with Spark Experience working in Hadoop or other Big data platforms Exposure to deploying code through...Work experience placementLocal areaRelocation$175k - $215k
DESCRIPTION: Duties: Design, develop and implement software solutions. Solve business problems... ...for ETL; Python; Shell scripts; Talend; Spark framework; Cloud services such as AWS or... ...; SOAP and REST web services; Cassandra; Hadoop; Linux; Software development; SQL;...Full time- ..., and responsive ratings to the customer. We are looking for developers with a passion for building software to collect, aggregate, and... ...Experience with Python Experience with technologies such as Hadoop, Spark, Elasticsearch Experience with NoSQL data warehouses such as...Remote work