Get new jobs by email
$70 - $80 per hour
...About the Role: We are seeking a highly motivated and results-driven Contract Recruiter to own niche technical hiring for Crusoe's Spark business. This is a specialist search role covering hard-to-fill manufacturing and engineering positions such as Manufacturing...SuggestedHourly payFull timeContract workCrusoe
Indiana29 days ago- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...SuggestedFull timeLocal areaImmediate startRemote work
- ...connect and protect our customers with inventive electrical solutions. People are our most valuable asset. Inclusion and diversity means that we celebrate and encourage each other's authenticity because we understand that uniqueness sparks growth. #J-18808-Ljbffr nventSuggestedFull timeTemporary workWork at officeWorldwideFlexible hours
$165k - $190k
...governance disciplines-quality, lineage, cataloging, MDM, and access control. ~ Proficiency in SQL and Python; familiarity with R and/or Spark a plus. ~ Experience integrating with or sourcing data from ERP (D365 F&O or comparable) and operational/industrial systems...Suggested- ...Factory. Develop Lakehouse solutions using Microsoft Fabric. Design data warehouses using Synapse Analytics. Develop Spark notebooks. Build real-time ingestion pipelines. Implement data governance using Microsoft Purview. Optimize Power BI...Suggested
- ...Computer Vision, or Deep Learning projects. Familiarity with Vector Databases (Pinecone, FAISS, ChromaDB, Weaviate). Exposure to Spark, Hadoop, or Databricks. Excellent analytical, problem-solving, and communication skills. Bachelor's or Master's degree in...SuggestedFull timeRemote work
- ...technologies like Azure Synapse, Azure SQL, Amazon Redshift, Snowflake, Google Big Query etc. Strong experience with big data tools (Databricks, Spark etc.) and programming skills in PySpark and Spark SQL. For applications and inquiries, contact:****@*****.***...SuggestedLocal area
$118.8k - $205.92k
...Dimensional Modeling, Normalized models, OBTs etc. Must have knowledge of one or more of ETL/ELT tools like AWS Glue, DBT, SSIS, Apache Spark, Informatica. 3 + years of hands-on experience of working on modern columnar data platforms like Snowflake, AWS Redshift, Azure...SuggestedFull timeTemporary workWork experience placementCasual workWork at officeLocal areaRemote work- ...by integrating Azure Data Factory (ADF) with on-premise databases, cloud storage (ADLS Gen2), and Databricks activities. Optimize Spark configurations and cluster utilization to drastically reduce cloud compute overhead and job execution windows. Enforce data...Suggested
- ...quality, governance, and observability frameworks. Nice to Have Snowflake Streams, Tasks, Snowpipe. DBT Cloud. PySpark or Spark. Terraform or Infrastructure as Code. Monitoring and alerting tools. Qualification ~ Bachelor's degree in Computer...SuggestedFull time
- ...GitHub action, gitlabCI Preferred Tech Stack LangChain / LIamaIndex / Semantic Kernel Vector DBs (Pinecone, FAISS) Kafka, Spark Kubernets, Docker Azure OpenAI , AWS Bedrock Camunda (for Workflow/ migration context) About NTT DATA NTT DATA is a...SuggestedWork at officeRemote workFlexible hours
- ...Pipeline Engineering: Design, build, and maintain scalable ETL/ELT pipelines using Microsoft Fabric (Dataflows Gen2, Pipelines, Notebooks, Spark) alongside legacy SSIS workflows. Medallion Architecture: Implement Bronze, Silver, and Gold layers utilizing Delta Lake,...SuggestedFull timeContract workRemote workShift work
- ...Transaction Monitoring changes within a bank or regulated financial institution. Experience with the Transaction Monitoring SMBD Spark engine, including profiling, segmentation and scenario processing. Strong SQL and relational database experience. Experience handling...SuggestedWork at officeRemote workFlexible hours
- ...and consumption layers. Develop scalable data pipelines and Lakehouse solutions utilizing Databricks, Delta Lake, Unity Catalog, Spark, and cloud-native services. Collaborate with Data Engineers, Data Architects, Governance teams, and platform teams to establish delivery...SuggestedWork at officeRemote workFlexible hours
- ...it Click here to find out more about the benefits we offer. How We Give Back to the Community: You can learn more about our Q2 Spark Program, Q2 Philanthropy fund, and our employee volunteering programs on our Q2 Community page . Q2 supports dozens of wide-reaching...SuggestedFull timeWork experience placementLocal areaRemote workWork visaFlexible hours
- ...Skilled in data visualization tools and libraries (Tableau, Power BI, Matplotlib, Seaborn) - Familiarity with big data platforms (Spark, Hadoop) and SQL databases - Knowledge of cloud-based ML platforms (AWS SageMaker, Azure ML, GCP AI Platform) - Understanding of...
- ...schemas, Data Vault, Kimball, Inmon). • Familiarity with data lake architectures and distributed processing frameworks (e.g., Spark, Hadoop). • Experience with version control tools (GitHub, Bitbucket) and CI/CD pipelines. • Understanding of data governance...Work at officeRemote workFlexible hours
- ...data pipelines to migrate existing ETL workloads to the Databricks Lakehouse. Develop data transformations using Python, PySpark, Spark SQL and Databricks SQL . Implement Bronze, Silver and Gold layer processing following established project architecture and...Work at officeRemote workFlexible hours
$140k - $160k
...with Microsoft database stack: SQL Server/SSIS/SSAS/SSRS ~ 5+ years' experience with Microsoft Azure BI Stack: Delta Lake/Databricks/Spark ~ Experience with Microsoft DevOps (Source Control and CI/CD) ~ 5+ years' experience with cloud programming languages ~ 8+...Full timeWork experience placementLocal areaRemote workWorldwide- ...Skills: · Tools: Strong knowledge of SQL,Google cloud Platform,Big Query,Python,CI/CD Pipeline,Git,Airflow composer, Big Data,Hadoop, Spark, SQL, Python, Java, Shell Scripting, Cron, Hbase, HDFS, Impala, Hive, Pig, Sqoop, MySQL. · Minimum 3-5 years’ experience in...Work at officeRemote workFlexible hours
- ...SymphonyAI NetReveal version 8 or later (version 9 preferred). Strong experience with the Transaction Monitoring SMBD engine using Spark; experience limited to the classic NetReveal TM engine will not be sufficient. Strong understanding of NetReveal data structures,...Work at officeRemote workFlexible hours
- ...frameworks, and coding standards adopted across the pod. Architect scalable, cost-efficient pipelines using Databricks PySpark, Spark SQL, and Delta Live Tables (DLT) as appropriate. Make and document key architectural decisions (ADRs) with clear rationale and trade...Full timeContract workWork at officeRemote workFlexible hoursShift work
- ...Mathematics, Computer Science, Artificial Intelligence, Physics, Engineering or a related quantitative discipline. · Experience with Spark or distributed data processing frameworks. · Experience preparing data pipelines or analytical datasets to support machine...Work at officeRemote workFlexible hours
- ...data infrastructure on at least one cloud provider (AWS, Azure, or GCP). Distributed Systems: Complete understanding of Apache Spark core concepts, memory management, optimizations (Z-order, data skipping), and tuning. Key Responsibilities Platform Architecture...Work at officeRemote workFlexible hours
- ...Semantic Kernel, or similar frameworks. ~ Architect data platforms supporting real-time and batch processing using technologies like Spark, Databricks, or cloud-native services. ~ Collaborate with cross-functional teams to deliver client demos, POCs, and production-...Immediate start
- ...following Medallion Architecture (Bronze, Silver, Gold). ~ Design, develop, and optimize Fabric Notebooks using Python, PySpark, and Spark SQL. ~ Lead the development of reusable Python frameworks and notebook-based ETL/ELT solutions. ~ Optimize Spark jobs,...
- ...stores into a scalable Medallion Architecture (Bronze, Silver, Gold layers): • Delta Lake Optimization: Using Databricks and Apache Spark to build ETL/ELT data pipelines with ACID transactions. Senior engineers handle schema evolution, upserts, and slowly changing...
- ...projects. Own Databricks CoE, accelerators and technical standards. Coach engineering teams. Core Skills Databricks Spark Delta Lake Unity Catalog Lakehouse Success Measures ~50% billable utilisation ~ Contribution to proposal wins ~ Customer...Work at officeRemote workFlexible hours
- ...Model: Core Team Location: Remote Start Date: ASAP Duration: Ongoing (Quarterly renewal) Day to Day Job Duties: •Migrate Spark Job Definitions from Synapse to Fabric (32) Build Fabric Pipelines; Set up Data Orchestration Design, develop, and maintain...Contract workWork experience placementWork at officeImmediate startRemote workFlexible hours
- ...Symphony platform solution for assigned market(s) • Develop and maintain market-specific data pipelines using Scala and SQL on Apache Spark • Integrate market-level marketing and data sources into the Symphony platform • Identify and resolve market-specific data...Work at officeLocal areaImmediate startRemote workFlexible hours
