Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer - (Python, Advanced SQL ,Databricks)Hybrid-Sunnyvale ,CA

Samprasoft

Data Engineer Client's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our data architecture to support our next generation of products and data initiatives. Responsibilities for Data Engineer • Create and maintain optimal data pipeline architecture for data intensive applications. • Assemble large, complex data sets that meet functional / non-functional business requirements. • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Azure SQL, Cosmo DB, Databricks and other legacy databases. • Build analytics Dashboard/Visualizations utilizing the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. • Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs. • Keep our data separated and secure across national boundaries through multiple data centers and Azure regions. • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader. • Work with data and analytics experts to strive for greater functionality in our data systems. Qualifications for Data Engineer: • Strong python programming skills, expert level on using Python to process Big Data; • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. • Extensive Experience on Databricks on Azure Cloud platform, deep understanding on Delta lake, Lake House Architecture. • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. • Strong analytic skills related to working with Data Visualization Dashboard, Metrics and etc, experience on Tableau, Power BI or Looker tools; • Build processes supporting data transformation, data structures, metadata, dependency and workload management. • A successful history of manipulating, processing and extracting value from large disconnected datasets. • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. • Familiar with Deployment tool like Docker and building CI/CD pipelines. • Experience supporting and working with cross-functional teams in a dynamic environment. • 8+ years’ experience in software development, Data engineering, and • Bachelor’s degree in computer science, Statistics, Informatics, Information Systems or another quantitative field. Postgraduate/master’s degree is preferred. Additional Information: • What project or initiative will they be working on? Cash Reward -- loyalty program

  • Will this role be hybrid? Yes
  • If hybrid, how many days per week will need to be in office? 2-3 days per week
  • Top 3 Skills Needed or Required Python, Advanced SQL and Databricks
  • What is the makeup of the team? Team of 8, supporting Cash application operations, monitoring and reporting tasks. Team has a mixed of Backend Engineers, Site Reliability Engineers and Data Engineers.
  • Preferred Locations: Sunnyvale, Bentonville, or Dallas. Must be strong and hands-on on Python and Databricks; Required Skills : Python Additional Skills : Python DeveloperThis is a high PRIORITY requisition. Samprasoft

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineer - (Python, Advanced SQL ,Databricks)Hybrid-Sunnyvale ,CA in Dallas, TX vacancy
  • $86.8k - $165.2k

     ...Position Role Type: Hybrid U.S. Citizen, U....  ...technologically advanced, intelligent...  ...build, and maintain data pipelines that ingest...  ..., logs, and engineering artifacts. Engineer...  ...Proficiency in Python, SQL, and data processing...  ...(Spark, PySpark, Databricks, EMR, Glue, or... 
    Databricks
    SQL
    Contract work
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Collins Aerospace

    Richardson, TX
    1 day ago
  • Job Title Advanced working SQL knowledge and experience working with...  ...experience on Azure Databricks is an added advantage...  ...Programming experience on Python, Shell scripting, PySpark and other data programming languages....  ...development, Data engineering. Bachelor's degree in... 
    Databricks
    SQL

    Samprasoft

    Dallas, TX
    1 day ago
  • $111.8k - $186.4k

     ...scale healthcare data platforms. This role...  ...cloud-based data engineering capabilities that...  ...expertise in Databricks, SQL, Python, and modern Business...  ...Apache Spark. Advanced proficiency in SQL...  ...possibility of a hybrid work arrangement...  ...****@*****.***.ca. Resumes or CVs... 
    Databricks
    SQL
    Full time
    H1b
    Work at office
    Remote work
    Work from home
    2 days per week

    McKesson

    Irving, TX
    2 days ago
  •  ...Competitive salary Opportunity for advancement Job Title: Data Quality Engineer (Databricks, Kafka, AWS) Location: Dallas, TX (Hybrid – 3 days onsite) Job Type: Long-...  ...platforms built on Databricks, Kafka, AWS, SQL, and Python. This is a hands-on role focused... 
    Databricks
    SQL
    Long term contract
    Work from home
    Flexible hours

    Select Minds LLC

    Dallas, TX
    a month ago
  • Epiroc is seeking an Analytics Engineer to join our Global Data Analytics team, delivering scalable analytics solutions...  .... You will design data pipelines with SQL and Python, build modern data platforms using Fabric and Databricks, and create insightful Power BI reports.... 
    Databricks
    SQL

    Epiroc Group

    Garland, TX
    1 day ago
  •  ...looking for a Senior Data Engineer to play a key senior...  ...languages (Python, Scala, SQL) Solid understanding...  ...experience with Snowflake or Databricks, Azure Synapse...  ...techniques preferred. #LI-Hybrid - At Core Specialty,...  ...development and advancement. Benefits We offer medical... 
    Databricks
    SQL
    Temporary work
    Local area
    Flexible hours

    Core Specialty Insurance Services, Inc.

    Dallas, TX
    2 days ago
  • Azure - Data Factory, Databricks, Synapse, ADLS Senior Data Engineer - 8+ Years Experience Job Type: Full-Time Work Model: Hybrid Experience: 8+ Years Employment: Full...  ...strong expertise in Python, SQL, ETL/ELT, cloud...  ...experience with Python. Advanced SQL skills with experience... 
    Databricks
    SQL
    Full time
    Work at office
    Remote work

    7Th Sky Tech

    Dallas, TX
    4 days ago
  • $111.8k - $186.4k

     ...enterprise-scale healthcare data platforms. This role...  ...and cloud-based data engineering capabilities that...  ...expertise in Databricks, SQL, Python, and modern Business...  ...Lake and Apache Spark.Advanced proficiency in SQL for...  ...the possibility of a hybrid work arrangement based... 
    Databricks
    SQL
    Work at office
    Remote work
    Work from home
    2 days per week

    McKesson

    Irving, TX
    3 days ago
  •  ...into complementary data technologies for...  ...support search engine-based analytics....  ...understanding of Hybrid Cloud Computing:...  ...with REST APIs Advanced knowledge of Databricks platform and associated...  ..., time travel, SQL statement execution...  ...SQL and Python/PySpark Additional... 
    Databricks
    SQL
    Work experience placement

    GM Financial

    Irving, TX
    2 days ago
  •  ...opportunities for individuals to advance their careers and...  ...a Senior Associate, Data Engineer for our Consulting...  ...scale data solutions in Databricks to support multiple use...  ...technical experience with SQL and Apache Spark Strong...  ...ranges by city outside of CA: KPMG offers a... 
    Databricks
    SQL
    Local area
    Visa sponsorship

    KPMG

    Dallas, TX
    1 day ago
  • $130k - $170k

     ...Architect in Credera's Data capability group...  ..., data engineering pipelines, and advanced analytical solutions...  ...languages (e.g. Python, Spark, Java, C++, Scala, etc.) SQL and NoSQL...  ...Warehouse design (Databricks, Snowflake, Delta...  ...please visit Hybrid Working Model: Our... 
    Databricks
    SQL
    H1b
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours
    2 days per week
    3 days per week

    Omnicom Group Inc.

    Addison, TX
    2 days ago
  •  ...Data Integration EngineerLocation: Dallas TX Duration: 6 to 12+ MonthsTechnical...  ...using the visual designer and advanced transformation components.Familiarity with SQL and database management systems (...  ...using PythonMust have strong working experience using Databricks.... 
    Databricks
    SQL
    Work experience placement

    Redolent

    Dallas, TX
    4 days ago
  • $115k - $130k

     ...As a Data Engineer, you will be part of a talented team of engineers...  ...including but not limited to Python, SQL, Spark and various AWS services...  ..., Snowflake, PostgreSQL, Databricks, etc.) Experience in the design...  ...Machine Learning experience Advanced GenAI experience... 
    Databricks
    SQL

    Protagona

    Dallas, TX
    1 day ago
  • $175k - $220k

    US Health Analytics Data Engineering Team Leader Aon is looking...  ...offices in the US. Hybrid office schedule is the...  ...solutions using Apache Spark, Databricks, Python, Git, Azure DevOps,...  ...individual effort. Advanced Analytics, Structured Query Language (SQL), Data Analysis, Data... 
    Databricks
    SQL
    Full time
    Temporary work
    Part time
    Work at office
    Local area

    Aon

    Dallas, TX
    1 day ago
  • $195.3k - $199.2k

     ...maintain scalable data pipelines and systems using Databricks on Azure (among other...  .... You will utilize advanced Databricks...  ...Catalog, Delta Sharing, SQL Warehouse) to enhance...  ...and executing data engineering projects from inception...  ...on Azure, Spark, Python, and Spark... 
    Databricks
    SQL
    Apprenticeship
    Easy work

    McKinsey & Company

    Dallas, TX
    12 hours ago
  • $50 - $60 per hour

     ...Data Engineer LaSalle Network is partnering with our client to hire...  ...in Dallas, Texas, in a hybrid work environment. In this contract...  ...Hands-on experience with Databricks (or a comparable modern...  ...to ramp quickly) Strong SQL and Python skills Experience designing... 
    Databricks
    SQL
    Hourly pay
    Contract work
    Temporary work
    Work at office
    2 days per week
    3 days per week

    LaSalle Network

    Dallas, TX
    8 days ago
  • $90k - $110k

     ...Data EngineerWe are seeking a highly skilled...  ...motivated Data Engineer to play a pivotal...  ...intelligence and advanced analytics initiatives...  ...PySpark and Spark SQL, Hive for complex...  ...coding skills in Python and extensive experience...  ....g., AWS EMR, AWS Databricks) within major... 
    Databricks
    SQL

    Tata Consultancy Services

    Irving, TX
    2 days ago
  •  ...experience working in software engineering, data engineering, data science,...  ...troubleshooting code in Python and SQL • Experience with modern data...  ...such as Snowflake, Databricks, or other cloud-based environments...  ...and changing technological advances in program languages,... 
    Databricks
    SQL

    Insight Global

    Dallas, TX
    17 hours ago
  • Data Engineer - BI Designer Location: Dallas, TX Duration: 8-12 Months Required Skills...  ...Designer Hands-on experience with Databricks Strong Python and SQL skills Experience with BI design...  ...Understanding of AWS Advanced SQL skills Experience designing scalable... 
    Databricks
    SQL

    Prabhav Services Inc.

    Dallas, TX
    1 day ago
  •  ...organizations that are advancing the built environment...  ...the fast-moving data center and digital infrastructure...  ...sector, where engineering, construction,...  ...experience ~ Advanced SQL and Python skills with experience...  ...Experience with Spark, Databricks, Kafka, dbt, Airflow,... 
    Databricks
    SQL

    snipebridge

    Dallas, TX
    a month ago
  • Data Engineer - Healthcare / PHI We are seeking a hands-on Data Engineer to support healthcare...  ...and maintain data solutions using Databricks, SQL, and Python Work with sensitive or regulated...  ...-based candidates who can work in a hybrid environment are preferred, though... 
    Databricks
    SQL
    Remote work

    The LaSalle Network Inc

    Dallas, TX
    1 day ago
  • $101.7k - $119.6k

     ...Monroe is seeking a talented Data Engineer to join our Data Engineering...  ...experience Experience writing complex SQL queries related to data...  ...Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/...  ...travel 30 to 50% to client sites Hybrid role - 2 days a week in officeBased... 
    Databricks
    SQL
    Local area
    Immediate start
    Flexible hours
    2 days per week

    West Monroe Partners

    Dallas, TX
    12 hours ago
  •  ...Data EngineerGeneral Purpose The Data Engineer will be responsible for designing, developing...  ...to support advanced analytics, reporting...  ...Azure Data Factory, Databricks, and Snowflake....  ...Databricks, and Azure SQL is a plus.Familiarity...  ...languages like Python, Scala, or Java.Knowledge... 
    Databricks
    SQL
    Local area

    Coca-Cola Southwest Beverages

    Dallas, TX
    3 days ago
  • $160k - $240k

     ...YouTube. Job Description:The Staff Data & Analytics Engineer, Domain Enablement is a senior, hands...  ...transformation pipelines using Databricks, SQL, Python, PySpark, Delta Lake, and related technologies...  ..., autonomous systems, robotics, advanced manufacturing, industrial... 
    Databricks
    SQL
    Full time
    Temporary work
    Part time
    Worldwide

    Shield AI

    Dallas, TX
    2 days ago
  • Azure Databricks Engineer Prodapt is the largest specialized player in the Connectedness...  ...and building scalable data engineering solutions using Azure Databricks, PySpark, Python, SQL, and Azure Data Services...  ...Lake, Delta tables, and advanced Databricks optimization techniques... 
    Databricks
    SQL

    Prodapt

    Irving, TX
    1 day ago
  • $91k - $185.9k

     ...An ideal candidate will have:•Advanced Python Mastery & Software...  ...Strict adherence to software engineering standards, patterns and architectures...  ...postmortem processes.•Databasing & Data Modelingo Expertise in...  ...with large tables via Oracle SQL.o Understanding of database execution... 
    SQL
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office
    Remote work

    The PNC Financial Services Group

    Dallas, TX
    12 hours ago
  • $125k - $155k

     ...Summary Data Operations Engineer to manage, optimize, and support...  ...in Microsoft SQL Server (On-Premises),...  ...Azure SQL, and Azure Databricks, with a focus on ensuring...  ...T-SQL, Azure CLI, or Python. Support CI/CD pipelines...  ...development and advancement Employee Perks:... 
    Databricks
    SQL
    Full time

    Wilson Elser

    Dallas, TX
    1 day ago
  • Job Title-Senior Data Engineer Location: Remote Duration...  ...drive innovation and advanced analytics. We specialize...  ...Expert in Microsoft SQL Server (preferred) or...  ...programming skills in Python, C# or any other programming...  ...technologies: Spark, Databricks or other frameworks.... 
    Databricks
    SQL
    Contract work
    Remote work

    Saviance

    Dallas, TX
    5 days ago
  • Job Details Job Title: Data Engineer - ADF / Databricks / Snowflake Location: Dallas, TX Duration: 6 months GBaMS ReqID: 10926596 Experience...  ...knowledge of: Delta Lake Apache Spark Databricks Advanced proficiency in: SQL Python Experience with SQL and Python for: Data... 
    Databricks
    SQL

    Talent Software Services

    Dallas, TX
    1 day ago
  •  ...seeking a Senior Associate, Data Engineer for our Consulting practice....  ...large-scale data solutions in Databricks to support multiple use cases...  ...relationship development Translate advanced business data, integration...  ...on technical experience with SQL and Apache Spark Strong... 
    Databricks
    SQL
    Visa sponsorship

    KPMG LLP

    Dallas, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer - (Python, Advanced SQL ,Databricks)Hybrid-Sunnyvale ,CA. Be the first to apply!