Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Azure Data Engineer with Azure Synapse Exp

Diverse Lynx

Azure Data Engineer With Azure Synapse Exp

We are looking for a data engineer with strong experience in Azure and Apache Spark to design and build scalable, high-performance data solutions. The ideal candidate will work on modern cloud data platforms, ensuring reliable data pipelines and supporting analytics and business intelligence needs. Familiarity with Databricks and Collibra will be an added advantage.

Key Responsibilities
  • Design, develop, and maintain scalable data pipelines using Azure services
  • Build and optimize Spark-based data processing applications
  • Implement ETL/ELT workflows for batch and real-time data processing
  • Work with Azure Data Factory (ADF) or similar tools for orchestration
  • Store and manage data in Azure Data Lake (ADLS) or cloud storage systems
  • Perform data transformation, cleansing, and validation
  • Ensure data quality, governance, and security compliance
  • Collaborate with analysis data scientist and business stakeholders
  • Monitor, debug, and optimize data workflows
  • Required Skills & Qualifications
  • Technical Skills
  • Strong hands-on experience with Microsoft Azure (ADF, ADLS, Synapse or similar)
  • Solid experience in Apache Spark (PySpark preferred)
  • Proficiency in Python and SQL
  • Experience in designing data pipelines and data models
  • Good understanding of data warehousing concepts
  • Experience with version control and CI/CD pipelines (e.g., Azure DevOps)
  • Nice-to-Have Skills
  • Experience with Azure Databricks for distributed data processing
  • Exposure to Collibra or similar data governance/catalog tools
  • Knowledge of Delta Lake architecture
  • Familiarity with streaming technologies (Kafka, Event Hub)
  • Experience with BI tools such as Power BI

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer with Azure Synapse Exp in San Francisco, CA vacancy
  •  ...Azure Data Engineer Designing, building, and maintaining cloud-based data pipelines and analytics...  ...the Azure Analytics Platform Azure Synapse Analytics - Mandatory - Capability to...  ...ETL Processes - Mandatory - Experience with ETL processes and report development... 
    Suggested

    Omni Inclusive

    San Francisco, CA
    4 days ago
  •  ...Lead Azure Data Engineer Location: San Francisco Bay Area, CA (Hybrid) Duration: Long Term...  ...Description: Key Skills: ADF, ADLS, Synapse (Azure Sql Datawarehouse), T-Sql Note...  ...Azure SQL DB, Fabric. Proven experience with SQL, namely schema design and... 
    Suggested
    Work at office
    Local area

    Argyle Infotech

    San Francisco, CA
    4 days ago
  • Job Title Required Skills: SQL and Snowflake experience along with understanding the data pipelines. Documentation of the data pipelines, metadata, data catalog experience is preferred Expertise in DBT and Airflow
    Suggested

    Syntricate Technologies

    San Francisco, CA
    2 days ago
  •  ...A leading technology solutions firm seeks a Data Engineer to design, build, and optimize data solutions in cloud environments with a focus on Azure. Responsibilities include collaborating on cloud migration initiatives, designing scalable data structures, and building... 
    Suggested

    Simera

    San Francisco, CA
    3 days ago
  •  ...Lisbon, Portugal in 2018-and now with offices in both Lisbon and...  ...way. The Role As a Data Engineer at Air Apps, you will be responsible...  ...as AWS, Google Cloud, or Azure . Implement real-time...  ..., Google BigQuery, Azure Synapse, Snowflake). Experience building... 
    Suggested
    Temporary work
    Worldwide

    Air Apps

    San Francisco, CA
    23 hours ago
  • $65 - $75 per hour

     ...in the confectionery industry with over 250 retail shops across...  ...POSITION OBJECTIVE: The Data Engineering - Data & Analytics (Contractor...  ...data lake infrastructure within Azure. Embedded within the Data &...  ...Factory, Databricks, Azure SQL, Synapse / SQL Data Warehouse, Azure... 
    Hourly pay
    For contractors
    Work experience placement
    Seasonal work
    Local area

    Sees Candy Shops Inc

    San Francisco, CA
    3 days ago
  •  ...our purpose and values, and with people at the center of everything...  ...business hours As a Data Engineer Co-Op at our organization, you...  ...edge technologies within the Azure stack. You'll specifically collaborate...  ...such as Data Factory, Synapse, Databricks, and Azure... 
    Part time
    Remote work
    Flexible hours

    The Clorox Company

    San Francisco, CA
    1 day ago
  • $112.5k - $149.97k

     ...Technology is seeking a Lead Data Engineer to join our dynamic team at the...  ...a hands-on technical leader with experience in building...  ...following is strongly desired: Azure Data Engineer Associate; Power...  ...pipelines using Azure Data Factory, Synapse Analytics, and Data Lake... 
    Work at office
    Remote work

    California Correctional Health Care Services

    San Francisco, CA
    1 day ago
  •  ...Lead Data Integration Engineer - Medicaid & MDM Location: San Francisco, CA - Onsite Duration: 6 months IT experience in Requirements...  ...Sun certified Programmer for the Java 2 Platform 1.4 Exp should be in Data Migration ,MDM, Medicaid claim processing

    AceStack LLC

    San Francisco, CA
    3 days ago
  • $160k - $200k

     ...financial journey. ABOUT THE TEAM Data Platform Engineers at Rocket Money further our mission...  ...efficiently. We work closely with engineering teams to ensure data is captured...  ..., DMS, Lambda, SageMaker, S3) or Azure (Synapse, Data Factory, Functions), Snowflake,... 
    Temporary work
    Work at office

    Rocket Money

    San Francisco, CA
    3 days ago
  •  ...The Data Engineer is responsible for designing, building, and optimizing data solutions in cloud environments, with a strong focus on Azure and participation in cross-cloud migration initiatives. This role supports data architecture decisions, migration processes, and... 
    Remote work

    Simera

    San Francisco, CA
    3 days ago
  •  ...Job Overview: We are looking for a skilled zure Technical Lead (Lead Azure Data Engineer) with strong experience in building scalable data pipelines using Azure Data Factory and Azure Databricks. The ideal candidate will have a solid background in data engineering, particularly... 

    Macpower Digital Assets Edge

    Oakland, CA
    1 day ago
  •  ...Data Science & ML Ops Engineer We are seeking a hybrid Data Science & ML Ops Engineer to drive the full...  ..., TensorFlow, PyTorch). Experience with cloud platforms and containerization (...  ...in cloud environments (e.g., GCP, AWS, Azure). Implement CI/CD workflows for model... 

    Apolis

    San Francisco, CA
    3 days ago
  •  ...approaches to maximizing the potential of data in AI models Defining creative...  ...field of study Strong ML research and engineering utilizing established and emerging NLP technologies...  ...and first principles understanding with proven application Experience with information... 

    NovumTech Partners

    San Francisco, CA
    3 days ago
  •  ...Seeking Founding Data Scientists and Machine Learning Engineers Imagine Multiplying Your Impact You've unlocked major wins in your career - you've...  ...growth levers and guiding action so product teams iterate with confidence and velocity instead of sifting through... 

    Palladio AI, Inc

    San Francisco, CA
    4 days ago
  • $181.1k - $318.4k

     ...Senior ML Data Engineer, MLO Do you believe Machine Learning and AI can change the world? We truly believe it can! We are the ML Data...  ...using state of the art processing technologies (eg familiarity with Iceberg, BigQuery, Airflow, Spark, etc.) Expertise in Python... 
    Temporary work
    Relocation

    Apple

    San Francisco, CA
    2 days ago
  •  ...Description: Job brief Join our San Francisco office as an ML Engineer focused on Data Engineering. Visa sponsorship available for global talent ~3 days ago A machine learning engineer with an emphasis on data engineering is needed by this organization to... 
    Full time
    H1b
    Work at office
    Immediate start
    Visa sponsorship

    Dfbooking Recruitment Services

    San Francisco, CA
    3 days ago
  • $130k - $400k

     ...Data Engineer Location: San Francisco or New York City Company Stage: Series C / Late-Stage (AI / Enterprise) Office Type:...  ...expertise is leveraged to train and improve frontier AI systems. With a global network of tens of thousands of experts and partnerships... 
    Work at office
    Relocation package

    Recruiting from Scratch

    San Francisco, CA
    4 days ago
  •  ...Data Engineer Responsibilities: Develop and automate large scale, high-performance data processing systems (batch and/or streaming) to drive Airbnb business growth and improve the product experience. Build scalable Spark data pipelines leveraging Airflow scheduler... 

    Omega Solutions Inc

    San Francisco, CA
    3 days ago
  •  ...Data Engineering Role at Triumph Triumph is a skill-based real-money gaming platform in a period of rapid growth. Real money flows through...  ...for performance, cost, and reliability as data volumes scale with user growth. Build and maintain transformation layers. Own... 

    Triumph

    San Francisco, CA
    3 days ago
  •  ...Sr. Data Engineer (SCM) Location: Bay area, CA (Hybrid/Remote) Duration: Long term contract...  ...skills – go figure it out and come back with working model. Pros/cons analysis skills...  ...Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M)... 
    Long term contract
    Remote work

    InterSources

    San Francisco, CA
    3 days ago
  • $144.77k - $209.11k

     ...Sr. Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and...  ...focused on providing solutions that empower our federal customers with the tools and capabilities needed to turn data into actionable... 
    Full time
    Flexible hours

    Contact Government Services, LLC

    San Francisco, CA
    2 days ago
  • $140k - $348k

     ...creating a prototype, translating designs into code, or iterating with AI. From idea to product, Figma empowers teams to streamline...  ...collaboration, join us! We are looking for an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams... 
    Full time
    Remote work
    Work from home

    Figma

    San Francisco, CA
    2 days ago
  •  ...the makers of Devin, the first AI software engineer, and Windsurf, the AI-native IDE....  ...About the Role We're hiring a technical Data Engineer to own our full data stack - from...  ...SQL and Python (required) ~ Experience with data modeling, warehouse architecture, and... 

    Cognition Corp

    San Francisco, CA
    2 days ago
  •  ...Title: Senior Data Engineer - Platform Engineering Location: San Francisco, Los Angeles, or Dallas - Hybrid (Requires three days...  ...services support the needs of the business. You will collaborate with cross-functional teams to enable operational data analysis,... 
    Full time
    Work at office
    Flexible hours
    3 days per week

    Kaav Inc.

    San Francisco, CA
    2 days ago
  • $152k - $205.6k

     ...Data Engineer San Francisco, CA About Us Twitch is the world's biggest live streaming service, with global communities built around gaming, entertainment, music, sports, cooking, and more. It is where thousands of communities come together for whatever, every... 
    Flexible hours

    Twitch

    San Francisco, CA
    23 hours ago
  • $190.8k - $349k

     ...smarter, and more expansive. As Director, Data Science & Strategy - Agentic Product, you...  ...technical fluency in data and AI systems with the strategic judgment to translate those...  ...this role will partner across product, engineering, partnerships, corporate strategy, and GTM... 
    Temporary work
    Local area
    Worldwide

    Adobe

    San Francisco, CA
    4 days ago
  •  ...Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire...  ...procedures; Employ an array of technological tools to integrate with 3rd-party data systems; Collaborate team members (e.g.,... 

    Adapt Talent

    San Francisco, CA
    3 days ago
  • $150k - $220k

     ...learning. We combine world-class curriculum with cutting-edge AI and modern SaaS...  ...center of this effort, collaborating across engineering, design, research, and education to create...  ...Content & AI Systems team is building the data layer that powers the next generation of... 
    Permanent employment
    Full time
    Local area
    Flexible hours

    Kiddom

    San Francisco, CA
    1 day ago
  • $146.6k - $150k

    Tech & AI Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries) Job ID: 10272...  ...analytics and AI solutions. You'll collaborate with clients and interdisciplinary teams to...  ...with cloud platforms such as (AWS, GCP, Azure, Oracle) and modern data storage/... 
    Hourly pay
    Apprenticeship
    Work at office
    Easy work

    McKinsey & Company

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Azure Data Engineer with Azure Synapse Exp. Be the first to apply!