Senior Data Engineer - Azure Databricks & Pipelines Lead
Business Needs Inc
Business Needs Inc. in Austin, TX is seeking a Data Engineer to design, develop, and maintain scalable data pipelines, ingestion frameworks, and reusable data products using Azure Databricks, PySpark, SQL, and Delta Lake. You will implement Bronze, Silver, and Gold patterns, support batch and streaming workloads, lead technical reviews, mentor engineers, and collaborate with data architects to ensure secure, governed, cost-conscious solutions. #J-18808-Ljbffr Business Needs Inc
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Azure Databricks & Pipelines Lead in Austin, TX vacancy
- ...Senior Databricks Data Engineer (Azure Databricks | Lakehouse | ETL/ELT) Austin, Texas (Hybrid – 3 Days Remote | Onsite Every Monday & Thursday)... ...Azure Databricks ✔ Lakehouse Architecture ✔ ETL / ELT Pipelines ✔ Delta Live Tables (DLT) ✔ PySpark ✔ Data Engineering...DatabricksPipelineSeniorTemporary workLocal areaRemote work
Delan Associates, Inc
Austin, TXa month ago - SpyCloud in Austin, TX seeks a Senior Data Engineer to lead the architectural transformation of our data... ...to modernize data systems using Databricks and serving customers via RDS, Elasticsearch... ...data engineers, drive AI-ready data pipelines, and own long-term data architecture...DatabricksPipelineSeniorRemote job
- ...Computer Science, Software Engineering, Computer Engineering, Electrical... ...and supporting ETL/ELT pipelines and data platforms in cloud environments... ...in Python, SQL, Spark, and Databricks for data engineering use cases. Experience with Azure Databricks, including...DatabricksPipelineSeniorLocal area
- YETI Canada Limited is seeking a Senior Data Engineer in Austin, Texas, to help design and build our enterprise... ...data platform emphasizing Google BigQuery and Databricks. This role includes developing scalable ELT/ETL pipelines and integrating SAP data sources. The ideal...DatabricksPipelineSenior
- ...down anytime soon. Our client in Austin, Texas is seeking a Senior Data Engineer to join their team for high-impact upcoming projects.... ...Qualifications Minimum 3 years of hands-on experience with Azure Databricks. At least 10 years of experience in data warehousing environments...DatabricksSenior
- Data Engineer focused on Azure Cloud Platform - Austin, TX Must have 8+ yrs of professional experience - 5+ yrs as Data Engineer focused... ...e.g., Azure Key Vault, Azure Blob Storage, ADLS Gen2, Databricks Pipeline, Log Analytics, Logic App, Purview, Azure Functions)....DatabricksPipeline
- Senior Data Engineer At YETI, we believe that time spent outdoors matters more than ever and our gear... ...needs Design and build scalable ELT/ETL pipelines using Airflow, Stored Procedures in BigQuery, Dataflow, and Databricks Lead development of analytical data models Integrate...DatabricksPipelineSeniorH1b
$145k - $165k
...company delivering cloud, AI, data, and enterprise solutions... ...potential. Job Title: Senior Data Engineer - Hadoop Location: 100%... ...-scale data processing pipelines and analytics platforms on... ...platforms such as AWS EMR, Azure HDInsight, or Databricks. Familiarity with modern...DatabricksPipelineSeniorFull timeH1bLocal areaImmediate startRemote workVisa sponsorship$155k - $175k
...delivering cloud, AI, data, and enterprise... ...potential. Job Title: Senior Data Engineer Location: 100% Remote... ..., scalable data pipelines, and distributed data... ...technologies such as Databricks, Snowflake, Apache Spark... ...solutions on AWS, Azure, or Google Cloud Platform...DatabricksPipelineSeniorFull timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
Austin, TXa month ago- ...building the AI, data, and infrastructure... ...industry down. Leading global travel, retail... ...an experienced Senior Data Engineer to establish and... ...data lake and pipeline architecture, and... ...platforms (AWS, GCP, or Azure) and their data... ..., Redshift, Databricks) Understanding of...DatabricksPipelineSeniorWork at officeFlexible hoursShift work
- Cloud Data Engineer We are looking for passionate data engineers to join... ...: • Design and develop data pipelines to extract data from a wide... ...of data sources using Azure, Snowflake Cloud, and cloud-... ...database, Functions, Data Lake, Databricks, Logic Apps, and Azure Automation...DatabricksPipelineSeniorWork at officeRemote work
$70 - $80 per hour
Position: Senior Data Engineer Location: Austin, TX - Hybrid Compensation... ...and maintain scalable data pipelines, transformation processes,... ...efficiency and solution quality. Lead technical design efforts... .... Strong experience with Azure Databricks, Delta Lake, Unity Catalog,...DatabricksPipelineSeniorHourly payContract workLocal areaRemote work- ...BUILT FOR THE WILD™. About the Role The Senior Data Engineer will be part of a team that designs,... ...needs Design and build scalable ELT/ETL pipelines using Airflow, Stored Procedures in BigQuery, Dataflow, and Databricks Lead development of analytical data models Integrate...DatabricksPipelineSeniorH1bLocal area
$133k - $188.6k
...batch and streaming ETL/ELT pipelines in Azure Databricks to support ingestion,... ...manufacturing and enterprise data.Build reusable Bronze, Silver... ...data preparation, feature engineering, model training, evaluation... ...embrace the responsibility to lead the change that will make...DatabricksPipelineSeniorFull timeH1bLocal areaWork from homeRelocation packageFlexible hoursGeneral Motors
Austin, TXa month ago$198k - $297k
..., and happy. The Role As a Data Engineer you will handle everything from... ...and modeling to data pipeline tooling and dashboarding. You... ...controls, and disputes. You Will Lead the creation and... ...We Use and Teach Snowflake Databricks Dbt Github Airflow Prefect...DatabricksPipelineSeniorWork at officeLocal areaRemote workFlexible hours$147k - $181k
...forward. About JLL and Data Platform JLL is a leading professional... ...without re-building pipelines of their own. What... ...job involves As a Senior Data Engineer on the Data Consumption... ...cloud environment (Azure preferred). Direct... ...Qualifications Experience with Databricks, Unity Catalog, or...DatabricksPipelineSeniorDaily paidContract workLocal areaRemote work$110k - $200k
Senior Data Engineer At NinjaOne, we're looking for a skilled Senior Data Engineer to join our Emerging... ..., building robust streaming and batch pipelines, and ensuring data flows reliably to... ...stack — Kafka, Spark, Iceberg, and Databricks — collaborate with cross-functional...DatabricksPipelineSeniorPermanent employmentFull timeWork experience placementRemote workWork from homeRelocationFlexible hours$106.9k - $176.5k
...CTO, the Advanced Forward Engineering (AFE) team is comprised... .... We are seeking a Data Engineer to join AFE delivery... ...sources. Ensure data pipelines comply with governance,... ...systems (Postgres, Oracle, Databricks, SnowFlake, BigQuery, RedShift, Azure Data Factory, Kafka,...DatabricksPipelineSeniorSummer holidayWork at officeFlexible hours- Senior Data Engineer Arrive Logistics is a leading transportation and technology company in North America... ...as well as own the pipelines that ingest and... ...preference for Microsoft Azure. Solid understanding of... ...warehouse like Snowflake, Databricks, BigQuery, or Redshift....DatabricksPipelineSeniorWork experience placementCasual workWork at officeLocal areaRelocationRelocation packageDay shift
$144k - $187k
...mission, look no further! As a Senior Data Engineer at SpyCloud, you will lead the architectural transformation... ...modernizing our data platform utilizing Databricks and serving customers via purpose... ...real‑time and batch data pipelines using AWS tools (e.g., Lambda, S3...DatabricksPipelineSeniorTemporary workLocal areaRemote workWorldwideVisa sponsorshipFlexible hours$100k - $120k
Senior Data Platform Engineer Location: Austin, TX Worksite: Onsite About WCT WCT... .... The engineer will lead major data platform initiatives... ...areas of focus include Azure Databricks, cloud data engineering, platform... ...maintain scalable data pipelines, ingestion frameworks,...DatabricksPipelineSenior- ...large, global organization is seeking a highly motivated Senior Data Engineer to lead the architecture and deployment of next-generation data-driven... ...the cloud. Key responsibilities include designing data pipelines, developing APIs, and managing infrastructure using GKE....PipelineSenior
$253.9k - $298.7k
...working at Coinbase. As a Senior Staff Software Engineer on the Data Platform team within Platform, you'll define and lead the technical strategy... ...ML workloads, ensuring pipelines, data lake systems, and compute... ...such as CDC, Kafka, Databricks, Snowflake. ~ Platform...DatabricksPipelineSeniorLocal areaCoinbase
Austin, TX2 days ago- ...Summary We’re looking for a senior engineer who can take Vi’s AI agent... ...clients — owning everything from data ingestion and CRM... ...comfortable with databases, data pipelines, AI/ML tooling, and the messy... ...lake connectors (Snowflake, Databricks, S3). ~ Solid database fundamentals...DatabricksPipelineSeniorFull time
V.i. Labs
Austin, TX14 hours ago - ...Data Operations Engineer Location: Austin, TX Duration: 6+ Months Tax... ...Key Responsibilities Lead day-to-day operations to ensure... ...real time systems including pipelines, frameworks, tools and... ...Luigi, Tableau, Snowflake, Databricks, MLFlow, Data Catalogs, Jupyter...DatabricksPipeline
Apolis
Austin, TX2 days ago - ...Senior Data EngineerWe are looking for a hands-on Senior Data Engineer to design, build, and operationalize ETL/ELT pipelines in Azure Databricks for manufacturing data and analytics use cases. This role will focus on scalable ingestion, transformation, curation, and delivery...DatabricksPipeline
Saxon Global
Austin, TX3 days ago - ...Data Engineer Duration: Long term Location: Austin, TX- 3... ...and maintain scalable data pipelines, ingestion frameworks, transformation... ...data products using Azure Databricks, PySpark, SQL, and Delta Lake... ...workloads. Serve as technical lead for complex initiatives;...DatabricksPipeline3 days per week
Business Needs Inc
Austin, TX2 days ago - Baker Botts L.L.P. in Austin seeks an Analytics Engineer to transform enterprise data into trusted analytics-ready assets... ...design and maintain data transformations in Azure Databricks, own Bronze-to-Silver/Gold pipelines, ensure data quality, and deliver curated datasets...DatabricksPipeline
- General Motors is seeking a Senior Data Engineer to join the Motorsports Data Engineering team, building data platforms for real-time and batch... ..., and trackside data. You will own Kafka/Flink components, Databricks lakehouse implementations, and IaC deployments,...DatabricksSenior
- ...scalable batch and near-real-time data pipelines. Develop ETL/ELT workflows... ...6+ years of experience in data engineering for analytics or ML systems. Experience... ...Iceberg). Experience with AWS, Azure, or GCP . Experience with Snowflake, Databricks, Trino, OLAP/NRT systems,...DatabricksPipeline
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Azure Databricks & Pipelines Lead. Be the first to apply!
Related searches
- aws data engineer Austin, TX
- director data engineering Austin, TX
- data platform engineer Austin, TX
- data engineer machine learning Austin, TX
- data science developer Austin, TX
- senior data engineer Austin, TX
- finance data engineer Austin, TX
- principal data engineer Austin, TX
- big data devops engineer Austin, TX
- data engineer analytics Austin, TX