Senior Databricks Data Engineer
I-Flow
Job Title:Senior Databricks Data Engineer
Location: Chicago, IL
Duration: 6 months
Experience Required: 8-10 Summary
In this role, you will autonomously, with minimal supervision, utilize your outstanding organizational and critical thinking skills. You will leverage your experience with agile methodologies software development practices. You will solve complex problems and bring a new perspective to the usage of existing solutions. Responsibilities :
• Design, develop, enhance, code, test, deliver, and debug software.
• Create software applications in alignment with business requirements.
• Assist in troubleshooting, root cause determination, and resolution of defects and issues in various applications.
• Ensure code quality and maintainability through code reviews and adherence to coding standards.
• Develop deliverables to meet project deadlines and fulfill functionality expectations.
• Identify opportunities to improve procedures and standards.1
• Mentor entry and mid-level developers to enhance their skills and productivity.
• Design and implement scalable data engineering solutions using Databricks and Apache Spark to support analytics and AI-driven and machine Leaning healthcare applications.
• Architect, optimize, and maintain distributed data pipelines within Databricks to ensure performance, reliability, and scalability across environments.
• Establish best practices for CI/CD, testing, monitoring, and cost optimization of Databricks workloads in cloud environments.
• Troubleshoot complex data processing and performance issues and implement scalable solutions to improve system stability and efficiency. Qualifications :
• Relevant degree in Computer Science or a related field preferred.
• 5 or more years of relevant work experience required.
• Experience designing and implementing scalable data engineering solutions using Databricks and Apache Spark required.
• Strong expertise in Delta Lake architecture, distributed computing, and large-scale data processing frameworks.
• Experience building and optimizing ETL/ELT pipelines in Databricks within Azure cloud environments.
• Experience supporting machine learning model deployment and lifecycle management within Databricks preferred.
• Proficiency in Python or Scala for data engineering and platform development. Role Descriptions: Databricks
Essential Skills: Databricks
Desirable Skills:
Keyword:
Skills: Digital : Databricks
Location: Chicago, IL
Duration: 6 months
Experience Required: 8-10 Summary
In this role, you will autonomously, with minimal supervision, utilize your outstanding organizational and critical thinking skills. You will leverage your experience with agile methodologies software development practices. You will solve complex problems and bring a new perspective to the usage of existing solutions. Responsibilities :
• Design, develop, enhance, code, test, deliver, and debug software.
• Create software applications in alignment with business requirements.
• Assist in troubleshooting, root cause determination, and resolution of defects and issues in various applications.
• Ensure code quality and maintainability through code reviews and adherence to coding standards.
• Develop deliverables to meet project deadlines and fulfill functionality expectations.
• Identify opportunities to improve procedures and standards.1
• Mentor entry and mid-level developers to enhance their skills and productivity.
• Design and implement scalable data engineering solutions using Databricks and Apache Spark to support analytics and AI-driven and machine Leaning healthcare applications.
• Architect, optimize, and maintain distributed data pipelines within Databricks to ensure performance, reliability, and scalability across environments.
• Establish best practices for CI/CD, testing, monitoring, and cost optimization of Databricks workloads in cloud environments.
• Troubleshoot complex data processing and performance issues and implement scalable solutions to improve system stability and efficiency. Qualifications :
• Relevant degree in Computer Science or a related field preferred.
• 5 or more years of relevant work experience required.
• Experience designing and implementing scalable data engineering solutions using Databricks and Apache Spark required.
• Strong expertise in Delta Lake architecture, distributed computing, and large-scale data processing frameworks.
• Experience building and optimizing ETL/ELT pipelines in Databricks within Azure cloud environments.
• Experience supporting machine learning model deployment and lifecycle management within Databricks preferred.
• Proficiency in Python or Scala for data engineering and platform development. Role Descriptions: Databricks
Essential Skills: Databricks
Desirable Skills:
Keyword:
Skills: Digital : Databricks
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer in Chicago, IL vacancy
- We are seeking a hands-on Senior Data Engineer to support Phase 0 data discovery, profiling, mapping, and engineering handoff activities for... ...-quality engineering deliverables for implementation in Databricks. The ideal candidate has strong expertise in Databricks, SQL...DatabricksSeniorHourly payFreelance
- ...influence and grow our Business Intelligence practice by developing data engineering pipelines and analytic solutions that support our Advanced... ...Degree.3+ years of experience building data pipelines using Databricks(SQL and pyspark) and Snowflake3+ years of experience with...DatabricksSeniorFull timeWork at officeLocal areaFlexible hours
$95k - $150k
...to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate... ...optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks Write and tune PySpark / Spark SQL notebooks for large-...DatabricksSeniorPermanent employment- ...Your Role The Data Services team is responsible for technical design and end-... ...products for the enterprise. The Data Engineer,Senior will report to the Sr Manager, Data Solutions... ...stack tools such as dbt, Snowflake, Databricks, Airflow, or Tidal Solid knowledge...DatabricksSenior
Blue Shield of CA
Chicago, IL2 days ago $137.4k - $161.7k
Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design... ...and business intelligence. Working with technologies such as Databricks, Snowflake, and Microsoft Fabric, you will help clients...DatabricksSeniorLocal areaImmediate startFlexible hours$120k - $160k
...flexibility needed for a meaningful work-life balance.Being a Senior Data Engineer at iManage Means…You get excited about data, and you... ...Machine Learning Engineers to architect, design and build our Databricks data platform and our Databricks MCP connector. iM Responsible...DatabricksSeniorWork at officeLocal areaWorldwideFlexible hours2 days per week$100k - $120k
...• Python (modular code, testing, CI/CD) • PySpark (distributed processing, optimization) • Azure Data Factory (pipelines, triggers, monitoring) • Databricks (Delta Lake, workflows, clusters) • Azure (ADLS Gen2, Azure SQL, Resource Groups, Portal) • Pulumi (...DatabricksSeniorTata Consultancy Services
Chicago, IL2 days ago$215.2k - $244.7k
...impact?West Monroe is seeking a Senior Architect to join our... ...with clients developing Big Data strategy and roadmaps, while... ...platform selection advice for Databricks, Snowflake, and/or Microsoft... ...Language Models (LLMs), prompt engineering, embeddings, vector databases...DatabricksSeniorLocal areaImmediate startFlexible hours$77k - $202k
...Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced... ...data architecture strategies. As a Senior Associate you analyze complex problems... ...Associate, Snowflake Core, Snowflake Databricks Data Engineer Associate] is a plus-...DatabricksSeniorFull timeH1b$124k - $280k
...Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced... ...current and future business needs. As a Senior Manager you lead large projects,... ...Snowflake Core, Snowflake Architect, Databricks Data Engineer Associate] is a plus-...DatabricksSeniorFull timeH1b- ...as a firm.KPMG is currently seeking a Manager, Ignition - Tax Data Engineer to join our Tax Ignition practice.Responsibilities:Lead and... ...and governance using cloud based data platforms (Snowflake, Databricks, Informatica, and or Azure Synapse), technical scripting languages...DatabricksSeniorLocal area
$98k - $169.05k
84.51° is a retail data science, insights and media company. We help The Kroger Co.,... ...our big data. Our developers use Python, Databricks, Spark, JSON, and SQL in scrum teams to... ...Collaborate with architecture and lead engineers to ensure consistent development practices...DatabricksSeniorWork at office84.51°
Chicago, IL9 hours ago$120k - $170k
...maintaining flexibility for meaningful work‑life balance. As a Senior Data Engineer on the Applied Data team, you will design, build, and... ...Designing, developing, and maintaining scalable data pipelines on Databricks & Microsoft Azure to ingest and transform large volumes of...DatabricksSeniorWork at officeLocal areaFlexible hoursROLE
Chicago, IL2 days ago- We are looking for an experienced Data Engineer to join a high-performing technology team in Chicago. This individual will play a key role... ...storage, or distributed data platforms such as S3, HDFS, Databricks, Iceberg, or related technologies. Strong experience developing...DatabricksSenior
- ...largest provider-driven healthcare performance improvement company, is looking for a Sr. Azure Data Engineer with solid, real-time hands-on experience in: PySpark Databricks (notebooks, jobs, workflows, External/Managed tables, SQL Warehouse, AI/ML) ADLS (Blob Storage)...DatabricksSenior
Motion Recruitment
Chicago, IL9 hours ago $112.9k - $188.1k
...consistent with applicable law. Position Details: As a Senior Data Engineer at Grainger, you will play a pivotal role in designing,... .... ~ Proficiency with tools such as Snowflake, Databricks, PostgreSQL, and event-streaming platforms like Kafka. ~...DatabricksSeniorFull timeH1bLocal areaWorldwideGrainger Businesses
Chicago, IL4 days ago- ...- Customer, Loyalty, Search and Browse, Data Integration, Cart. Current overriding priorities... ...We are looking for a Data Engineer who will be responsible for designing a... ...Analytics, Azure Data Factory, and Azure Databricks, pySpark for building scalable and reliable...DatabricksSenior
$10k
...of products, please visit fairlife.com. Job Purpose The Sr. Data Engineer will play a key role in delivering fairlife's ambition of building... ...experience (Delta Lake, medallion architecture) in Fabric or Databricks preferred Working knowledge of KQL (Azure Data Explorer,...DatabricksSeniorTemporary workLocal areaFairlife
Chicago, IL4 days ago- ...days per week in office in Chicago, IL Our client seeks a Senior Data Engineer to design, build, and operate large-scale data processing for... ...processing and modern lakehouse architectures such as Databricks, Delta Lake, or Apache Spark. Operating distributed data platforms...DatabricksSeniorWork at office2 days per week
$88.9k - $165.1k
...with 1 View, 1 Vision, 1 Voice. Responsibilities As a Senior Software Engineer on Publicis’s Data Warehouse projects, you will design, build, and... ...petabyte-scale data, leverage frameworks such as Spark, Databricks, and Airflow, and directly influence how global brands...DatabricksSeniorLocal areaFlexible hours$90k - $200k
...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...solutions like Snowflake, Redshift, Databricks 5+ years of experience with SQL or NoSQL... ...: ConsultingExperience level: Mid-Senior LevelIndustry: Management ConsultingDatabricksSeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours$88k - $103k
...datasets using cloud-native technologies (AWS, Databricks, Amazon Redshift) and SQL-based processing. Design and maintain relational data models to support analytics, reporting,... .... Mentor and train junior data engineers through code reviews, technical coaching,...DatabricksSeniorFlexible hours- ...insurance carrier, insurance brands and partner brands. **Senior Data Engineer****External name**: Senior Data EngineerEstablished in 2021... ...ecosystem.* Implement modern data solutions using tools like dbt, Databricks, ELT frameworks, and other cloud platforms (AWS, Snowflake)...DatabricksSeniorTemporary workWork at officeRemote workFlexible hours
- ...a highly motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Chicago, IL (Hybrid) Key Skills: AWS (EMR, DynamoDB, S3, Lambda), Python, PySpark, Databricks, SQL Overview: We are seeking a highly skilled Sr. Data Engineer to join...DatabricksSeniorLocal areaRemote work
$70k - $110k
The Senior Analytics Engineer is responsible for designing, building, and maintaining critical data pipelines, data models, and infrastructure solutions that enable data products... ...Data Platform (Data Factory, Data Lake, Databricks preferred) in production environments...DatabricksSeniorTemporary workWork from homeWorldwideFlexible hoursShift work- Sr Data Engineering & Data Governance Architect Our talented Data & AI team is made up of globally... ...and Integrate Purview with Azure, Databricks, Postgres and other platforms. Partner... ...and governance operating processes As a senior member of the Avanade technical community...DatabricksSenior
$155k
...technology‑led service with a human touch. About the Role The Senior Data Engineer sits on Scorpion's AI team and plays a critical role in... ...Data Processing & Lakehouse Technologies Deep expertise with Databricks, Delta Lake, and Apache Spark for large‑scale data...DatabricksSeniorWork at officeLocal areaRemote workFlexible hours$92.7k - $167.5k
...Job SummaryAn individual with the ability to design and develop data Integrations to deliver Enterprise BI Data Marts and BI... ...platforms such as MPP Platforms (Teradata), Hadoop Datalake , Databricks, Azure Cloud and PowerBi with ability to design and develop end...DatabricksSeniorFull timeRelocationFlexible hours- ...Job Description Job Description Job Title: Senior Data Engineer Location: Chicago, IL or Minneapolis, Minn. 3-4 days per week onsite... ...and implementation, particularly within the Azure ecosystem, Databricks and ADF • Large-Scale Data Architecture & Design: •...DatabricksSenior3 days per week
$161.5k - $299.7k
...SummaryHCSC is recruiting for a leader in our Data Science Engineering function. The team is responsible for... ..., monitoring, and reliability. The Senior Director will lead a team of machine... ..., Kubeflow, SageMaker, Azure ML, Databricks)Experience deploying and operating...DatabricksSeniorFull timeWork experience placementWork at office3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Databricks Data Engineer. Be the first to apply!
Related searches
- software data engineer Chicago, IL
- entry level big data engineer Chicago, IL
- big data developer Chicago, IL
- senior data quality engineer Chicago, IL
- sr data engineer Chicago, IL
- junior big data engineer Chicago, IL
- big data cloud engineer Chicago, IL
- data platform engineer Chicago, IL
- senior cloud data engineer Chicago, IL
- data developer Chicago, IL