Data Engineering Lead
Openkyber
Role:
Data Engineering Lead (Databricks + AWS)
Location:Dallas, TX Onsite as needed
Experience:10+ years
Please share the resume with me at View email address on us.fitly.work
Job Summary:Seeking a Sr. Technical Lead with strong hands-on, real-time production experience in Databricks and AWS to design and develop scalable data pipelines, data lake solutions, and real-time data processing applications.
Candidate Must Have:- 4+ years Python/Spark/PySpark
- 3+ years AWS
- Strong hands-on Databricks production experience
- Databricks real-time/production experience is mandatory
- Python
- Apache Spark / PySpark
- AWS 3+ years
- AWS S3, Glue, Lambda, Kinesis, EMR, Redshift
- Data Pipeline design & development
- ETL / Data Ingestion & Transformation
- Advanced SQL, query optimization & indexing
- CDC (Change Data Capture)
- MS SQL / SQL Server and Oracle Aurora & Redshift
- Real-time data processing
- Data Lake architecture & data integration
- Agile methodology
For applications and inquiries, contact:View email address on us.fitly.work
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Engineering Lead in Illinois vacancy
$190k - $220k
...fantastic restaurant experiences, leveraging advanced technology and data analytics to deliver value to restaurants, diners, and our... ...to help you gain your full potential. Job OverviewThe Data Engineering Lead is responsible for driving the modern data engineering foundation...SuggestedFull timeWork at officeLocal areaFlexible hours3 days per week- Publicis Groupe is seeking a Data Manager of Data Engineering to handle data projects in our Technology and Data Department. The role involves overseeing data flows into the organization, ensuring processes, and maintaining client documentation for HCP publishers. Ideal...SuggestedFlexible hours
- Chainlink Labs is seeking an Engineering Manager for Data Feeds to lead a critical engineering team responsible for reliable, scalable infrastructure powering our flagship data feeds product. You will guide architecture, mentorship, and delivery goals to support DeFi and...Suggested
$88.54k - $127.16k
Publicis Groupe ANZ in Chicago is looking for a Data Manager for Data Engineering to lead data projects and maintain data integrity. The ideal candidate will have strong experience with data pipelines and cloud platforms, along with a BS in Computer Science or related field...Suggested- ...Warrants ~ Annual bonus ~401(k) ~401(k) matching ~ Competitive salary ~ Health insurance ~ Paid time off Data & AI Engineering Lead Full Time | Hybrid Preferred | Chicago Metro Area Preferred Build the data and agent foundation for POWR:Suite...SuggestedFull timeRemote workWork from homeFlexible hours
Intelligent Generation
Oak Brook, ILa month ago - Revature LLC is seeking a Senior Trainer in Data Engineering to deliver advanced training on data engineering workflows, focusing on emerging technologies and AI integration. In this role, you will mentor the next generation of Data Engineers and professionals, teaching...
- Eaton's Data Center Solutions division is seeking an Operations & Engineering Manager to lead manufacturing, test engineering and operations for configure-to-order data center products. You will develop scalable assembly and test processes, deploy production infrastructure...
- ...Job Title: Data Lead / Senior Data Engineer Location: Charlotte, NC or Chiago, IL - 5 Days onsite role; local only Long Term Project Exp- 10-15 years only S.No Skills No of years of hands on Exp 1 ETL...Hourly payFull timeH1bLocal areaRelocation
Hallmark Global Solutions Ltd
Chicago, IL1 day ago - Deloitte’s GPS team seeks a skilled data professional to lead data and communications workstreams for major client initiatives in the United States. You will turn readiness data into clear, actionable insights and stakeholder-facing products, combining analytics with strategic...
- ...Chicago is seeking candidates with an Mtech or MS in related fields to join their team. The ideal applicant will have solid experience in data tuning and expertise in big data technologies such as HDFS, PIG, HIVE, and HBase. Strong communication and troubleshooting skills...Full time
- Mayer Brown in Chicago seeks a Senior Engineer: Financial Services to architect and steward Finance data, analytics, and reporting. You will design scalable data pipelines, partner with Enterprise Data teams, and deliver governance across data assets. Expect collaboration...
- McKinsey & Company in Chicago seeks a Data Engineer to design and implement scalable data architectures for AI systems. You will manage data... ...collaborating with cross-functional teams. Your role includes leading the integration of machine learning capabilities into client...
- A prominent recruiting agency is looking for a Senior Data Engineer to transform data into business insights. The ideal candidate will design and maintain data pipelines, ensuring data integrity and governance compliance. With 5-8 years of experience and strong skills in...
- A leading data solutions provider has an opportunity for a Data Engineer 5 in Chicago. The role requires 10+ years of experience and focuses on enterprise data architecture and analytics. Responsibilities include maintaining data standards and guiding teams through complex...Permanent employment
- SiriusXM Radio, Inc. is seeking a Senior Staff Data Engineer to design and build high‑performance reporting APIs and scalable data pipelines. You will lead architecture discussions, work with ad measurement and revenue data, and collaborate across engineering teams to...
- ...global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction... ...Engineer with experience on Hyperscale Data Center projects to act as Data Center Mechanical Engineer Lead. The job incumbent will be responsible for designing...Work at officeLocal areaRemote workWorldwideFlexible hours
- ARCO/Murray Engineering is seeking a Lead Mechanical Engineer in Downers Grove, Illinois, to guide mechanical system designs for data center projects. Candidates should have a Bachelor's degree in Mechanical Engineering, 8-10 years of relevant experience, and expertise...
- Chamberlain Group based in Oak Brook, IL is looking for a Sr. Manager, Data Science to lead a team of data scientists. This role involves transforming business objectives into data-driven solutions, fostering relationships with senior leaders, and promoting advanced analytical...
- iManage is seeking a Senior Data Engineer in Chicago, IL to own the iMData platform and pipelines, collaborating with ML engineers to deliver scalable data insights. You will mentor junior engineers, engage with stakeholders, and drive data-driven decisions. The role emphasizes...Work at officeRemote workFlexible hours
- ULSE in Evanston, IL is looking for a Senior Data Engineer to design and maintain scalable data architectures. This hybrid role involves leading initiatives to support standards development and data science while ensuring the alignment of business needs and data solutions...
- A high-growth financial services company in Chicago is seeking a Principal Data Engineer for a hybrid role. You will drive architectural decisions in a modern cloud data platform and oversee the development of scalable data pipelines. The ideal candidate has 5-8+ years...
- Benchmark Analytics is seeking a senior Data Engineer to lead platform-level work from discovery through production in our cloud-native data stack. You will own architecture decisions, translate objectives into plans, and build reusable data capabilities using Python, Kubernetes...
- DomainTools is seeking a Senior Software Engineer to join our Engineering Team in Chicago. You’ll design and maintain web-scale data systems, mentor engineers, and drive productivity while delivering high-quality results. You should have 5+ years in Python/GoLang/Rust and...
- Heidrick & Struggles International, Inc. is seeking a Senior Data Engineer in Chicago to shape its data foundation. Your role involves owning complex data solutions, mentoring junior engineers, and collaborating with stakeholders to drive data-driven insights. The ideal...
- InRule Technology, Inc. in Chicago is seeking an experienced Senior Data Engineer to own and evolve the data architecture behind our decision intelligence platform. You will design data schemas, pipelines, and integrations, delivering reliable, well-governed data services...Flexible hours
$88k - $103k
Publicis Media is seeking an experienced Data Engineer to design and maintain scalable ETL and ELT pipelines using cloud-native technologies such as AWS and Databricks. The ideal candidate will have a Bachelor's degree in Information Technology and at least 4 years of experience...- ...globally dispersed, 100% remote company with a strong open-source focus, building data-driven identification and smart signals products. As Engineering Manager, Data Platform & ML Ops, you will lead 4-6 engineers, own the data warehouse and ML lifecycle, and partner with...Remote job
- Capgemini in Chicago is seeking a hands-on GCP Data Architect to design and build scalable, cloud-native data solutions. You will lead batch and real-time ingestion, leverage... ...hands-on delivery, with 7+ years in data engineering and strong communication to partner with...
- ...a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction... ...EngineerLead specializing in Hyper-scale Data Centers to act as Data Center Electrical Engineer Lead. The job incumbent will be responsible for designing...Work at officeLocal areaRemote workWorldwideFlexible hours
- Sidley Austin LLP in Chicago seeks a Senior Analytics Engineer to own recurring operational reporting and data processes across financial and HR data, with end-to-end ownership and tight monthly and year-end deadlines. The role emphasizes expert SQL analysis and developing...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineering Lead. Be the first to apply!
Related searches
- aws data engineer Illinois
- data center engineer Illinois
- big data cloud engineer Illinois
- senior data integration developer Illinois
- data developer Illinois
- data engineer contract Illinois
- data science developer Illinois
- finance data engineer Illinois
- senior data center engineer Illinois
- sr information security engineer Illinois