Sr Technical Lead Data Bricks

Openkyber

Atlanta, GA

Position : Sr Technical Lead Data Bricks

Location: Dallas, TX (Must be Onsite on needed basis)

Duration : Long Term Contract

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years

Realtime experience on databricks is must. Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark . Realtime experience on databricks is must. Evaluates and plans software designs, test results and technical manuals using AWS. Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions. Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.). Extend and enhance the business Data Lake. Create or implement solutions for metadata management. Solve for complex data integrations across multiple systems. Design and execute strategies for real-time data analysis and decisioning. Build robust data processing pipelines using AWS Services and integrate with multiple data sources. Translating client user requirements into data flows, data mapping, etc. Analyses and determines data integration needs and follows Agile practices.

Required Skills:

4+ years experience designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python
4 years experience with Python, Spark & Pyspark
3 years experience working on AWS technologies
Experience designing, building, and deploying production-level data pipelines using AWS Glue, Lambda, Kinesis with Aurora and Redshift
Spark programming experience (Pyspark or Scala)
Hands on with AWS components EMR, S3, Redshift, Lambda, API Gateway, Kinesis in production
Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques
Experience using ETL tools for data ingestion
Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB
Ability to translate data needs into detailed functional and technical designs

Thanks & Regards OpenKyber.

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Sr Technical Lead Data Bricks in Atlanta, GA vacancy

Sr Java DevSecOps Sr Technical Lead
...Amtrak resources or anyone from Railroad domain The Senior Technical Lead serves as the primary technical leader responsible for the... ...messaging and streaming platforms. Design and maintain scalable data models and complex data structures while ensuring data...
Data
Senior
Work experience placement
Openkyber
Atlanta, GA
2 days ago
Senior Technical Lead
...Title: Senior Technical Lead Description: Requirements for the Senior Technical Lead: • Over 8-10 years of experience... ...expertise in application architecture, integration strategies, and data migration methodologies. • Hands-on experience with diverse...
Data
Senior
3B Staffing LLC
Atlanta, GA
4 days ago
CCaaS Technical Lead, Senior Consultant
$130k - $200k
Position Summary CCaaS Technical Lead, Senior ConsultantOur Deloitte Sales & Service team empowers organizations to build deeper relationships... ..., commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and...
Data
Senior
Local area
Deloitte
Atlanta, GA
3 days ago
Senior Technical Lead
...Role: Senior Technical Lead Location: Atlanta, GA We are seeking a Technical Lead with over 10 years of relevant experience... ...teams using Boomi or similar middleware platforms to streamline data exchange. • Ensure compliance with organizational and...
Data
Senior
Equiliem
Atlanta, GA
3 days ago
Senior ERP Technical Manager or PeopleSoft HCM Technical Lead with Min 16yrs exp (Webcam or In Pers
...client We are looking for a Business Systems Technical Master (Min 16+ Yrs. Exp) ONSITE ( Either... .... This position shall be utilized to lead and support the overall PeopleSoft HCM application... ...Prior experience with the development of data extraction, translation and load programs...
Data
Senior
Local area
Immediate start
Openkyber
Atlanta, GA
2 days ago
Salesforce Technical Lead
...Opportunity ConstructConnect is seeking a Salesforce Technical Lead to serve as the primary technical authority for our enterprise... ...across the Salesforce core platform, quote-to-cash lifecycle, data integrity, and AI-assisted development practices....
Data
Contract work
Work at office
ConstructConnect™
Atlanta, GA
4 days ago
Oracle HCM Cloud Technical Integration Lead
$110.7k - $218.3k
...Consultant on the team, you will be responsible for: Leading the design, coordination, and delivery of Oracle HCM Cloud technical integrations across enterprise systemsDefining... .../outbound interfaces, middleware coordination, data mapping, and end-to-end validationPartnering...
Data
Local area
Deloitte
Atlanta, GA
3 days ago
Technical Lead, Forward Deployed Engineering
$111.3k - $215.1k
...others. If you're as passionate about your future as we are, join our team.KPMG is currently seeking a Technical Lead, Forward Deployed Engineering to join our AI & Data Labs practice.Responsibilities:Rapidly build and deploy end-to-end AI systems as part of a pod of...
Data
H1b
Local area
KPMG
Atlanta, GA
4 days ago
Technical Lead, Automation & AI Enablement
Technical Lead, Automation & AI EnablementRole Summary: At TireHub we move more than tires - we move... ...systems. This role will report to the Sr. Leader, BI & Analytics.When you say YES... ...ensure automation and AI solutions adhere to data privacy, access control, and compliance...
Data
Full time
Temporary work
Work at office
Local area
Flexible hours
TireHub
Atlanta, GA
2 days ago
Sr. Informatica Cloud / ETL Developer
...operations support, correct failures, do workflow modifications.Make system improvementsParticipates on (and may lead) projects where analysis of systems or data requires an in-depth evaluation of complex business process, system process, and industry standards.Regularly...
Data
Senior
NTT DATA
Atlanta, GA
17 hours ago
Salesforce Technical Lead
...Salesforce Technical Lead Location: Atlanta, GA Duration: Full Time Job Description:... ...Salesforce platform on as technical lead/Sr Dev. ~ Experience working on a minimum... ...understands the basic workings of Understand data migration considerations, design trade-...
Data
Full time
JConnect Infotech
Atlanta, GA
4 days ago
Sr. Lead Software Engineer
...deliver top-notch technology products. As a Sr. Lead Software Engineer at JPMorgan Chase... ...secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting... ...use in engineering workflows, including data sensitivity considerations, secure...
Data
Senior
For contractors
JP Morgan Chase
Atlanta, GA
1 day ago
Salesforce Technical Lead
...Salesforce Technical Lead Salesforce Team is growing rapidly and is looking to add experienced Salesforce Technical Leads to join our team... ...offshore. You'll oversee programmatic elements, Integration, Data Migration and we'll need you to have a strong understanding of...
Data
Work experience placement
Work at office
Monday to Thursday
ClifyX
Atlanta, GA
4 days ago
Sr. Software Developer - EtQ Reliance Team
...Sr. Software Developer: Atlanta Ga, Key Responsibilities: Design, develop, and maintain custom features and integrations within... ...and support APIs and scripts to enable automation and seamless data exchange. Troubleshoot issues and support the configuration,...
Data
Senior
Datum Technologies Group
Atlanta, GA
4 days ago
Technical Project Lead - Tekion
...global reach, we promise to know you and help you.CLA is seeking a Technical Lead Consultant - Tekion. This role leads technical and functional... ...issues into training, configuration, workflow, integration, data, or product-defect issues to decide the right correction....
Data
Full time
CliftonLarsonAllen
Atlanta, GA
17 hours ago
Sr. DevOps Engineer / DevOps Architect
$117.2k - $223.9k
...Ready to level-up your career at the company leading workforce transformation in the agentic... ...collaboration with Delivery Managers, Technical Architects, Solution Architects, and Account... ..., Experience, Industries (Vlocity), and Data Cloud.Strong understanding of environment...
Data
Senior
Full time
Remote work
Salesforce
Atlanta, GA
1 day ago
Sr. Lead QA Test Automation Engineer
...be local to Metro AtlantaAs a Sr. LeadQA Test Automation Engineer... ...and Team Management: Lead, mentor, and manage a team of... ...validation of functionalities and data integrity.Root Cause Analysis:... ...microservices systems is required.Technical Expertise: Proficiency in automated...
Data
Senior
Work at office
Local area
American Technology Consulting
Atlanta, GA
17 hours ago
Sr .NET Developer
...Hands-on migration of legacy ASP.NET applications to .NET 6/7/8/10 . Strong SQL Server, T-SQL, stored procedures, data migration, and performance tuning experience. Hands-on Azure App Services, Azure Functions, Azure DevOps CI/CD ....
Data
Senior
Apex Informatics
Atlanta, GA
2 days ago
Sr. Solutions Architect - Retail, Travel & Hospitality
$219.1k - $301.3k
...large enterprises become more data-driven. Working with the... ...(AE), the Retail and CPG Sr. SA defines and directs the technical strategy for our largest... ...most important accounts, leading to more widespread use of... ...includes Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and...
Data
Senior
Local area
Worldwide
DataBricks
Atlanta, GA
4 days ago
Sr Software Engineer
$170.6k - $261.3k
...Collect team builds the platform that determines what vehicle data to collect, validates collection configurations, deploys them... ...coverage, recording volume, ingestion latency, and data quality. Lead technical design and deliver cross-team initiatives involving vehicle...
Data
Senior
Full time
Local area
Remote work
Work from home
Relocation package
Flexible hours
General Motors
Atlanta, GA
1 day ago
Sr Fullstack .Net modernization developer
Job-ID33135707Reference26-03190 Job Title: (Sr Fullstack .Net modernization developer)About Kyyba:Founded in 1998 and headquartered in... ...-sector systems — you understand compliance, auditability, and data sensitivityFamiliarity with ADA/WCAG 2.1 AA accessibility standardsExposure...
Data
Senior
Kyyba
Atlanta, GA
17 hours ago
Celfocus / Zuora Billing OSS/BSS Implementation Technical Lead
...Hiring: Celfocus / Zuora Billing OSS/BSS Technical Lead Location: Remote Experience: 7+ Years We are looking for a Celfocus OSS/BSS Technical... ...Architecture REST/SOAP APIs and Integrations SQL & Data Analysis Production Support & Troubleshooting Strong...
Data
Remote work
Openkyber
Atlanta, GA
2 days ago
Sr Software Engineer - Full Stack
...strengthen the public trust. Category-leading products include enterprise... ..., and transparency and open data. These solutions come together... ...build systems that scale.As a Sr. Software Engineer, you will... ...for a fearless, hands-on technical leader who thrives on tackling...
Data
Senior
Contract work
Work at office
Local area
Immediate start
OpenGov
Atlanta, GA
1 day ago
Senior Software Engineering - Machine Learning
...AI integration, Databricks administration, data lake management, and cloud platform... ...installed base, we are uniquely positioned to lead the industrial sector’s transition from automation... ...work on Azure, GCP and data platform data bricks governance and make sure SRE best practice...
Data
Senior
Temporary work
Flexible hours
Honeywell
Atlanta, GA
17 hours ago
Sr Principal / Architect Engineer Software - Backend, Alerting (Chronosphere)
...Chronosphere empowers customers to focus on the data and insights that matter by reducing... ...polished, effective user experiences.Lead development of user experiences that surface... ...to delivery either independently or as a technical leader of a small team, all while...
Data
Senior
Full time
Remote work
Flexible hours
Palo Alto Networks
Atlanta, GA
17 hours ago
Java Technical Lead
...Job Title: Java Technical Lead Location: Atlanta, GA (3 Days Onsite - Local Candidates Only) Job Type: Contract... ...architectures, and container technologies Exposure to AI/ML, Data Engineering, or Digital Transformation programs Relevant...
Data
Contract work
Local area
Inficare
Atlanta, GA
4 days ago
Manager, SAP SuccessFactors Technical Lead
...opportunities, a world-class training facility, and leading market tools, we help our people continue... ...seeking a Manager, SAP SuccessFactors Technical Lead to join our Advisory Services... ...cloud architecture and securityOversee data migration strategies, employee data models...
Data
Local area
KPMG
Atlanta, GA
2 days ago
Sr. Node/React Developer
$120k - $125k
...GorusuCompany: SRI Tech SolutionsJob Title: Sr. Node/React DeveloperLocation: Atlanta, GA... ...or Express based framework.Integration of data storage solutions which can include... ...Identify and correct bottlenecks and fix bugs.Technical Skills:Good object-oriented software design...
Data
Senior
Full time
Contract work
SRI Tech
Atlanta, GA
17 hours ago
Sr Software Engineer - United States
...(SE&I) team is looking for a Sr. Software Engineer to help solve... ...software engineering, AI, and data-driven decision making.You... ...results from collaborating with non-technical partners to solve business... ...Pacific is one of the world's leading makers of tissue, pulp, packaging...
Data
Senior
Work at office
Flexible hours
Georgia-Pacific
Atlanta, GA
4 days ago
Sr Data Engineer -- Assortment and Space Planning
...something bigger.Position Purpose:Data Engineers within the... ...integrity on an automated basis.The Sr. Data Engineer position creates... ...and storage. Beyond this technical ownership, the role mentors and... ...Analysis: Collaborate with team leads and cross functional partners...
Data
Senior
Full time
Work experience placement
Night shift
Home Depot
Atlanta, GA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Technical Lead Data Bricks. Be the first to apply!