Sr Technical Lead Data Bricks

Openkyber

Atlanta, GA

Position : Sr Technical Lead Data Bricks

Location: Dallas, TX (Must be Onsite on needed basis)

Duration : Long Term Contract

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years

Realtime experience on databricks is must. Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark . Realtime experience on databricks is must. Evaluates and plans software designs, test results and technical manuals using AWS. Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions. Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.). Extend and enhance the business Data Lake. Create or implement solutions for metadata management. Solve for complex data integrations across multiple systems. Design and execute strategies for real-time data analysis and decisioning. Build robust data processing pipelines using AWS Services and integrate with multiple data sources. Translating client user requirements into data flows, data mapping, etc. Analyses and determines data integration needs and follows Agile practices.

Required Skills:

4+ years experience designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python
4 years experience with Python, Spark & Pyspark
3 years experience working on AWS technologies
Experience designing, building, and deploying production-level data pipelines using AWS Glue, Lambda, Kinesis with Aurora and Redshift
Spark programming experience (Pyspark or Scala)
Hands on with AWS components EMR, S3, Redshift, Lambda, API Gateway, Kinesis in production
Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques
Experience using ETL tools for data ingestion
Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB
Ability to translate data needs into detailed functional and technical designs

Thanks & Regards OpenKyber.

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Sr Technical Lead Data Bricks in Atlanta, GA vacancy

Sr Java DevSecOps Sr Technical Lead
...Amtrak resources or anyone from Railroad domain The Senior Technical Lead serves as the primary technical leader responsible for the... ...messaging and streaming platforms. Design and maintain scalable data models and complex data structures while ensuring data...
Data
Senior
Work experience placement
Openkyber
Atlanta, GA
2 days ago
Senior Technical Lead
...Title: Senior Technical Lead Description: Requirements for the Senior Technical Lead: • Over 8-10 years of experience... ...expertise in application architecture, integration strategies, and data migration methodologies. • Hands-on experience with diverse...
Data
Senior
3B Staffing LLC
Atlanta, GA
5 days ago
Senior Technical Lead
...Job Summary: We are seeking a Technical Lead with over 10 years of relevant experience in modern technologies to provide architectural... ...using Boomi or similar middleware platforms to streamline data exchange. Ensure compliance with organizational and...
Data
Senior
Apex Informatics
Atlanta, GA
4 days ago
Senior ERP Technical Manager or PeopleSoft HCM Technical Lead with Min 16yrs exp
...client We are looking for a Business Systems Technical Master (Min 16+ Yrs. Exp) ONSITE ( Either... .... This position shall be utilized to lead and support the overall PeopleSoft HCM application... ...Prior experience with the development of data extraction, translation and load programs...
Data
Senior
Local area
Immediate start
Openkyber
Atlanta, GA
2 days ago
Salesforce Technical Lead
...Opportunity ConstructConnect is seeking a Salesforce Technical Lead to serve as the primary technical authority for our enterprise... ...across the Salesforce core platform, quote-to-cash lifecycle, data integrity, and AI-assisted development practices....
Data
Contract work
Work at office
ConstructConnect™
Atlanta, GA
5 days ago
Sr. Salesforce Engineer
Looking for strong hands-on experience with Salesforce Sales & Service Cloud, Agentforce, Omnichannel and preferably Data Cloud. Must be a strong individual contributor with Salesforce integration experience. Description : ~ Opportunity Name / Requirement...
Data
Senior
Saxon Global
Atlanta, GA
16 hours ago
Salesforce Technical Lead
...Salesforce Technical Lead Location: Atlanta, GA Duration: Full Time Job Description:... ...Salesforce platform on as technical lead/Sr Dev. ~ Experience working on a minimum... ...understands the basic workings of Understand data migration considerations, design trade-...
Data
Full time
JConnect Infotech
Atlanta, GA
5 days ago
Sr. Software Developer - EtQ Reliance Team
...Sr. Software Developer: Atlanta Ga, Key Responsibilities: Design, develop, and maintain custom features and integrations within... ...and support APIs and scripts to enable automation and seamless data exchange. Troubleshoot issues and support the configuration,...
Data
Senior
Datum Technologies Group
Atlanta, GA
5 days ago
Sr. Software Engineer
...processes. Translate business requirements into scalable Salesforce solutions aligned with UTA’s Client Framework and Authoritative Data models. Support the migration and mapping of data from Airtable, Quickbase, and Google Sheets into Salesforce. Collaborate with cross...
Data
Senior
Yantran LLC
Atlanta, GA
4 days ago
Sr .NET Developer
...Hands-on migration of legacy ASP.NET applications to .NET 6/7/8/10 . Strong SQL Server, T-SQL, stored procedures, data migration, and performance tuning experience. Hands-on Azure App Services, Azure Functions, Azure DevOps CI/CD ....
Data
Senior
Apex Informatics
Atlanta, GA
3 days ago
Java Technical Lead
...Job Title: Java Technical Lead Location: Atlanta, GA (3 Days Onsite - Local Candidates Only) Job Type: Contract... ...architectures, and container technologies Exposure to AI/ML, Data Engineering, or Digital Transformation programs Relevant...
Data
Contract work
Local area
Inficare
Atlanta, GA
5 days ago
Celfocus / Zuora Billing OSS/BSS Implementation Technical Lead
...Hiring: Celfocus / Zuora Billing OSS/BSS Technical Lead Location: Remote Experience: 7+ Years We are looking for a Celfocus OSS/BSS Technical... ...Architecture REST/SOAP APIs and Integrations SQL & Data Analysis Production Support & Troubleshooting Strong...
Data
Remote work
Openkyber
Atlanta, GA
2 days ago
Sr. Salesforce Developer
...Candidates Description: Sr Salesforce Developer Location: ATL, GA... ...needs of the business. Maintain and update technical documentation related to implemented... ...Exposure to advanced Salesforce features like Platform Events and Change Data Capture....
Data
Senior
Contract work
Immediate start
3B Staffing LLC
Atlanta, GA
5 days ago
Sr. Software Engineer
...The Weather Company is the world's leading weather provider, helping people and businesses... ...The Weather Company's high-volume weather data, insights, advertising, and media... ...block automation opportunities Influence technical direction across SSDS development and operational...
Data
Senior
Flexible hours
The Weather Channel
Atlanta, GA
17 hours ago
Sr. Software Engineer
...The Sr. Software Engineer is primarily responsible for the design and development of software... ...are expected to foster high performing technical teams. You will be required to collaborate... ...Experience with Elasticsearch, including data modeling, indexing, and querying. Hands-on...
Data
Senior
RIT Solutions, Inc.
Atlanta, GA
2 days ago
Snowflake Technical Lead
$140k - $160k
...Role: Snowflake Technical Lead Location: Atlanta GA Salary Range: $140000 - $160000/Year Job Description Must Have Technical/Functional... ...skills Worked on Modern Cloud Datawarehouse Architecture (Data Lake Data warehouse). Having strong experience on Azure...
Data
Full time
Work experience placement
Work at office
Diverse Lynx LLC
Atlanta, GA
1 day ago
Sr. SAP Technical Consultant
...analyze business requirements and provide technical solutions. Work on SAP EWM and SAP RFID... ...planning, estimation, and progress reporting. Leads and develops technical and business... ...to existing, and development of required data and reporting standards. Develops technical...
Data
Senior
Next Level Business Services, Inc.
Atlanta, GA
5 days ago
Sr Software Engineer
...Sr. Software Engineer - Atlanta The Bank is the most sought... ...skills and experience to provide technical guidance, estimation of... ...knowledge of our microservices, our data architecture and databases,... ...team members can understand, lead them to a successful implementation...
Data
Senior
Temporary work
Professional Recruiters
Atlanta, GA
5 days ago
Technical Lead, Automation & AI Enablement
...Job Description:\n\nTechnical Lead, Automation & AI Enablement\nRole... ...Automation & AI Enablement Technical Lead is a hands-on technical leader... ...nThis role will report to the Sr. Leader, BI & Analytics.\nWhen... ...and AI solutions adhere to data privacy, access control, and...
Data
Temporary work
Work at office
Local area
Flexible hours
TireHub, LLC
Atlanta, GA
27 days ago
Sr Cloud Architect
...Sr Cloud Architect *MUST BE LOCAL TO METRO ATLANTA** JOB SUMMARY: The Senior Cloud... ..., improve citizen engagement, and drive data-informed decision-making — all while... ...services industry. ~5-8 years of hands-on technical application architecture experience, including...
Data
Senior
Work experience placement
Local area
GlobalPoint
Atlanta, GA
4 days ago
Sr SalesForce Developer
...Role: Sr Salesforce Developer Location: Salt Lake City / Sandy, Utah, Phoenix... ...improvement. Promote inner sourcing. Lead and mentor a team of 5-8 junior engineers.... .... ~ Strong knowledge of Application, data security, and finance-related compliance...
Data
Senior
United IT Solutions
Atlanta, GA
1 day ago
Sr Software Engineer Atlanta Hybrid
~ Hybrid Job Description As a Sr Software Engineer youll play a critical role in shaping the future of our platform and directly... .... Your work will enable faster product delivery smarter data insights and a more seamless experience for users around the world...
Data
Senior
Full time
Work at office
Speria
Atlanta, GA
1 day ago
Sr. Structural Engineer
...Sr. Structural Engineer Senior Structural Engineer/Designer Responsibilities/Project Types/Experience Required Designing structural... ...variety of project types, including manufacturing, distribution, data center, commercial, self-storage, churches, historical, public...
Data
Senior
TOP DOG Inc
Atlanta, GA
4 days ago
Senior Software Engineering
...Your Job Koch Technology Data Solutions (KTDS) is seeking a Senior Software Engineer... ...engineering with solution architecture, leading complex initiatives and applying AI-DLC... ...value. The ideal candidate is a technically strong engineer who enjoys solving complex...
Data
Senior
Work at office
Flexible hours
Koch
Atlanta, GA
3 days ago
Senior Advanced Software Engineer
...integration, Databricks administration, data lake management, and cloud platform initiatives... ...on Azure, GCP and data platform data bricks governance and make sure SRE best... ...In addition to a competitive salary, leading-edge work, and developing solutions side-...
Data
Senior
Temporary work
Flexible hours
Honeywell Technologies
Atlanta, GA
2 days ago
Sr Software Engineer
...(SE&I) team is looking for a Sr. Software Engineer to help solve... ...software engineering, AI, and data-driven decision making. You... ...from collaborating with non-technical partners to solve business problems... ...Pacific is one of the world's leading makers of tissue, pulp,...
Data
Senior
Work at office
Visa sponsorship
Flexible hours
Koch Industries
Atlanta, GA
5 days ago
Technical Enablement Team Lead
...becoming the worldwide market leader – don't miss it! As Technical Enablement Team Lead , you will lead the strategy, execution and continuous... ...experiences are organized, current and scalable Use platform data and field feedback to improve content discoverability,...
Data
Remote work
Worldwide
Flexible hours
Cato Networks
Atlanta, GA
14 days ago
Sr Director, Software Engineering
$175k - $185k
.... What You'll Be Doing: Sr. Director, AI Platform Engineering... ...of AI Platform Engineering leads the engineering teams... ...closely with Architecture, Product, Data Engineering, Security and the... ...obsession, product mindset, and technical excellence. What You Will Be...
Data
Senior
Full time
Immediate start
Work from home
Evolent
Atlanta, GA
2 days ago
Sr. Software Engineer
...Sr. Software Engineer - 100% Remote Candidates will need to take an assessment test before submitting. Must have great communication... ...critical enterprise applications. ~ Strong proficiencies in data structures, algorithms, and design patterns. ~ Experience with...
Data
Senior
Remote work
RIT Solutions
Atlanta, GA
2 days ago
Sr. Power BI Developer
$55 - $58 per hour
...building Executive Leadership Dashboards (ELD), Data Quality Readiness Reports, gap assessment... ...objectives and reporting vision. Lead the development of key reporting... ...reporting requirements and translate them into technical solutions. Work closely with Data...
Data
Senior
ApTask
Atlanta, GA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Technical Lead Data Bricks. Be the first to apply!