Sr Technical Lead Data Bricks

Openkyber

Position : Sr Technical Lead Data Bricks

Location: Dallas, TX (Must be Onsite on needed basis)

Duration : Long Term Contract

Mandatory skills: AWS, Databricks, Python, Spark & Pyspark

Key Responsibilities:

Experience: 6 to 10 years

Realtime experience on databricks is must.

Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .

Evaluates and plans software designs, test results and technical manuals using AWS.

Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.

Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).

Extend and enhance the business Data Lake.

Create or implement solutions for metadata management.

Solve for complex data integrations across multiple systems.

Design and execute strategies for real-time data analysis and decisioning.

Build robust data processing pipelines using AWS Services and integrate with multiple data sources.

Translating client user requirements into data flows, data mapping, etc.

Analyses and determines data integration needs and follows Agile practices.

Required Skills:

At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.

At least 4 years of experience with Python, Spark & Pyspark.

At least 3 years of experience working on AWS technologies.

Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.

Experience with Spark programming ( Pyspark or scala ).

Hands on experience with AWS components like ( EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.

Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.

Experience using ETL tools for data ingestion.

Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.

Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Sr Technical Lead Data Bricks in Hawaii County, HI vacancy

Diagnostic Cardiac Sonographer Sr - Kailua Kona $10K Sign On Bonus!
...Job Summary: Performs variety of technical, patient-attending, and clerical duties pertaining to echocardiography. Essential Responsibilities... ...of significant functional and/or anatomical and pathological data obtained. Reviews, screens, and measures echocardiography...
Data
Senior
Permanent employment
Contract work
Relocation package
Kaiser Permanente
Kailua Kona, HI
1 day ago
Sr. Manufacturing Engineer
...role is for you.What you’ll doSupport production teams to resolve technical issues and maintain scheduleGenerate manufacturing and test... ...organizational skills (required)Proficiency in Microsoft Office for data-driven reporting (required)Must be a U.S. Citizen and able to...
Data
Senior
Minimum wage
Full time
Work experience placement
Work at office
Local area
Worldwide
Flexible hours
Teledyne FLIR
Mountain View, HI
1 day ago
Senior Software Engineer
...powering dynamic and user-friendly experiences. Make high-level technical and architectural decisions to ensure our solutions are secure,... ...-driven mindset has become part of our DNA and helps us make data-driven decisions. If you have interests across these domains,...
Data
Senior
For contractors
Live in
Remote work
SageSure
Mountain View, HI
3 days ago
Sr. Contracts Negotiator
...identify proposal parameters/requirements. Leads price negotiations for Teledyne,... ...contractual/program risks, compiles and analyzes data and maintains historical information.... ...contract compliance requirements; price, technical, schedules, risk and customer satisfaction...
Data
Senior
Minimum wage
Full time
Contract work
Work experience placement
Local area
Worldwide
Flexible hours
Teledyne FLIR
Mountain View, HI
3 days ago
Police Documents Clerk - SR-11
...Hawai'i Police Department - Technical Services - Records and Identification Division There... ...of the list. Temporary appointment may lead to conversion to permanent appointment.... ...and manual files; inputs wanted person's data. Researches, compiles, and prepares information...
Data
Senior
Permanent employment
Full time
Temporary work
Part time
Work at office
Immediate start
Flexible hours
USDN Inc.
Hilo, HI
10 hours ago
Wastewater Operations Superintendent - SR-24
...they arise during the life of the list. Temporary appointment may lead to conversion to permanent appointment. Examples of Duties... ...or employee complaints. Oversees the maintenance of records, data, and files; prepares operational reports. Develops, organizes,...
Data
Senior
Odd job
Permanent employment
Full time
Temporary work
Part time
For contractors
Work experience placement
Immediate start
Flexible hours
USDN Inc.
Hilo, HI
22 hours ago
AERC Sr. Project Manager
...seeking a full-time, Senior Project Manager to lead a $500,000 annual wetland and coastal... ...Center's externally funded research and technical projects. Working closely with the AERC... ...project management, research administration, data analysis, proposal development, sponsor...
Data
Senior
Full time
Contract work
For subcontractor
Work at office
Immediate start
Remote work
Visa sponsorship
Relocation package
University of Alaska Fairbanks
Hawaii County, HI
11 days ago
Senior Tax Analyst
...and have significant impact on issues facing the operating unit. Leads Business Reviews of field and headquarters offices, serves on... ...areas to discern trends in program delivery. Consolidates report data to measure the effectiveness in meeting baselines or the degree...
Data
Senior
Treasury Department
Hilo, HI
1 day ago
Network Engineer Senior
...and resiliency needs across mission partner environments. Provide tactical data link expertise to support joint, coalition, and mission partner interoperability. Coordinate technical requirements involving operational communications, network integration, and data...
Data
Senior
Work from home
Flexible hours
General Dynamics Information Technology
Hawaii County, HI
a month ago
Senior Network Administrator
$140k - $165k
...team responsible for evaluating customer requirements on complex technical challenges. You will aid by providing solutions to complex... ...Testing and Training Ranges, Military Instrumentation Systems Data Analysis Experience working with DoD Wide Area Networks and...
Data
Senior
Full time
Local area
KBR
Hawaii County, HI
a month ago
Staff Software Engineer
$150k - $226k
...funding and is valued at $5.5B, backed by leading investors including Goldman Sachs, Menlo... ...& Senior Software Engineers and provide technical leadership to themPerforms peer reviews of... ...database technologiesSolid foundation in data structures, algorithms and software design...
Data
Local area
Immediate start
Flexible hours
Shift work
Harness
Mountain View, HI
2 days ago
Wastewater Treatment Plant Senior Operator - Kona
$35.98 - $44.01 per hour
...tests. Providing leadership to WWTP Operators. Interpreting data and making recommendations to improve plant equipment and... ...approaches in response to situations encountered. Professional & technical knowledge: Understands different treatment processes, for...
Data
Senior
Hourly pay
Shift work
Weekend work
Aqua Engineers Inc
Kailua Kona, HI
22 hours ago
Data Architect
...Job Title: Senior Data Architect Location: Windsor, CT (5 Days from office) Duration: 12 Months contract About the Role: We are seeking a Senior Data Architect to lead enterprise data strategy, data platform modernization, and solution design. This role works directly...
Data
Contract work
Work at office
Openkyber
Hawaii County, HI
1 day ago
Senior Systems Administrator
...• Experience with infrastructure including but not limited to: data center operations, server hardware, operating systems (Windows,... ...Experience 5 + years of related experience * may vary based on technical training, certification(s), or degree Certification...
Data
Senior
Work experience placement
Weekend work
Afternoon shift
General Dynamics Information Technology
Hawaii County, HI
21 days ago
Platform Engineer
...opinion because it makes their work better. Preferred Experience with high-volume streaming pipelines for observability data (Kafka, Vector, Fluent Bit, etc.). Background in AI/ML infrastructure observability: GPU utilisation, training job visibility,...
Data
Openkyber
Hawaii County, HI
1 day ago
Data Architect
...Role : (Data) Databrick Architect Location : Tarrytown New York (Onsite)... ...Project Key Responsibilities & Skills: Lead enterprise-scale data platform modernization... ...excellence practices Provide technical leadership, mentoring, architecture reviews...
Data
Openkyber
Hawaii County, HI
1 day ago
Senior Laboratory Assistant - Lanihuli Patient Service Center
$23.68 - $26.05 per hour
...performs tasks to support the laboratory technical staff in specimen procurement, specimen processing... ...experience in clinical laboratory, data entry, or production We’ll give... ...that a global culture of Medical Leadership leads to the delivery of outstanding medical...
Data
Senior
Full time
Local area
Shift work
Clinical Laboratories of Hawaii, LLP
Hilo, HI
10 hours ago
SENIOR COOK (FULL TIME AND PART TIME)
$19 per hour
...jobs with Compass Group. Message frequency varies. Message and data rates may apply. Text STOP to opt out or HELP for help. Terms and... ...journey with us today! Flik Independent School Dining has been leading the way in transforming private and independent school...
Data
Senior
Hourly pay
Full time
Part time
Local area
Immediate start
Remote work
Monday to Friday
Flexible hours
Shift work
Compass Group, North America
Kamuela, HI
1 day ago
Mid - System Engineer (w/ active Secret)
$99k - $128k
...troubleshooting.This position will serve as a technical resource and escalation point for complex... ....PRIMARY ROLES AND RESPONSIBILITIES: Lead efforts to identify, troubleshoot,... ...policies, and associated network configuration data.Ensure configuration changes are properly...
Data
Full time
Flexible hours
Critical Solutions
Hawaii County, HI
1 day ago
Platform Engineer
...week) Duration: Fulltime Note: Must have startup/data platform experience, Amazon Mechanical Turk or Meta GenAI... ...Strong Individual Contributor (IC) who is still hands-on technically NOT A FIT: Undergraduate degree outside Canada/Europe...
Data
Full time
Contract work
Openkyber
Hawaii County, HI
1 day ago
Azure Engineer
...distinctive skills will contribute to a winning culture and team. As a Lead Data Engineering at OpenKyber within the Consumer and Community... ...transformations Translate complex business requirements into technical solutions meeting data lake and data warehousing standards....
Data
Openkyber
Hawaii County, HI
1 day ago
Azure DevOps Engineer
...service providers. Note that if you choose to communicate with OpenKyber via text messaging the frequency may vary, and message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You will always have the right to cease communicating...
Data
Hourly pay
Contract work
Openkyber
Hawaii County, HI
1 day ago
Principal / Director, Product Management - Code & Container Security
$240k - $265k
...funding and is valued at $5.5B, backed by leading investors including Goldman Sachs, Menlo... ...exploitability analysis, or automated remediation.Technical background in software engineering,... ...committed to protecting your personal data. For additional information on this topic...
Data
Work at office
Local area
Immediate start
Flexible hours
Shift work
Harness
Mountain View, HI
4 days ago
Staff Software Engineer - Data Platform
$180k - $220k
...$570M in funding and is valued at $5.5B, backed by leading investors including Goldman Sachs, Menlo Ventures,... ...Position SummaryWe are seeking a talented and experienced Data Platform Engineer to join our team as the Technical Lead. The ideal candidate will be responsible for...
Data
Local area
Immediate start
Flexible hours
Shift work
3 days per week
Harness
Mountain View, HI
3 days ago
Senior Principal MMIC Design Engineer
...validation including S-parameters, output power, efficiency, noise figure, and linearity measurementsMentor junior designers and provide technical leadershipCollaborate with cross-functional teams throughout the product development cycleAssist in proposals, system architecture...
Senior
Full time
Work experience placement
Local area
Flexible hours
Teledyne FLIR
Mountain View, HI
6 hours ago
Senior Small Business Specialist - Accountant
$55k - $85k
...Ability to maintain an accounts receivable and accounts payable subsidiary ledger system. ~ General computer operations - QuickBooks, data input, and processing. ~ Must maintain strict client confidentiality. ~ High level of intelligence, integrity, honesty,...
Data
Senior
Full time
Local area
Flexible hours
Taketa, Iwata, Hara & Associates, LLC
Hilo, HI
18 days ago
Project Analytic Integrator
$113.33k - $188.88k
...from multiple sources and disciplines. Incorporate new and legacy data into cohesive, all-source intelligence products, ensuring timely... ...Ability to build and sustain professional relationships Ability to lead projects or workstreams Ability to manage and prioritize...
Data
Local area
Shift work
Deloitte LLP
Hawaii County, HI
23 days ago
Travel Occupational Therapist (OT) - $2,116 per week in Hilo, HI
$2,116 per week
...calls, AI-generated calls, text messages, or emails from Prime HealthCare Staffing. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered message. You can reply STOP to cancel and HELP for help. Requirements...
Data
Full time
Contract work
Shift work
Prime HealthCare Staffing
Hilo, HI
1 day ago
Senior Estimator - Construction
...labor, and equipment. Develop accurate project budgets and bid proposals based on scope and market conditions. Analyze historical data, subcontractor quotes, and material costs to optimize pricing. Collaborate with project managers, architects, engineers, and...
Data
Senior
Contract work
For contractors
For subcontractor
Work at office
Flexible hours
US Pacific Inc
Kailua Kona, HI
15 days ago
Travel Speech Language Pathologist (SLP) - $2,781 per week in Hilo, HI
$2,781 per week
...calls, AI-generated calls, text messages, or emails from Prime HealthCare Staffing. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered message. You can reply STOP to cancel and HELP for help. Requirements...
Data
Full time
Contract work
Shift work
Prime HealthCare Staffing
Hilo, HI
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Technical Lead Data Bricks. Be the first to apply!