Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr Technical Lead Data Bricks

Openkyber

Position : Sr Technical Lead Data Bricks



Location: Dallas, TX (Must be Onsite on needed basis)



Duration : Long Term Contract



Mandatory skills: AWS, Databricks, Python, Spark & Pyspark



Key Responsibilities:
  • Experience: 6 to 10 years
  • Realtime experience on databricks is must.
  • Collaborate as part of a development team to design and enhance large scale applications developed using Python, Spark & Pyspark .
  • Evaluates and plans software designs, test results and technical manuals using AWS.
  • Confer with business units and development staff to understand both the business and technical requirements for producing technical solutions.
  • Create and review technical and user-focused documentation for data solutions (data models, data dictionaries, business glossaries, process and data flows, architecture diagrams, etc.).
  • Extend and enhance the business Data Lake.
  • Create or implement solutions for metadata management.
  • Solve for complex data integrations across multiple systems.
  • Design and execute strategies for real-time data analysis and decisioning.
  • Build robust data processing pipelines using AWS Services and integrate with multiple data sources.
  • Translating client user requirements into data flows, data mapping, etc.
  • Analyses and determines data integration needs and follows Agile practices.
Required Skills:
  • At least 4+ years of experience on designing and developing Data Pipelines for Data Ingestion or Transformation using Scala or Python.
  • At least 4 years of experience with Python, Spark & Pyspark.
  • At least 3 years of experience working on AWS technologies.
  • Experience of designing, building, and deploying production-level data pipelines using tools from AWS Glue, Lamda, Kinesis using databases Aurora and Redshift.
  • Experience with Spark programming ( Pyspark or scala ).
  • Hands on experience with AWS components like ( EMR, S3, Redshift, Lamdba, API Gateway, Kinesis ) in production environments.
  • Strong analytical skills and advanced SQL knowledge, indexing, query optimization techniques.
  • Experience using ETL tools for data ingestion.
  • Experience with Change Data Capture (CDC) technologies and relational databases such as MS SQL, Oracle and DB.
  • Ability to translate data needs into detailed functional and technical designs for development, testing and implementation.

For applications and inquiries, contact:View email address on us.fitly.work

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Sr Technical Lead Data Bricks in Maine vacancy
  •  ...analytics, budget oversight, and marketing governance. The ideal candidate brings deep experience leading complex initiatives, influencing senior stakeholders, and leveraging data and insights to improve operational effectiveness and business outcomes.ResponsibilitiesLead a... 
    Data
    Senior

    Tyler Technologies

    Yarmouth, ME
    3 days ago
  •  ...Description We are looking for an experienced Sr. Accountant to support key accounting...  ...driven environment. Responsibilities: • Lead month-end close activities by preparing...  ...items. • Support the accuracy of financial data within QuickBooks through regular review,... 
    Data
    Senior
    Contract work
    Part time

    Robert Half

    Portland, ME
    4 days ago
  • $88.1k - $172.9k

     ...with all contractual requirements.Provide technical support to BIW’s Manufacturing...  ...presentations at group meetings.Ability to lead, organize, plan, and execute projects.Demonstrated...  ...network communication and protocols and data collection.Experience working on power systems... 
    Data
    Senior
    For subcontractor
    Interim role
    Work at office
    Local area
    Flexible hours

    General Dynamics - Bath Iron Works

    Bath, ME
    1 day ago
  •  ...experience with DB2/SQL, FTP, DB2 Connect, TSO/ISPF, ¿ HOD, CRIF, Data Studio, RapUp, IBM socket connections, Rexx ¿ Knowledge in IMS...  ...code reviews ¿ Write scripts to validate that the code meets technical and functional specifications ¿ Work with team members to establish... 
    Data

    Procyon TS

    Detroit, ME
    4 days ago
  • $88.1k - $142k

     ...requirements.Develop/maintain and provide technical leadership for all assigned systems,...  ...presentations at group meetings.Ability to lead, organize, plan, and execute projects.Demonstrated...  ...network communication and protocols and data collection.Experience working on power... 
    Data
    Senior
    Contract work
    For subcontractor
    Interim role
    Work at office
    Flexible hours

    General Dynamics - Bath Iron Works

    Brunswick, ME
    3 days ago
  •  ...Role: Tech Lead Location: - Dallas(TX) Detailed JD:- 6-10 years of relevant experience in Apps Development or systems analysis...  ...knowledge in GenAI , Machine Learning (ML modeling), Data Science, Statistics, and AI fundamentals, including Natural Language... 
    Data

    Yantran LLC

    Rangeley, ME
    4 days ago
  • $90.26k - $125k

     ...Sr. Sales Operations Analyst Apply Online A Sr. Sales Operations Analyst collects, cleans, and interprets complex sales data to identify trends, enhance performance, and drive revenue growth. They create actionable reports, build dashboards, and support forecasting... 
    Data
    Senior
    Work at office
    Local area
    Remote work

    Tyler Technologies

    Yarmouth, ME
    4 days ago
  • $24.11 - $28.56 per hour

     ...maintain strong relationships with clients and sales partners. Lead and manage e-commerce program activities to meet and exceed...  ...and reporting to ensure seamless client experiences. Analyze data to monitor account performance and create actionable insights.... 
    Data
    Senior
    Hourly pay
    Remote work

    Geiger Brothers

    Lewiston, ME
    21 days ago
  • $18.19 - $27.34 per hour

     ...functions, including, but not limited to, photocopying, filing, faxing, emailing and answering telephone Reviews, researches and/or enters data in various systems to support respective functional area Compiles data and provides various regular and adhoc reports to management... 
    Data
    Senior
    Hourly pay
    For contractors
    Work at office

    FedEx Group

    Portland, ME
    3 days ago
  • $128.6k - $192.9k

     ...projects that will benefit future generations. Grow with us, H2O+U.Your OpportunityWe’re looking for a Senior Project Manager / Technical Lead experienced in Conveyance who’s passionate about shaping water infrastructure and making a real impact within the community. In... 
    Senior
    Full time
    Temporary work
    Part time
    For contractors
    Casual work
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week

    Stantec

    Portland, ME
    2 days ago
  • $34 - $42 per hour

     ...planning and implementing rehabilitation programs and procedures, monitoring patient admissions, schedules, MDS assessment periods and data, providing administrative rehabilitation supervision, serving as a rehabilitation staff mentor, providing speech therapy services as... 
    Data
    Senior
    Full time
    Temporary work
    Flexible hours

    Preferred Therapy Solutions

    Wiscasset, ME
    3 days ago
  •  ...transformation solutions and services. We solve process, automation, and data integration challenges in therapeutics, energy, and...  ...new technology and product solution offerings.Provide support & technical services to customers by assisting users with start-up, checkout... 
    Data
    Senior
    Immediate start

    NECI

    Bangor, ME
    1 day ago
  • $239k - $323k

     .... This role carries dual responsibility: leading dealer‑facing software applications while...  ...and leverage, and delivering intelligent, data‑driven features across every customer...  ...Toronto. ResponsibilitiesOwn and drive the technical and product strategy for the Home Software... 
    Data
    Senior
    Full time
    Temporary work
    Work experience placement
    Remote work
    Flexible hours

    Generac Power System

    South Portland, ME
    4 days ago
  •  ...Supplier Quality • Partner with operations to provide the necessary raw materials to support the production schedule. • Analyze data, review negotiated prices and terms, and work with suppliers to maintain existing, and develop new, long-term partnerships with our... 
    Data
    Senior
    Local area

    Vantage Point Recruiting

    Auburn, ME
    21 days ago
  •  ...Generation Division - Network Security Team Manager. The PGD Senior Technical Services Specialist role supports the cyber and physical...  ...troubleshoot Network Switches and Routers on a Plant Control or Process Data NetworksKnowledge of the latest standard practices for... 
    Data
    Senior
    Full time
    For contractors
    Local area
    Relocation
    Night shift
    Weekend work

    NextEra Energy

    Yarmouth, ME
    3 days ago
  •  ...about driving transformation across commercial systems. You will lead high-impact programs that span multiple business domains and technologies...  ...software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and... 
    Data
    Senior
    Full time
    Live in
    Work at office
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Mexico, ME
    1 day ago
  • $94.7k - $120k

     ...Responsibilities for this Position Sr Supervisor - Procurement, Purchase Spec...  ...Actively participate in safety initiatives and lead by example. Prioritize safety, fostering...  ...ability to compile large volumes of data into high level presentations PI28628... 
    Data
    Senior
    Long term contract
    Full time
    Contract work
    Flexible hours
    Shift work

    Bath Iron Works

    Bath, ME
    13 days ago
  •  ...startup with the stability and resources of a global leader. As a Lead Software Engineer, you will play a pivotal role in developing AI-...  ..., PostgreSQL, and AWS.Experience in distributed systems, API and data model design.Strong debugging skills and a track record of... 
    Data
    Full time
    Work at office
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Mexico, ME
    4 days ago
  • $88k - $132k

     ...Accounting teams. This role partners closely with IT to ensure data quality, integrity, and seamless integration across Salesforce...  ...systems. The ideal candidate is fluent in both functional and technical discussions and is motivated to design scalable, future-proof solutions... 
    Data
    Senior
    Remote work
    Home office

    Relativity

    Portland, ME
    4 days ago
  • $25 - $30 per hour

     .../skilled nursing Rehab Department. The successful candidate will lead rehabilitation operations, plan and implement programs, and provide...  ...patient admissions, schedules, MDS assessment periods and data Provide administrative rehabilitation supervisionServe as a rehabilitation... 
    Data
    Senior
    Full time
    Temporary work
    Relocation package
    Flexible hours

    Preferred Therapy Solutions

    Rockland, ME
    5 days ago
  • $30 - $40 per hour

     ...rehabilitation programs and procedures to optimize patient outcomes Monitor patient admissions, schedules, MDS assessment periods and data Provide administrative rehabilitation supervision Serve as a rehabilitation staff mentor Provide speech therapy services as... 
    Data
    Senior
    Full time
    Temporary work
    Part time
    Relocation package
    Flexible hours

    Preferred Therapy Solutions

    Bucksport, ME
    4 days ago
  •  ...Lateral Flow, ELISA and Molecular products Troubleshooting of technical and quality issues Undertake new procedures and observe...  ...measurement systems, systematic troubleshooting, statistics and data analysis.    If you have the required experience, apply as soon... 
    Data
    Senior
    Contract work
    Work at office
    Immediate start
    Remote work

    Techlink Systems

    Scarborough, ME
    4 days ago
  • $25 - $30 per hour

     ...rehabilitation programs and procedures to optimize patient outcomes Monitor patient admissions, schedules, MDS assessment periods, and data Provide administrative rehabilitation supervision Serve as a rehabilitation staff mentor Provide speech therapy services as... 
    Data
    Senior
    Full time
    Temporary work
    Relocation package
    Flexible hours

    Preferred Therapy Solutions

    Union, ME
    5 days ago
  • $78.8k - $177.68k

     ...now or in the future. Company Overview: Leading with our core values of Quality, Integrity...  ....Our company purpose is to empower easy, data-driven decision-making on important healthcare...  ...levels, including senior executives and technical leaders. Exceptional communication,... 
    Data
    Senior
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Milliman

    Portland, ME
    5 days ago
  • $66.59k - $110k

     ...Software Engineer for this group will provide technical guidance and assistance to product...  ...adoption of emerging technologies, selected by leads Mentor junior and mid-level engineers...  ...practices, including security, compliance, data privacy, and human oversight within... 
    Data
    Senior

    Tyler Technologies, Inc.

    Yarmouth, ME
    4 days ago
  • $100k - $125k

     ...scalable, resilient AWS cloud infrastructure:Lead implementation of disaster recovery, high...  ...to drive innovationCommunicate technical concepts clearly to both technical and non...  ...pipelinesTroubleshoot complex distributed systemsMake data-driven decisionsTranslate business... 
    Data
    Senior
    Local area
    Worldwide
    Flexible hours

    IDEXX Laboratories

    Westbrook, ME
    2 days ago
  •  ...specifications to determine material quantities and labor costsLead preconstruction meetings to discuss estimates and provide technical expertiseAnalyze historical data to improve estimating processes and accuracyMaintain relationships with suppliers and subcontractors to ensure... 
    Data
    Senior
    For subcontractor

    CyberCoders

    Portland, ME
    1 day ago
  •  ...Senior Golang Software Engineer to join their innovative VSaaS engineering team. This role involves architecting and building scalable data systems for cloud-based video surveillance. The ideal candidate will have over 5 years of experience in Go programming, strong... 
    Data
    Senior
    Remote job

    Milestone Systems Inc

    Portland, ME
    6 days ago
  •  ...Learning Operations team in Client's R&D AI Center of Excellence. In this role, you will build and operate the infrastructure that turns Data Scientists' models into production systems - from scalable training and inference pipelines to optimized on-device deployment on... 
    Data
    Senior

    Compunnel

    Westbrook, ME
    2 days ago
  • $100k - $125k

     ...****@*****.*** Ledger ManagementMaintain and reconcile general ledger accounts, ensuring accuracy and completeness of data in the accounting system.Serve as a key contributor in the month-end and year-end close processes, including preparation of journal... 
    Data
    Senior

    Robert Half

    Bath, ME
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Technical Lead Data Bricks. Be the first to apply!