Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)

Cloud Analytics Technologies LLC


About the Role:
We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.
Responsibilities:
*   Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
*   Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
*   Work with DataFrames to manipulate and analyze large datasets.
*   Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
*   Build and maintain real-time data streaming pipelines using MSK/Kafka.
*   Utilize S3 for data storage and retrieval.
*   Work with data lake technologies like Iceberg.
*   Ensure data quality, integrity, and security.
*   Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
*   Participate in code reviews and contribute to improving our development processes.
*   Troubleshoot and resolve issues in data pipelines and back-end systems.

Qualifications:
*   Bachelor’s degree in computer science or a related field (or equivalent experience).
*   5+ years of experience in back-end development with a focus on data engineering.
Required Skills:

*   Strong proficiency in Spark, Python, Scala, and Java.
*   Expertise in SQL and working with relational databases.
*   Experience with DataFrames for data manipulation and analysis.
*   Experience with cloud technologies (preferably AWS or GCP).
*   Experience with message streaming platforms like MSK/Kafka.
*   Experience with S3 or similar object storage.
*   Experience with data lake technologies like Iceberg.
*   Solid understanding of data warehousing concepts.
*   Excellent communication and collaboration skills.
Bonus Points:
*   Experience with data modelling and schema design.
*   Experience with data governance and data quality management.
*   Experience with DevOps practices and CI/CD pipelines.
*   Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Spark, Scala, Python, AWS/GCP) in Elk Grove, CA vacancy
  • $134.7k - $249.5k

     ...scalabletechnologies.DescriptionWe are seeking a Senior Software Engineer responsible for the development and...  ...across both front-end (GUI) and backend. You will design, code,test, and...  ...suites (CircleCI, Jenkins), and DevOps and AWS infrastructure.GoLang and Java —... 
    Amazon Web Service
    Senior
    Relocation

    Apple

    Elk Grove, CA
    19 hours ago
  • $89.2k - $157.3k

     ...competitive achievable and serviceable Electrical Engineer...  ...from executing defined tasks and supporting senior engineers to owning complex technical scope...  ...Equipment ~ MATLAB ~ LabVIEW ~ Python ~ Integration Verification & Validation... 
    Senior
    Python
    Full time
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ASML

    Wilton, CA
    1 day ago
  • $118.88k - $176k

     ...Introduction of the job As a Senior Mechanical Analysis Engineer you will apply advanced analytical and numerical methods to predict and optimize...  ...Simcenter Abaqus Nastran or equivalent tools together with Python MATLAB Mathematica or similar technical computing... 
    Senior
    Python
    Full time
    Work at office
    Immediate start

    ASML

    Wilton, CA
    4 days ago
  • $104.8k - $190.8k

     ...position is for a First Line Support Production Engineer (PE) with innovative attitude to work in...  ...-based software Develop and maintain Python / Matlab script to troubleshoot issues on...  ...with multidisciplinary groups (including senior leadership) and be willing to take on... 
    Senior
    Python
    Full time
    Work experience placement
    Immediate start
    Weekend work

    ASML

    Wilton, CA
    1 day ago
  • $90.75k - $166.38k

     ...position is for a Factory Quality Production Engineer with an innovative attitude to work in a...  ...~ Knowledge of MATLAB LabVIEW and Python is a plus ~ Working knowledge of NX Teamcenter...  ...with multidisciplinary groups (including senior leadership) and be willing to take on... 
    Senior
    Python
    Full time
    Work at office
    Immediate start

    ASML

    Wilton, CA
    1 day ago
  • About who needs care: Broken ankle est 6 month recovery About the care needs: Be able to climb ladder and lift 40 lbs,, speak English fluently Services needed include: transportation, meal preparation, errands / shopping, and light housekeeping.
    Senior

    Care.com

    Elk Grove, CA
    2 hours ago
  • Overview If you are a highly motivated individual with an active, unrestricted credential (CPA/EA/Practicing Attorney) and excellent communication skills, we need you to help our customers complete their taxes using Intuit TurboTax products. You will be working toward...
    Senior
    Remote work

    Intuit

    Elk Grove, CA
    2 days ago
  • Overview If you are a highly motivated individual with an active, unrestricted credential (CPA/EA/Practicing Attorney) and excellent communication skills, we need you to help our customers complete their taxes using Intuit TurboTax products. You will be working toward...
    Senior
    Remote work

    Intuit

    Elk Grove, CA
    2 days ago
  •  ...and Rescue Swimmer School for those in that specialty; Class A School in an assigned aircrew rating pipeline such as AWF, AWO, AWR, AWS, or AWV; Fleet Replacement Squadron training and survival, evasion, resistance, and escape instruction; ongoing qualification and advanced... 
    Amazon Web Service
    Contract work
    Apprenticeship
    Worldwide
    Shift work

    US Navy

    Wilton, CA
    5 hours ago
  • $28.74 - $36.72 per hour

    Overview If you are a highly motivated individual with an active, unrestricted credential (CPA/EA/Practicing Attorney) and excellent communication skills, we need you to help our customers complete their taxes using Intuit TurboTax products. You will be working toward...
    Senior
    Remote work

    Intuit

    Elk Grove, CA
    1 day ago
  • $31 - $39 per hour

    Job Description Job Description We're looking for Autobody Preppers with a minimum of 5 years of professional automotive bodywork experience to join us at Carvana - the fastest-growing used automotive retailer in U.S. history and one of the four fastest companies...
    Senior
    Hourly pay

    Carvana

    Elk Grove, CA
    a month ago
  • $140k - $200k

     ...seeking a compassionate Nurse Practitioner or Physician Assistant for our Mobile Primary Care Team to serve older adults in homes and senior living communities in California. You’ll deliver comprehensive, patient-centered care, conduct assessments, and manage chronic... 
    Senior

    Brigade Health

    Elk Grove, CA
    4 days ago
  •  ...deliver clinic-based podiatric care in Sacramento, CA. This independent contractor role offers a structured outpatient setting serving seniors, with a focus on quality and mission-driven care. You’ll work 4 days per week, typically 8:30 AM to 4:30 PM, in a supportive team... 
    Senior
    Part time
    For contractors

    Comprehensive Mobile Care

    Elk Grove, CA
    2 days ago
  •  ...the Role We are seeking an experienced Contact Center Quality Engineer to support the development and enhancement of a large-scale...  ...integration testing ~ Experience with test automation using Python and/or JavaScript ~ Experience with Git, SQL, log analysis, and... 
    Python

    Glint Tech Solutions LLC

    Elk Grove, CA
    8 days ago
  •  ...Qualifications 0-2 years of experience in sales or a related field. AWS Cloud Practitioner Certification. HubSpot Sales Software...  ...the-art MarTech tools. Opportunities for career progression into senior sales or account management roles. Access to mentorship... 
    Amazon Web Service
    Local area
    Flexible hours

    Comunidade Metodista

    Elk Grove, CA
    3 days ago
  •  ...valuation, and wealth management services to individuals, businesses, and organizations throughout Chicagoland.We are looking for a Tax Senior to work directly with clients while gaining exposure to complex tax compliance, planning, and consulting engagements across a... 
    Senior
    Work at office

    CyberCoders

    Elk Grove, CA
    3 days ago
  • $20.9 - $21.15 per hour

    Assistant Store Manager Hourly rate ranges from $20.90 to $21.15 and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan with...
    Senior
    Hourly pay
    Local area

    Spencer's

    Elk Grove, CA
    2 days ago
  • This position is responsible for the innovation, maintenance, and enhancement of products within the tortilla category—including frozen dough, dry mix, die‑cut, pressed flour, and corn tortillas. The role requires close collaboration with Operations, Finance, Sales, Quality...
    Senior

    First Search

    Elk Grove, CA
    1 day ago
  •  ...Senior Electrical Estimator A well-established local electrical contractor is looking to add an experienced Senior Electrical Estimator to their team. The company has a strong backlog of local commercial and industrial projects and is looking for someone who can independently... 
    Senior
    For contractors
    For subcontractor
    Local area

    gpac

    Elk Grove, CA
    23 hours ago
  •  ...The Senior Food Technologist will help lead innovation, optimization, and technical advancement initiatives across the tortilla category and other related product lines. This position requires expertise in formulation science, process improvement, and cross‑functional... 
    Senior
    Work at office

    First Search

    Elk Grove, CA
    4 days ago
  • $17 - $53 per hour

     ...multidiscipline project team working on the electrical infrastructure engineering analysis and generation of electronic designs. The position...  ...PSpice OrCAD PADs or similar. MATLAB. LabVIEW. Python. Skills Working at the cutting edge of tech youll... 
    Python
    Full time
    Internship
    Work at office
    Immediate start
    Shift work

    ASML

    Wilton, CA
    4 days ago
  • $130.2k - $237.6k

     ...Information Systems and Technology (IS&T) organization.IS&T is the engine behind everything Apple does for customers and for the people...  ...experience developing and maintaining one or more programming languages (Python, C++, etc).Pay & BenefitsAt Apple, base pay is one part of our... 
    Python
    Relocation

    Apple

    Elk Grove, CA
    1 day ago
  •  ...Certified Senior Pharmacy Technician Customer Experience Engages customers and patients by greeting them and offering assistance with products and services. Resolves customer issues and answers questions to ensure a positive customer experience. Models and shares... 
    Senior
    Local area
    Immediate start

    Walgreens

    Elk Grove, CA
    6 hours ago
  • $19 per hour

    Customer Assistance Representative Sr (CAR Sr) Enterprise Mobility operates the Enterprise Rent-A-Car, National Car Rental, and Alamo car rental brands and has frequently been named one of the top places to work. Enterprise Mobility is the largest and fastest growing...
    Senior
    Full time
    Local area
    Monday to Friday
    Weekend work

    Enterprise Holdings

    Elk Grove, CA
    1 day ago
  •  ...Job Description Job Description Lead day to day cloud security operations for Azure, AWS, and/or GCP environments. Manage continuous vulnerability assessments, security patching, and remediation activities. Administer and monitor Wiz to identify and remediate... 
    Amazon Web Service
    Remote work

    Yantran LLC

    Mather, CA
    23 days ago
  • $10k

     ...process. Under the general direction of the Chief Psychologist, Correctional Facility (CF) or Chief of Mental Health Services, the Senior Psychologist, CF (Specialist), Suicide Prevention, Training and Assessment Coordinator coordinates the institution's suicide... 
    Senior
    Permanent employment
    Full time
    Work at office
    Remote work

    California Correctional Health Care Services

    Elk Grove, CA
    6 hours ago
  • Sr. Sales ExecutiveIf you are looking for a career at a dynamic company with a people-first mindset and a deep culture of growth and autonomy, ACV is the right place for you! Competitive compensation packages and learning and development opportunities, ACV has what you...
    Senior
    Temporary work
    Live in
    Local area
    Visa sponsorship
    Work visa

    ACV Auctions

    Elk Grove, CA
    4 days ago
  •  ...Description Job Description Job Title: Contact Center Systems Engineer Location: Elk Grove, CA – Onsite Employment Type: W2...  ...troubleshooting ~ Scripting/programming experience with Python, JavaScript, Bash , or comparable ~ Experience with REST... 
    Python
    Contract work

    Applab Systems Inc

    Elk Grove, CA
    23 days ago
  •  ...Job Description Job Description Job Title: QA Engineer – Contact Center / Telephony Location: Elk Grove, CA – Onsite Employment...  ..., and UAT testing ~ Test automation experience using Python, JavaScript, or comparable language ~ Experience testing REST... 
    Python
    Contract work

    Applab Systems Inc

    Elk Grove, CA
    23 days ago
  •  ...for an application. " Design, develop, and maintain automated test suites for REST APIs and web applications using Selenium and Python. " Build and execute test automation strategies for Voice/VoIP/SIP-based systems and features. " Perform functional, regression... 
    Python

    Diverse Lynx

    Elk Grove, CA
    23 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer (Spark, Scala, Python, AWS/GCP). Be the first to apply!