Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)
Cloud Analytics Technologies LLC
About the Role:
We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.
Responsibilities:
* Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
* Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
* Work with DataFrames to manipulate and analyze large datasets.
* Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
* Build and maintain real-time data streaming pipelines using MSK/Kafka.
* Utilize S3 for data storage and retrieval.
* Work with data lake technologies like Iceberg.
* Ensure data quality, integrity, and security.
* Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
* Participate in code reviews and contribute to improving our development processes.
* Troubleshoot and resolve issues in data pipelines and back-end systems.
* Bachelor’s degree in computer science or a related field (or equivalent experience).
* 5+ years of experience in back-end development with a focus on data engineering.
Required Skills: * Strong proficiency in Spark, Python, Scala, and Java.
* Expertise in SQL and working with relational databases.
* Experience with DataFrames for data manipulation and analysis.
* Experience with cloud technologies (preferably AWS or GCP).
* Experience with message streaming platforms like MSK/Kafka.
* Experience with S3 or similar object storage.
* Experience with data lake technologies like Iceberg.
* Solid understanding of data warehousing concepts.
* Excellent communication and collaboration skills.
Bonus Points:
* Experience with data modelling and schema design.
* Experience with data governance and data quality management.
* Experience with DevOps practices and CI/CD pipelines.
* Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Spark, Scala, Python, AWS/GCP) in Elk Grove, CA vacancy
- ...seeking a skilled and passionate Back-End Engineer with a strong background in data... ...develop, and maintain data pipelines using Spark, Python, Scala, and Java. Write efficient and... ...using cloud technologies (preferably AWS or GCP). Build and maintain real-time data streaming...Amazon Web ServiceSeniorPythonHourly payPermanent employmentContract workLocal area
$119k - $208k
...Organization Transformation Assess and elevate engineering delivery processes and governance... ...Act as a trusted partner to senior technology and business leaders. Create... ...with SaaS architecture, cloud platforms (AWS, Azure, or GCP), and multi-tenant systems Excellent communication...Amazon Web ServiceWork experience placementWork at officeLocal areaRemote workAutoZone de México
Elk Grove, CA4 days ago$119k - $208k
...IT Operations team, Software Engineering Managers, Product Managers, and... ...other developers, both Junior and Senior. Design and prototype client... ...DevOps processes for a large GCP environment and supporting... ...Cloud Engineer certification or AWS/Azure. Seniority level: Mid-Senior...Amazon Web ServiceFull timeWork at officeRemote workWorldwide$40 - $80 per hour
DescriptionKforce has a client in Elk Grove, CA that is seeking an experienced Project Manager to lead data science and data engineering initiatives from planning through delivery. This role partners with technical and business teams to drive execution, manage dependencies...Senior- ...tools (Intune, SCCM, Mosyle) Basic knowledge of networking and security Preferred: scripting/automation experience (PowerShell, Python) Experience with conference room technologies (Logitech, Poly, Microsoft Teams Rooms) #J-18808-Ljbffr Quest Technology ManagementPythonWork at officeRemote work
$20.9 - $21.15 per hour
Assistant Store Manager Hourly rate ranges from $20.90 to $21.15 and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan with...SeniorHourly payLocal areaSpencer Gifts
Elk Grove, CA2 days ago$138k - $200k
...You want your work to make a difference in people’s livesWhat it takes:Bachelor’s degree in Construction Management, Electrical Engineering or equivalent degree from a 4 year college or universityExperience in utility construction estimating At least 5 years of substation...SeniorTemporary workFor contractorsFor subcontractorWork at officeFlexible hours- This position is responsible for the innovation, maintenance, and enhancement of products within the tortilla category—including frozen dough, dry mix, die‑cut, pressed flour, and corn tortillas. The role requires close collaboration with Operations, Finance, Sales, Quality...Senior
First Search
Elk Grove, CA1 day ago - ...Senior ServiceNow Developer Elk Grove, CA 12+ months Onsite Required Skills: Must have a minimum... .... Requires Bachelor's Degree in an IT-related or Engineering field. Additional qualifying experience may be substituted for...Senior
West Advanced Technologies
Elk Grove, CA3 days ago - ...and transportation. Willdan is a national leader in energy, engineering, and software consulting services. Since 1964, we have... ...Growth and Development Willdan is currently seeking a Senior Land Surveyor in Roseville, CA. Essential Duties and Responsibilities...SeniorWork experience placementWork at officeLocal area
Willdan
Elk Grove, CA3 days ago $23.69 - $39.36 per hour
...Senior Technician The Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your leadership and mentoring skills in driving a team toward increased customer care and satisfaction. Pay Range...SeniorDaily paidMinimum wagePrice workTemporary workLocal areaFlexible hoursBridgestone
Elk Grove, CA3 days ago$17.71 - $23.74 per hour
...Describe a data analysis project or task you completed. Include the type of data you worked with, what tools you used (excel, python, PowerBI, etc.), the objective of the analysis, and the key insights or outcomes you identified. 07 Have you taken any classes...PythonHourly payContract workTemporary workFor contractorsInternshipH1bWork at officeLocal areaCity of Elk Grove, CA
Elk Grove, CA5 days ago$10k
...provided to the selected candidate during the pre-employment process. Under the general direction of the Chief Psychologist or Senior Psychologist, CF (Supervisor), the Senior Psychologist, CF (Specialist) performs as the clinical systems expert and provides...SeniorPermanent employmentFull timeWork at officeRemote workWeekend workCalifornia Correctional Health Care Services
Elk Grove, CA5 days ago- The Senior Food Technologist will help lead innovation, optimization, and technical advancement initiatives across the tortilla category and other related product lines. This position requires expertise in formulation science, process improvement, and cross‑functional...SeniorWork at office
- US Department of Veterans Affairs in California seeks a Master''s-level social worker to deliver comprehensive clinical social work to veterans and their families at the Mather VA, with potential extension to Veterans Integrated Service networks. You will work with patients...Senior
US-Department-of-Veterans-Affair
Mather, CA5 days ago - JOB DESCRIPTION Centered in the heart of San Joaquin County, Adventist Health Lodi Memorial has been one of the area's leading healthcare providers since 1952. We are comprised of a 190-bed hospital, 17 medical offices, home care services, comprehensive cancer care ...SeniorFull timeWork experience placementLocal areaDay shift
- About the Employer The Elk Grove Unified School District (EGUSD) is the fourth-largest school district in California located in southern Sacramento County. EGUSD covers 320 square miles and includes 62 traditional public schools, five alternative education schools...Work at office
Elk Grove Unified School District
Elk Grove, CA16 hours ago - ...over 50 premier insurance carriers alongside a fully automated backend infrastructure. Core Objectives Strategic Client Advisory... ...automated nurturing campaigns, and instant multi-carrier quoting engines. Comprehensive Carrier Roster: Gain immediate appointments...Contract workWork at officeImmediate startRemote work
CEO Life
Elk Grove, CA11 days ago $100k - $125k
...Job Description We are seeking a highly skilled Senior Financial Planning Analyst to join our client's dynamic team in Elk Grove. This role will be responsible for assisting in financial planning, budgeting, and forecasting processes while providing strategic insights...SeniorTemporary workPacific ExecSearch
Galt, CA3 days ago$100k - $115k
...Our client is hiring a Senior Account Executive to lead strategic market development - winning high-value growers, navigating complex sales cycles, and operating as a commercial leader with a high degree of autonomy. We're not looking for someone to manage a territory...SeniorProduce Careers Inc
Clarksburg, CA5 days ago- ...Snapshot / Role Overview: We're seeking a Senior Plumbing Designer in Central Coast, CA to support and grow commercial mechanical... ...junior designers and drafters on best practices. - Partner with engineers, contractors, and architects from concept to construction....SeniorFor contractors
Gulfstream Strategic Placements, LLC
Clarksburg, CA5 days ago $142.25k - $235.7k
...Senior Electrical Engineer Construction Innovations Corporate - Mather - Mather, CA 95655 Overview Salary Range $142,250.00 - $235,700.00 Salary Position Type Full Time Job Shift Day Travel Percentage Negligible Description At Construction Innovations,...SeniorFull timeWork at officeLocal areaRemote workLong distanceShift workConstruction Innovations LLC
Mather, CA1 day ago$20 - $26 per hour
...we're preparing kids for tomorrow. Kids just think it's cool!' Are you passionate about computer science, video games, coding, Python, Roblox, app design, digital movies, robotics, drones, Minecraft or STEM? We are seeking enthusiastic, motivated and talented individuals...PythonHourly payPart timeImmediate startMonday to Friday$165k - $200k
...including expenses, approvals, cards, receipts, and user self-service. As a Mobile Architect, you will work closely with mobile engineers, backend developers, product managers, and QA teams to design and deliver scalable mobile solutions. This role requires both strategic...Currently hiringWork at officeLocal areaCorpay
Elk Grove, CA4 days ago- ...Job Summary The Senior Mechanical Design Engineer is a senior technical individual contributor who provides engineering and design leadership in the development of power distribution products for Butcher Power Products. The individual provides technical leadership...SeniorWork at office
Butcher Power Products
Elk Grove, CA2 days ago - Senior IT Project Manager / PMP Certified / Onsite / Rancho Cordova, CA Our team is partnering with a major California public sector organization to hire a part‑time Senior IT Project Manager to support highly visible, enterprise‑level technology initiatives. This role...SeniorContract workPart timeWork at office10 hours per weekDay shift
- ...Job Title: Senior Cabinet Designer Position Summary The Senior Cabinet Designer plays a critical role in driving high-end cabinetry projects from concept through production. Leveraging extensive design, technical, and industry experience, this role leads complex projects...SeniorFor contractorsWork at office
Closet Factory
Elk Grove, CA5 days ago $35 - $40 per hour
...The Bay City Electric Works team provides generator, air, and engine solutions for life's power needs. Offering quality brands like KOHLER... ..., casinos, and residences. The Job : We are seeking a Senior Customer Service Advisor who is passionate about delivering...SeniorWork at officeBay City Equipment Industries, Inc.
Galt, CA4 days ago$103k - $142k
...multi-service infrastructure consulting firm providing civil engineering and surveying services across California, the Pacific Northwest... ...certification for the second year in a row. We’re hiring a Senior Civil Engineer with a deep foundation in land development civil...SeniorBi-weekly payWork at officeLocal areaFlexible hours$140k - $170k
...Description Turner & Townsend are seeking an experienced Senior Project Manager responsible for overseeing innovative tenant... ...day to day activities. Experience managing design and engineering teams and coordinating multidisciplinary project deliverables....SeniorFull timeFor contractorsFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer (Spark, Scala, Python, AWS/GCP). Be the first to apply!
Related searches
- senior application administrator Elk Grove, CA
- senior performance engineer Elk Grove, CA
- srs Elk Grove, CA
- senior manager diversity & inclusion Elk Grove, CA
- senior Elk Grove, CA
- senior application security Elk Grove, CA
- senior implementation project manager Elk Grove, CA
- senior manager legal Elk Grove, CA
- senior operations technician Elk Grove, CA
- backend api developer