Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)
Cloud Analytics Technologies LLC
About the Role:
We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.
Responsibilities:
* Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
* Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
* Work with DataFrames to manipulate and analyze large datasets.
* Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
* Build and maintain real-time data streaming pipelines using MSK/Kafka.
* Utilize S3 for data storage and retrieval.
* Work with data lake technologies like Iceberg.
* Ensure data quality, integrity, and security.
* Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
* Participate in code reviews and contribute to improving our development processes.
* Troubleshoot and resolve issues in data pipelines and back-end systems.
* Bachelor’s degree in computer science or a related field (or equivalent experience).
* 5+ years of experience in back-end development with a focus on data engineering.
Required Skills: * Strong proficiency in Spark, Python, Scala, and Java.
* Expertise in SQL and working with relational databases.
* Experience with DataFrames for data manipulation and analysis.
* Experience with cloud technologies (preferably AWS or GCP).
* Experience with message streaming platforms like MSK/Kafka.
* Experience with S3 or similar object storage.
* Experience with data lake technologies like Iceberg.
* Solid understanding of data warehousing concepts.
* Excellent communication and collaboration skills.
Bonus Points:
* Experience with data modelling and schema design.
* Experience with data governance and data quality management.
* Experience with DevOps practices and CI/CD pipelines.
* Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Spark, Scala, Python, AWS/GCP) in Elk Grove, CA vacancy
- ...seeking a skilled and passionate Back-End Engineer with a strong background in data... ...develop, and maintain data pipelines using Spark, Python, Scala, and Java. Write efficient and... ...using cloud technologies (preferably AWS or GCP). Build and maintain real-time data streaming...Amazon Web ServiceSeniorPythonHourly payPermanent employmentContract workTemporary workLocal area
Robotics Technologies LLC
Elk Grove, CA2 days ago $119k - $208k
...IT Operations team, Software Engineering Managers, Product Managers, and... ...other developers, both Junior and Senior. Design and prototype client... ...DevOps processes for a large GCP environment and supporting... ...Cloud Engineer certification or AWS/Azure. Seniority level: Mid-Senior...Amazon Web ServiceFull timeWork at officeRemote workWorldwide- ...hands‑on data platform engineer who thrives on building... ...Engineer, you will be a senior individual contributor... ...design and build of our AWS‑based data platform and... ..., Airflow), Snowflake, Spark, and dbt to deliver... ...experience with Spark (PySpark/Scala) for large‑scale batch...Amazon Web ServiceFull timeContract work
$40 - $80 per hour
DescriptionKforce has a client in Elk Grove, CA that is seeking an experienced Project Manager to lead data science and data engineering initiatives from planning through delivery. This role partners with technical and business teams to drive execution, manage dependencies...Senior- ...tools (Intune, SCCM, Mosyle) Basic knowledge of networking and security Preferred: scripting/automation experience (PowerShell, Python) Experience with conference room technologies (Logitech, Poly, Microsoft Teams Rooms) #J-18808-Ljbffr Quest Technology ManagementPythonWork at officeRemote work
$20.9 - $21.15 per hour
Assistant Store Manager Hourly rate ranges from $20.90 to $21.15 and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan with...SeniorHourly payLocal areaSpencer Gifts
Elk Grove, CA3 days ago$138k - $200k
...You want your work to make a difference in people’s livesWhat it takes:Bachelor’s degree in Construction Management, Electrical Engineering or equivalent degree from a 4 year college or universityExperience in utility construction estimating At least 5 years of substation...SeniorTemporary workFor contractorsFor subcontractorWork at officeFlexible hours$20 - $26 per hour
...we're preparing kids for tomorrow. Kids just think it's cool!' Are you passionate about computer science, video games, coding, Python, Roblox™, app design, digital movies, robotics, drones, Minecraft™ or STEM? We are seeking enthusiastic, motivated and talented individuals...PythonHourly payPart timeImmediate startMonday to FridayBlack Rocket Productions
Elk Grove, CA4 days ago- This position is responsible for the innovation, maintenance, and enhancement of products within the tortilla category—including frozen dough, dry mix, die‑cut, pressed flour, and corn tortillas. The role requires close collaboration with Operations, Finance, Sales, Quality...Senior
First Search
Elk Grove, CA3 days ago - ...Maintenance AssistantAt Tenfold Senior Living, you'll make a difference for our residents—and for yourself. Prairie City Landing's philosophy "Different by Design" describes our community and our culture. We are blazing new trails in the senior living industry for our...SeniorDaily paid
Bruceville Point
Elk Grove, CA5 days ago - ...Senior Land Surveyor The future is now, Willdan is "Envisioning the Future" of clean energy and infrastructure as well as sustainability... ..., and transportation. Willdan is a national leader in energy, engineering, and software consulting services. Since 1964, we have...SeniorWork experience placementWork at officeLocal area
Willdan
Elk Grove, CA5 days ago $23.69 - $39.36 per hour
...Senior TechnicianThe Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your leadership and mentoring skills in driving a team toward increased customer care and satisfaction. Pay Range:...SeniorDaily paidMinimum wagePrice workTemporary workLocal areaBridgestone
Elk Grove, CA5 days ago$23.69 - $39.36 per hour
...Senior Technician The Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your leadership and mentoring skills in driving a team toward increased customer care and satisfaction. Pay Range...SeniorDaily paidMinimum wagePrice workTemporary workLocal areaFlexible hoursBridgestone
Elk Grove, CA5 days ago- JOB DESCRIPTION Centered in the heart of San Joaquin County, Adventist Health Lodi Memorial has been one of the area's leading healthcare providers since 1952. We are comprised of a 190-bed hospital, 17 medical offices, home care services, comprehensive cancer care ...SeniorFull timeWork experience placementLocal areaDay shift
$17.71 - $23.74 per hour
...Describe a data analysis project or task you completed. Include the type of data you worked with, what tools you used (excel, python, PowerBI, etc.), the objective of the analysis, and the key insights or outcomes you identified. 07 Have you taken any classes...PythonHourly payContract workTemporary workFor contractorsInternshipH1bWork at officeLocal areaCity of Elk Grove, CA
Elk Grove, CA2 days ago$23.69 - $39.36 per hour
...stuff, the bold, beautiful and brave stuff. Because who you are is what we need. Job Category Retail Position Summary The Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your...SeniorDaily paidMinimum wagePrice workFull timeTemporary workPart timeLocal areaFlexible hoursBridgestone Americas
Elk Grove, CA5 days ago- ...Server Position At Tenfold Senior Living At Tenfold Senior Living, you'll make a difference for our residentsand for yourself. Join our team. Become part of a connected community where you'll work every day with amazing teammates and seniors, building relationships...SeniorPart timeFlexible hoursWeekend work
$19 per hour
Customer Assistance Representative Sr (CAR Sr) Enterprise Mobility has an exciting opportunity for a Customer Assistance Representative Sr (CAR Sr). The Customer Assistance Representative Sr (CAR Sr) will provide a high level of customer service by assisting both internal...SeniorFull timeLocal areaMonday to FridayWeekend work$10k
...provided to the selected candidate during the pre-employment process. Under the general direction of the Chief Psychologist or Senior Psychologist, CF (Supervisor), the Senior Psychologist, CF (Specialist) performs as the clinical systems expert and provides...SeniorPermanent employmentFull timeWork at officeRemote workWeekend workCalifornia Correctional Health Care Services
Elk Grove, CA2 days ago- The Senior Food Technologist will help lead innovation, optimization, and technical advancement initiatives across the tortilla category and other related product lines. This position requires expertise in formulation science, process improvement, and cross‑functional...SeniorWork at office
- ...Tenfold Senior Living Opportunity At Tenfold Senior Living, you'll make a difference for our residentsand for yourself. Interested in joining a creative and fun team that is constantly pushing the envelope, developing deep and meaningful relationships with prospective...SeniorLocal areaFlexible hours
- ...Description Please reach out to Melissa (Painter) Ford via LinkedIn for immediate consideration. Our client is looking for an experienced Senior Accountant to support core accounting operations and help maintain accurate, timely financial records. This role is ideal for a...SeniorImmediate start
Robert Half
Elk Grove, CA5 days ago - General Summary: The Assistant Principal is responsible for assisting with the efficient operation of the school site and provides support and assistance to the Principal. The Assistant Principal serves as a member of the administrative team dedicated to cultivating excellence...Work at officeHome office
Fortune School of Education
Elk Grove, CA3 hours ago - The Elk Grove Unified School District (EGUSD) is the fourth-largest school district in California located in southern Sacramento County. EGUSD covers 320 square miles and includes 62 traditional public schools, five alternative education schools, an adult school, one charter...Work at office
Elk Grove Unified School District
Elk Grove, CA4 days ago $100k - $125k
...Job Description We are seeking a highly skilled Senior Financial Planning Analyst to join our client's dynamic team in Elk Grove. This role will be responsible for assisting in financial planning, budgeting, and forecasting processes while providing strategic insights...SeniorTemporary workPacific ExecSearch
Galt, CA5 days ago$100k - $115k
...Our client is hiring a Senior Account Executive to lead strategic market development - winning high-value growers, navigating complex sales cycles, and operating as a commercial leader with a high degree of autonomy. We're not looking for someone to manage a territory...SeniorProduce Careers Inc
Clarksburg, CA2 days ago- ...over 50 premier insurance carriers alongside a fully automated backend infrastructure. Core Objectives Strategic Client Advisory... ...automated nurturing campaigns, and instant multi-carrier quoting engines. Comprehensive Carrier Roster: Gain immediate appointments...Contract workWork at officeImmediate startRemote work
CEO Life
Elk Grove, CA29 minutes ago - ...Job Summary The Senior Mechanical Design Engineer is a senior technical individual contributor who provides engineering and design leadership in the development of power distribution products for Butcher Power Products. The individual provides technical leadership...SeniorWork at office
Butcher Power Products
Elk Grove, CA4 days ago - Senior IT Project Manager / PMP Certified / Onsite / Rancho Cordova, CA Our team is partnering with a major California public sector organization to hire a part‑time Senior IT Project Manager to support highly visible, enterprise‑level technology initiatives. This role...SeniorContract workPart timeWork at office10 hours per weekDay shift
- ...Job Title: Senior Cabinet Designer Position Summary The Senior Cabinet Designer plays a critical role in driving high-end cabinetry projects from concept through production. Leveraging extensive design, technical, and industry experience, this role leads complex projects...SeniorFor contractorsWork at office
Closet Factory
Elk Grove, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer (Spark, Scala, Python, AWS/GCP). Be the first to apply!
Related searches
- senior application administrator Elk Grove, CA
- senior performance engineer Elk Grove, CA
- srs Elk Grove, CA
- senior vice president of operations Elk Grove, CA
- senior activities Elk Grove, CA
- senior manager diversity & inclusion Elk Grove, CA
- senior Elk Grove, CA
- senior application security Elk Grove, CA
- senior implementation project manager Elk Grove, CA
- senior manager legal Elk Grove, CA