Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)
Cloud Analytics Technologies LLC
About the Role:
We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.
Responsibilities:
* Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
* Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
* Work with DataFrames to manipulate and analyze large datasets.
* Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
* Build and maintain real-time data streaming pipelines using MSK/Kafka.
* Utilize S3 for data storage and retrieval.
* Work with data lake technologies like Iceberg.
* Ensure data quality, integrity, and security.
* Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
* Participate in code reviews and contribute to improving our development processes.
* Troubleshoot and resolve issues in data pipelines and back-end systems.
* Bachelor’s degree in computer science or a related field (or equivalent experience).
* 5+ years of experience in back-end development with a focus on data engineering.
Required Skills: * Strong proficiency in Spark, Python, Scala, and Java.
* Expertise in SQL and working with relational databases.
* Experience with DataFrames for data manipulation and analysis.
* Experience with cloud technologies (preferably AWS or GCP).
* Experience with message streaming platforms like MSK/Kafka.
* Experience with S3 or similar object storage.
* Experience with data lake technologies like Iceberg.
* Solid understanding of data warehousing concepts.
* Excellent communication and collaboration skills.
Bonus Points:
* Experience with data modelling and schema design.
* Experience with data governance and data quality management.
* Experience with DevOps practices and CI/CD pipelines.
* Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Spark, Scala, Python, AWS/GCP) in Elk Grove, CA vacancy
- ...seeking a skilled and passionate Back-End Engineer with a strong background in data... ...develop, and maintain data pipelines using Spark, Python, Scala, and Java. Write efficient and... ...using cloud technologies (preferably AWS or GCP). Build and maintain real-time data streaming...Amazon Web ServiceSeniorPythonHourly payPermanent employmentContract workLocal area
Robotics Technologies LLC
Elk Grove, CA18 hours ago $119k - $208k
...IT Operations team, Software Engineering Managers, Product Managers, and... ...other developers, both Junior and Senior. Design and prototype client... ...DevOps processes for a large GCP environment and supporting... ...Cloud Engineer certification or AWS/Azure. Seniority level: Mid-Senior...Amazon Web ServiceFull timeWork at officeRemote workWorldwide- ...hands‑on data platform engineer who thrives on building... ...Engineer, you will be a senior individual contributor... ...design and build of our AWS‑based data platform and... ..., Airflow), Snowflake, Spark, and dbt to deliver... ...experience with Spark (PySpark/Scala) for large‑scale batch...Amazon Web ServiceFull timeContract work
- ...tools (Intune, SCCM, Mosyle) Basic knowledge of networking and security Preferred: scripting/automation experience (PowerShell, Python) Experience with conference room technologies (Logitech, Poly, Microsoft Teams Rooms) #J-18808-Ljbffr Quest Technology ManagementPythonWork at officeRemote work
$20.9 - $21.15 per hour
Assistant Store Manager Hourly rate ranges from $20.90 to $21.15 and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan with...SeniorHourly payLocal areaSpencer Gifts
Elk Grove, CA3 days ago$138k - $200k
...You want your work to make a difference in people’s livesWhat it takes:Bachelor’s degree in Construction Management, Electrical Engineering or equivalent degree from a 4 year college or universityExperience in utility construction estimating At least 5 years of substation...SeniorTemporary workFor contractorsFor subcontractorWork at officeFlexible hours$100k
...Currently, We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers for full time positions with clients. Who Should Apply Recent Computer science/Engineering...PythonFull timeH1bSynergisticIT
Elk Grove, CA4 days ago- This position is responsible for the innovation, maintenance, and enhancement of products within the tortilla category—including frozen dough, dry mix, die‑cut, pressed flour, and corn tortillas. The role requires close collaboration with Operations, Finance, Sales, Quality...Senior
First Search
Elk Grove, CA3 days ago - ...and transportation. Willdan is a national leader in energy, engineering, and software consulting services. Since 1964, we have... ...Growth and Development Willdan is currently seeking a Senior Land Surveyor in Roseville, CA. Essential Duties and Responsibilities...SeniorWork experience placementWork at officeLocal area
Willdan
Elk Grove, CA5 days ago $23.69 - $39.36 per hour
...Senior TechnicianThe Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your leadership and mentoring skills in driving a team toward increased customer care and satisfaction. Pay Range:...SeniorDaily paidMinimum wagePrice workTemporary workLocal areaBridgestone
Elk Grove, CA5 days ago$31 - $39 per hour
Job Description Job Description We're looking for Auto Painters with a minimum of 5 years of professional automotive painting experience to join us at Carvana - the fastest-growing used automotive retailer in U.S. history and one of the four fastest companies to ...SeniorHourly payMonday to FridayCarvana
Elk Grove, CA8 days ago- JOB DESCRIPTION Centered in the heart of San Joaquin County, Adventist Health Lodi Memorial has been one of the area's leading healthcare providers since 1952. We are comprised of a 190-bed hospital, 17 medical offices, home care services, comprehensive cancer care ...SeniorFull timeWork experience placementLocal areaDay shift
$23.69 - $39.36 per hour
...Senior Technician The Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your leadership and mentoring skills in driving a team toward increased customer care and satisfaction. Pay Range...SeniorDaily paidMinimum wagePrice workTemporary workLocal areaFlexible hoursBridgestone
Elk Grove, CA5 days ago$165k - $200k
...Headquartered in Sacramento, CA, our teams collaborate closely across engineering, manufacturing, and operations to build reliable, high?quality... ...through design reviews and knowledge sharing. Serve as a senior technical resource on production design work as assigned....SeniorLocal areaButcher Power Products
Elk Grove, CA2 hours ago- The Senior Food Technologist will help lead innovation, optimization, and technical advancement initiatives across the tortilla category and other related product lines. This position requires expertise in formulation science, process improvement, and cross‑functional...SeniorWork at office
$10k
...the referring employee's name, classification, PERNR, and work location. Under the direction of the Chief Executive Officer, the Senior Psychologist, Correctional Facility (CF) (Specialist) performs as the clinical systems expert and provides psychological...SeniorPermanent employmentFull timePart timeWork at officeRemote workCalifornia Correctional Health Care Services
Elk Grove, CA2 days ago$23.69 - $39.36 per hour
...stuff, the bold, beautiful and brave stuff. Because who you are is what we need. Job Category Retail Position Summary The Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your...SeniorDaily paidMinimum wagePrice workFull timeTemporary workPart timeLocal areaFlexible hoursBridgestone Americas
Elk Grove, CA5 days ago- ...over 50 premier insurance carriers alongside a fully automated backend infrastructure. Core Objectives Strategic Client Advisory... ...automated nurturing campaigns, and instant multi-carrier quoting engines. Comprehensive Carrier Roster: Gain immediate appointments...Contract workWork at officeImmediate startRemote work
CEO Life
Elk Grove, CA18 days ago $48.23k - $196.49k
...provides direct assistance, intuitive marketing tools, and prompt responses to your queries. Focus on Client Engagement — We handle backend tasks, enabling you to concentrate on client relationships and efficient closings. Effective, Proven Training — Learn...Full timeMonday to FridayFlexible hoursWeekend workCulbertson and Gray Group
Elk Grove, CA22 days ago$9.51k - $12.74k
...level of expertise available in state service within the Software Engineering, Information Security Engineering, Information Technology... ...Position #(s): 042-038-1415-XXX Working Title: Senior Application Developer Classification: INFORMATION...SeniorPermanent employmentFull timeWork at officeRemote workCalifornia Correctional Health Care Services
Elk Grove, CA5 days ago- ...Snapshot / Role Overview: We're seeking a Senior Plumbing Designer in Central Coast, CA to support and grow commercial mechanical... ...junior designers and drafters on best practices. - Partner with engineers, contractors, and architects from concept to construction....SeniorFor contractors
Gulfstream Strategic Placements, LLC
Clarksburg, CA2 days ago $45 - $55 per hour
...Whether you’re an installation technician, service technician, engineer, or project manager, you’ll discover rewarding opportunities to... ...Job Description What to expect as a Commercial Security Senior Service Technician: The Senior Service Technician will be...SeniorWork at officeLocal areaRemote workAllied Universal® Technology Services
Elk Grove, CA4 days ago$18 - $20 per hour
...Job Description Job Description Join Golden Years In-Home Senior Care! We’re looking for caring, HCA-certified caregivers with a passion for serving others. If you love creating joyful moments and providing excellent care, we want you on our team! Your Role:...SeniorFull timePart timeFlexible hoursShift workWeekend workGolden Years In Home Senior Care
Galt, CA23 days ago- ...Job Summary The Senior Mechanical Design Engineer is a senior technical individual contributor who provides engineering and design leadership in the development of power distribution products for Butcher Power Products. The individual provides technical leadership...SeniorWork at office
Butcher Power Products
Elk Grove, CA4 days ago - Senior IT Project Manager / PMP Certified / Onsite / Rancho Cordova, CA Our team is partnering with a major California public sector organization to hire a part‑time Senior IT Project Manager to support highly visible, enterprise‑level technology initiatives. This role...SeniorContract workPart timeWork at office10 hours per weekDay shift
- ...Job Title: Senior Cabinet Designer Position Summary The Senior Cabinet Designer plays a critical role in driving high-end cabinetry projects from concept through production. Leveraging extensive design, technical, and industry experience, this role leads complex projects...SeniorFor contractorsWork at office
Closet Factory
Elk Grove, CA2 days ago $35 - $40 per hour
...Senior Customer Service Advisor Galt - Galt, CA 95632 Overview Salary Range $35.00 - $40.00 Hourly Description Bay City... ...The Bay City Electric Works team provides generator, air, and engine solutions for life's power needs. Offering quality brands like KOHLER...SeniorHourly payWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer (Spark, Scala, Python, AWS/GCP). Be the first to apply!
Related searches
- srs Elk Grove, CA
- senior manager legal Elk Grove, CA
- senior operations technician Elk Grove, CA
- senior application security Elk Grove, CA
- senior performance engineer Elk Grove, CA
- senior Elk Grove, CA
- senior manager diversity & inclusion Elk Grove, CA
- senior application administrator Elk Grove, CA
- go backend developer
- back end developer internship summer