Senior Backend Engineer (Spark, Scala, Python, AWS/GCP)
Cloud Analytics Technologies LLC
About the Role:
We are seeking a skilled and passionate Back-End Engineer with a strong background in data engineering to join our growing team. In this role, you will be responsible for designing, developing, and maintaining scalable and reliable data pipelines and back-end systems. You will work with large datasets, leverage cloud technologies, and collaborate with data scientists and other engineers to deliver impactful data-driven solutions. This position is available in both the United States and India.
Responsibilities:
* Design, develop, and maintain data pipelines using Spark, Python, Scala, and Java.
* Write efficient and optimized SQL queries for data extraction, transformation, and loading (ETL) processes.
* Work with DataFrames to manipulate and analyze large datasets.
* Implement data storage and processing solutions using cloud technologies (preferably AWS or GCP).
* Build and maintain real-time data streaming pipelines using MSK/Kafka.
* Utilize S3 for data storage and retrieval.
* Work with data lake technologies like Iceberg.
* Ensure data quality, integrity, and security.
* Collaborate with data scientists and other engineers to understand data requirements and deliver solutions.
* Participate in code reviews and contribute to improving our development processes.
* Troubleshoot and resolve issues in data pipelines and back-end systems.
* Bachelor’s degree in computer science or a related field (or equivalent experience).
* 5+ years of experience in back-end development with a focus on data engineering.
Required Skills: * Strong proficiency in Spark, Python, Scala, and Java.
* Expertise in SQL and working with relational databases.
* Experience with DataFrames for data manipulation and analysis.
* Experience with cloud technologies (preferably AWS or GCP).
* Experience with message streaming platforms like MSK/Kafka.
* Experience with S3 or similar object storage.
* Experience with data lake technologies like Iceberg.
* Solid understanding of data warehousing concepts.
* Excellent communication and collaboration skills.
Bonus Points:
* Experience with data modelling and schema design.
* Experience with data governance and data quality management.
* Experience with DevOps practices and CI/CD pipelines.
* Relevant certifications (e.g., AWS Certified Data Engineer, Google Cloud Certified Professional Data Engineer).
Vacancy posted 14 days ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Spark, Scala, Python, AWS/GCP) in Elk Grove, CA vacancy
- ...seeking a skilled and passionate Back-End Engineer with a strong background in data... ...develop, and maintain data pipelines using Spark, Python, Scala, and Java. Write efficient and... ...using cloud technologies (preferably AWS or GCP). Build and maintain real-time data streaming...Amazon Web ServiceSeniorPythonHourly payPermanent employmentContract workLocal area
Robotics Technologies LLC
Elk Grove, CA4 days ago $119k - $208k
...IT Operations team, Software Engineering Managers, Product Managers, and... ...other developers, both Junior and Senior. Design and prototype client... ...DevOps processes for a large GCP environment and supporting... ...Cloud Engineer certification or AWS/Azure. Seniority level: Mid-Senior...Amazon Web ServiceFull timeWork at officeRemote workWorldwideALLDATA
Elk Grove, CA3 days ago- ...Experience with endpoint management tools (Intune, SCCM, Mosyle) Basic knowledge of networking and security Preferred: scripting/automation experience (PowerShell, Python) Experience with conference room technologies (Logitech, Poly, Microsoft Teams Rooms) #J-18808-Ljbffr...PythonWork at officeRemote work
Quest Technology Management
Elk Grove, CA1 day ago - Enterprise Mobility - 9700 West Stockton Avenue - Responsibilities: Take incoming calls- reservations, rate quotes, general questions and answers, provide information and resolution for customers, other branches, insurance companies, dealerships, repair shops and other...SeniorFull time
Enterprise Mobility Inc
Elk Grove, CA5 days ago - Analyst I – Licensing Support Unit (LSU) Under the supervision of the Supervisor I, the Analyst I performs less complex analytical program support functions for the Licensing Support Unit (LSU). The incumbent will serve as the subject matter partner and provide analytical...Senior
BKF
Elk Grove, CA1 day ago - ...help assist in lifting and/or moving up to 50 pounds. Schedule: BIM participates in an Alternative Workweek Schedule (AWS), allowing eligible employees to work approved 3x12 or 4x10 schedules without daily overtime, in accordance with California Labor Code...Amazon Web ServiceHourly payShift workNight shiftDay shift
BIM Supportive Living
Elk Grove, CA1 day ago - This position is responsible for the innovation, maintenance, and enhancement of products within the tortilla category—including frozen dough, dry mix, die‑cut, pressed flour, and corn tortillas. The role requires close collaboration with Operations, Finance, Sales, Quality...Senior
First Search
Elk Grove, CA1 day ago $19 per hour
Customer Assistance Representative Sr (CAR Sr) Enterprise Mobility has an exciting opportunity for a Customer Assistance Representative Sr (CAR Sr). The Customer Assistance Representative Sr (CAR Sr) will provide a high level of customer service by assisting both internal...SeniorFull timeLocal areaMonday to FridayWeekend workEnterprise Holdings
Elk Grove, CA5 days ago- ...Senior Land Surveyor The future is now, Willdan is "Envisioning the Future" of clean energy and infrastructure as well as sustainability... ..., and transportation. Willdan is a national leader in energy, engineering, and software consulting services. Since 1964, we have...SeniorWork experience placementWork at officeLocal area
Willdan
Elk Grove, CA3 days ago $103k - $142k
...multi-service infrastructure consulting firm providing civil engineering and surveying services across California, the Pacific Northwest... ...Work certification for the second year in a row. We’re hiring a Senior Civil Engineer with a deep foundation in land development...SeniorBi-weekly payWork at officeLocal areaFlexible hoursInternetwork Expert Inc
Elk Grove, CA2 days ago$23.69 - $39.36 per hour
...stuff, the bold, beautiful and brave stuff. Because who you are is what we need. Job Category Retail Position Summary The Senior Technician position requires your talent and technical expertise to diagnose drivability and electrical systems, while using your...SeniorDaily paidMinimum wagePrice workFull timeTemporary workPart timeLocal areaFlexible hoursBridgestone Americas
Elk Grove, CAa month ago- ...Overview Join to apply for the Senior Sourcing Manager role at TieTalent . 2 weeks ago Be among the first 25 applicants This is an... ...factories and customers. Our DNA contains customer focus, concurrent engineering, virtual integration plus the ability to thrive in a volatile...SeniorFull timeWork at office
TieTalent
Wilton, CA1 day ago $19 per hour
Customer Assistance Representative Sr (CAR Sr) Enterprise Mobility has an exciting opportunity for a Customer Assistance Representative Sr (CAR Sr). The Customer Assistance Representative Sr (CAR Sr) will provide a high level of customer service by assisting both internal...SeniorFull timeLocal areaMonday to FridayWeekend work- Hearing Center Manager Responsible for overseeing employees and directing operations of the Hearing Center and other areas of the warehouse. Addresses personnel issues and oversees tasks performed by employees. Participates in Licensed Hearing Aid Dispenser duties. ...SeniorFull timeTemporary workApprenticeshipWork at office
- Job Description Customer Experience Engages customers and patients by greeting them and offering assistance with products and services. Resolves customer issues and answers questions to ensure a positive customer experience. Models and shares customer service...SeniorWork experience placementLocal areaImmediate startFlexible hoursAfternoon shift
Walgreens Boots Alliance
Elk Grove, CA2 days ago $80k - $85k
...Senior Field Service Technician Pregis is in the packaging business to protect what matters. We are committed to providing our... ...with both external customers and internal stakeholders (Sales, Engineering, and Service) about technical and non-technical information....SeniorWork experience placementWork at officeLocal areaRemote workMonday to Friday- ...of operation knowledge. Valid driver's license. Nice-to-Haves Tridium Niagara N4 certification. Scripting (JavaScript, Python) for system integration. Mission-critical or healthcare project experience. Compensation & Logistics Competitive salary depending...PythonRemote work
Gulfstream Strategic Placements, LLC
Clarksburg, CA5 days ago $75k
Kforce is partnering with a well-established, global manufacturing organization to identify a Senior Customer Service Representative to join their team in Elk Grove, IL. This is a great opportunity to join a stable, growth-oriented company known for strong employee retention...SeniorWork at office$100k - $115k
...Our client is hiring a Senior Account Executive to lead strategic market development - winning high-value growers, navigating complex sales cycles, and operating as a commercial leader with a high degree of autonomy. We're not looking for someone to manage a territory...SeniorProduce Careers Inc
Clarksburg, CA5 days ago- About the Employer The Elk Grove Unified School District (EGUSD) is the fourth-largest school district in California located in southern Sacramento County. EGUSD covers 320 square miles and includes 62 traditional public schools, five alternative education schools...Work at office
Elk Grove Unified School District
Elk Grove, CA1 day ago $100k - $125k
...Job Description We are seeking a highly skilled Senior Financial Planning Analyst to join our client's dynamic team in Elk Grove. This role will be responsible for assisting in financial planning, budgeting, and forecasting processes while providing strategic insights...SeniorTemporary workPacific ExecSearch
Galt, CA3 days ago- ...Snapshot / Role Overview We're seeking a Senior Plumbing Designer in Central Coast, CA to support and grow commercial mechanical... ...junior designers and drafters on best practices. Partner with engineers, contractors, and architects from concept to construction. Responsibilities...SeniorFor contractorsLocal area
Gulfstream Strategic Placements, LLC
Clarksburg, CA5 days ago - ...technology, R&D, and advanced manufacturing, including expanded engine assembly operations, to deliver high‑performance machines. Arctic... ...those who share its off‑road passion. Role Description The Senior Payroll Specialist is a full‑time, on‑site role based in Twin Cities...SeniorFull timeLocal area
Arctic Cat
Galt, CA2 days ago - Senior IT Project Manager / PMP Certified / Onsite / Rancho Cordova, CA Our team is partnering with a major California public sector organization to hire a part‑time Senior IT Project Manager to support highly visible, enterprise‑level technology initiatives. This role...SeniorContract workPart timeWork at office10 hours per weekDay shift
$92k - $115k
...excel at work and the resources to build a career you can be proud of. 1 st Shift, Monday-Friday 8:00am- 5:00pm As the Senior Engineer, Industrial, you will be responsible for facility layout and design, manpower planning, project scheduling and management, and...SeniorWork at officeLocal areaMonday to FridayShift workDay shiftGXO Logistics
Galt, CA2 hours ago$600 per month
...Electric Distribution Planning Engineer (Hybrid) Before learning more about this opportunity, please note: Relocation assistance... ...including data validation, troubleshooting, database integrity, and Python-based automation Contributing to distribution planning...PythonPermanent employmentContract workTemporary workH1bWork at officeRelocationVisa sponsorshipWork visaRelocation packageFlexible hours$35 - $40 per hour
...Senior Customer Service Advisor Galt - Galt, CA 95632 Overview Salary Range $35.00 - $40.00 Hourly Description Bay City... ...The Bay City Electric Works team provides generator, air, and engine solutions for life's power needs. Offering quality brands like KOHLER...SeniorHourly payWork at officeBay City Electric Works
Galt, CA11 days ago- ...Job Description Job Description Hawthorn Senior Living currently has an immediate opening for a Community Sales for our independent living communities in Elk Grove, CA . Hawthorn Senior Living is a rapidly expanding senior housing company, managing independent...SeniorImmediate startNight shiftAfternoon shift
$66.68k - $84.33k
...The Senior Executive Assistant is a high‑impact role that provides executive‑level support to the broader C‑suite team. This position combines executive operations, administrative excellence, strategic initiative support, and board governance coordination, making it central...SeniorContract workWork at officeMonday to FridayOne Community Health – CA
Sloughhouse, CA3 days ago- JOB DESCRIPTION Centered in the heart of San Joaquin County, Adventist Health Lodi Memorial has been one of the area's leading healthcare providers since 1952. We are comprised of a 190-bed hospital, 17 medical offices, home care services, comprehensive cancer care ...SeniorFull timeWork experience placementLocal areaDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer (Spark, Scala, Python, AWS/GCP). Be the first to apply!
Related searches
- senior level Elk Grove, CA
- senior operations technician Elk Grove, CA
- srs Elk Grove, CA
- senior application administrator Elk Grove, CA
- senior application security Elk Grove, CA
- senior manager legal Elk Grove, CA
- senior manager diversity & inclusion Elk Grove, CA
- senior performance engineer Elk Grove, CA
- senior Elk Grove, CA
- backend python developer