Data Engineer

We are seeking motivated, dynamic professionals who are passionate about serving their local communities.Join our team: Apply to our open position(s) below. OPEN POSITION ANNOUNCEMENT! Posted 4/29/2026 San Diego County – hybrid work schedule set by SDCP About the role : The San Diego Community Power (SDCP) is seeking a seasoned Data Engineer to join our growing team of analytics experts who will be responsible for designing, maintaining , expanding, and optimizing our data infrastructure for data collection, management, transformation, and access. A key priority of this role will be to assist in SDCP’s development of centralizing its data eco-system to allow for creation of pipelines that convert raw data into usable formats for data analysts and other data consumers to utilize . The Data Engineer will handle the core data aspects of software engineering and data science and utilize software engineering principles to develop algorithms that automate the data flow process. They will collaborate with data and system analysts to build machine learning and analytics infrastructure from testing to deployment. WHO IS SAN DIEGO COMMUNITY POWER? San Diego Community Power is a community-driven, not-for-profit public agency providing cleaner energy to the San Diego region. Formed in 2019, Community Power is the second largest Community Choice Aggregator (CCA) in California , serv ing nearly 1 million customer accounts across its member agencies: the Cities of San Diego, Chula Vista, Encinitas, Imperial Beach, La Mesa and National City, as well as the unincorporated areas of San Diego County. OUR HISTORY San Diego Community Power was formed in 2019 as a public, not-for-profit community choice aggregator (CCA) in the San Diego region. We began electric service in 2021 and serve five member agencies: San Diego, Chula Vista, Encinitas, La Mesa and Imperial Beach, County of San Diego, and National City. SDCP was formed to bring local control and customer choice to San Diego while also providing clean and renewable energy at competitive rates. By the end of 2023, SDCP will provide electricity for nearly half the electric load in San Diego Gas and Electric’s service territory and will be the second largest CCA in California. For more information, please visit SDCommunityPower.org. COMMITMENT TO DIVERSITY At SDCP, we value diversity and are committed to creating an inclusive environment for all employees. We represent a diverse customer base and hope to hire employees that reflect our communities. We provide equal employment opportunities to all applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. ESSENTIAL DUTIES AND PRIMARY RESPONSIBILITES Building and maintaining a centralized cloud-based data infrastructure for optimal extraction, transformation, and loading of data from a wide variety of sources. Assemble large, complex data sets that meet functional/non-functional business requirements. Developing data tools and APIs for data analysis. Deploying and monitoring machine learning algorithms and statistical methods in production environments to solve organizational needs. Ensuring data accessibility and security and implementing company data policies regarding data privacy and confidentiality. Improving data systems reliability, speed, and performance. Build analytics tools that utilize the data pipeline to provide actionable insights into customer trends, operational efficiency, and other key business performance metrics. Collaborating with other internal teams, data analysts, and other stakeholders to understand and optimize how data can be leveraged to meet business needs. Assist in drafting data and analytics’ solicitations and in the selection of consultants. Assist with drafting staff reports and presentations for Board and Committee meetings. Performs other related duties and responsibilities as required. MINIMUM KNOWLEDGE, SKILLS, AND ABILITES Advance working knowledge of SQL, experience working with relational databases, query authoring (SQL) and working familiarity with various databases. Demonstrated experience in developing API and integrations to support analytics in cloud environment. Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency, and workload management. A successful history of manipulating, processing, and extracting value from large, disconnected datasets. Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores. Good understanding of data architecture, data design, data warehousing and data modeling concepts. Strong project management and organizational skills. Experience supporting and working with cross-functional teams in a dynamic environment. PREFERRED KNOWLEDGE, SKILLS, AND ABILITES Experience in the energy sector and/or supporting the implementation of programs funded by California state agencies (e.g., California Public Utilities Commission, California Energy Commission, California Air Resources Board). Ability to strongly represent the organization in various professional engagement settings from local to national convenings (conferences, workshops, executive meetings, etc.). PREFERRED QUALIFICATIONS, EDUCATION AND EXPERIENCE Minimum of two (2) to three (3) years of professional experience in a Data Engineer role, preferably in the energy industry with a graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. The candidate should also have experience using the following software/tools: Experience with big data tools: Hadoop, Spark, PowerBI, Kafka, etc. Experience with AWS, Azure and Google Cloud services. Experience with relational SQL and NoSQL databases. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with open-source technologies: Python, Pytorch, Flask, Tensorflow or Keras Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Java, C++ etc. Experience with batch, micro-batching and real-time data ingestion methodologies. Experience with GitHub or similar code repositories WORK ENVIROMENT & CONDITIONS Prolonged periods sitting at a desk and working on a computer. The position requires occasional carrying, lifting and/or moving objects up to 25 pounds. Occasional local travel required and reliable transportation to be able to attend SDCP events, meetings, and workshops as needed is expected. At SDCP we work in the communities we serve and in the office. SDCP works to ensure a safe and healthy workplace for employees and in our communities. SDCP requires employees to be fully vaccinated for COVID-19. SDCP is an agency required to adopt and promulgate a Conflict-of-Interest Code (“COI”). The COI code requires employees in designated positions, including those identified under the interim disclosure process to file a Statement of Economic Interests (Form 700) on an annual basis. A Successful candidate accepting this position may be required to file Conflict of Interest forms subject to the regulations of the Fair Political Practices Commission. COMPENSATION: Salary Range: The position salary range is: $84,900 - $110,400; with exact compensation to be determined by SDCP, depending upon experience. Benefits : Standard benefits package including but not limited to: Insurance : SDCP offers group health benefits, including medical, vision, and dental insurance, for eligible FT employees. Also provided is a $100,000 Life & AD&D policy, STD and LTD coverage that is 100% paid by SDCP. Retirement : SDCP offers a 457(b) plan for employee contributions and contributes 10% of eligible compensation to the employee’s Money Purchase Plan. Paid Time Off : 11 holidays per year + paid winter holiday (between 12/24-12/31), 160 hours of accrued paid time off per year (increases with time in service), and 96 hours per year of accrued paid sick leave. This job description may not be inclusive of all assigned duties, responsibilities, or aspects of the job described, and may be amended at the discretion of SDCP as needed. $84,900 - $110,400 USD Create a Job Alert Interested in building your career at San Diego Community Power? Get future opportunities sent straight to your email. Accepted file types: pdf, doc, docx, txt, rtf Enter manually Accepted file types: pdf, doc, docx, txt, rtf Education School Select... Degree Select... Select... Select... Start date year End date month Select... End date year Website LinkedIn Profile What are your salary expectations? * Do you have work authorization? * Will you require future work sponsorship? * Are you willing to relocate to San Diego, California (this position is a hybrid work schedule)? * Select... How did you hear about this position? * If you are a referral, who referred you? Please provide three (3) professional references, their email addresses and your working relationship to your listed reference. * Accepted file types: pdf, doc, docx, txt, rtf Voluntary Self-Identification For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file. As set forth in San Diego Community Power’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law. If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985. Select... Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years. Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at . How do you know if you have a disability? A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to: Alcohol or other substance use disorder (not currently using drugs illegally) Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS Blind or low vision Cancer (past or present) Cardiovascular or heart disease Celiac disease Cerebral palsy Deaf or serious difficulty hearing Diabetes Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders Epilepsy or other seizure disorder Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome Intellectual or developmental disability Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD Missing limbs or partially missing limbs Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS) Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities Partial or complete paralysis (any cause) Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema Short stature (dwarfism) Traumatic brain injury Disability Status Select... PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete. #J-18808-Ljbffr