Senior Data Engineer
InterSources Inc
Sr Data Engineer
Role: Sr Data Engineer MoI: 2 Video Notes from Manager: Candidates must be located in San Antonio, TX, VA, DC, NY- will work onsite first week and then remotely, contract through end of year, ideally 5+ years of experience with Pyspark who has experience building a code framework using Pyspark and debugged using spark logs for performance tuning. The expected output is a highly performant code that will used as a backbone for the enterprise, able to handle complex business transformations and move data from Delta format (Databricks) to a data warehouse in Synapse Pyspark, Spark Architecture, Azure Databricks (Unity Catalog), Azure Synapse, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS)
Responsibilities
- Takes a leading role in the design, development and implementation of processes to extract, transform and load data from disparate sources into a form that is consumable by analytics processes within a given project, reviewing deliverables to ensure high quality
- Evaluates and resolves issues regarding data quality reviews, cleansing, data integration and migration, leveraging advanced technical knowledge and showing technical leadership in aspects of data engineering while driving continuous improvement efforts
- Ensures that the appropriate expectations, principles, structures, tools and responsibilities are in place to deliver the project
- Analyzes the latest industry trends such as cloud computing and distributed processing and infers potential impact on businesses (short and long-term)
- Provides advanced technical expertise to maximize efficiency, reliability and value from current data engineering processes and researches and monitors existing client base and industry developments to identify potential new product opportunities from emerging technologies
- Develops strong working relationships with peers across engineering, collaborating to develop leading data engineering solutions
- Drives adherence to the relevant data engineering and data modelling processes, procedures, standards, and may input into the definition, maintenance and implementation of technology standards
Qualifications
- Uses most of the related skills and technologies, and maintains an in-depth knowledge of the area
- Experience designing and conducting research and experiments with recently developed technologies
- Has successfully demonstrated domain of most skills and technologies during a large number of relevant projects
- Strong experience in the use of complex technologies Computer Science
- Typical Education: Engineering, IT, Mathematics
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Farmington, NY vacancy
- ...Senior Data Engineer The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Senior Data Engineer will report to the Sr Manager, Data Solutions / Manager. This role...SeniorFull timePart timeWork at officeLocal areaWork from homeHome office2 days per week
Blue Shield Of California
Farmington, NY4 days ago $205k - $249k
...Senior Analytics Engineer/Data Scientist Laurel is on a mission to return time. As the leading AI Time platform for professional services firms, we're transforming how organizations capture, analyze, and optimize their most valuable resource: time. Our proprietary...SeniorWork at officeRelocation package3 days per weekLaurel Property Services
Farmington, NY2 days ago$65k - $80k
...succeed. To learn more about our One Broadstone culture, visit our website. The Analytics Engineer will support the development of Broadstone Net Lease's modern, automated data platform by building data pipelines, models, and APIs that power reporting, business analytics...SuggestedWork at officeFlexible hours- ...Job Title 8+ years of hands-on experience in data engineering, ETL development, and SQL Server administration Strong proficiency in SSIS (SQL Server Integration Services) and T-SQL development Strong experience with Azure Data Factory for pipeline orchestration...Suggested
Software Technology Inc
Farmington, NY4 days ago - ...Senior Project ManagerWe need a senior seasoned PM who is more than just asking whether task is done and writing minutes. We will need... ...MDM (especially Customer domain) is preferred. Experience with Data Mastering and data management Proven skills in project management...Senior
Yantran LLC
Victor, NY3 days ago - Job TitleVictor, NY, USA100,000.00-130,000.00 per year Medical, dental, and vision insurance, paid time off and holidays, Simple IRA with company match, and ongoing professional development and career growth opportunities.Senior
IK Systems, Inc
Victor, NY1 hour ago - A leading beauty retailer in New York seeks a Master Stylist passionate about the beauty industry. You will engage with guests, perform various hair services, and contribute to achieving sales goals. Responsibilities include consulting on hair care needs, providing exceptional...SeniorFull timeWork experience placement
$20 - $20.25 per hour
...Senior Assistant Store Manager Hourly rate ranges from $20.00 - $20.25 per hour. Work up to 38 hours per week. Minimum age requirement 18. Physical demands include more than 8 hours of standing, walking, climbing ladders and lifting up to 50 pounds. Responsibilities Create...SeniorHourly payLocal areaSpencer Gifts
Victor, NY3 days ago$20 - $20.25 per hour
Assistant Store Manager Hourly rate ranges from $20.00 - $20.25 per hour and is dependent upon qualifications and experience. Benefits include: Company Paid Sick Time, Paid Vacation Time, Paid Holidays, Bereavement Pay, Jury Duty Pay, Contest Prize Awards, 401K Plan...SeniorHourly payLocal areaSpencer Gifts
Victor, NY3 days ago$118k - $143k
SENIOR ELECTRICAL ENGINEER The Technical Services Division specializes in commissioning new substations, performing maintenance and testing of existing... ...compliance with industry standards.Analyze power quality data and generate detailed reports with actionable insights....SeniorWork at office$126.03k - $180.05k
...to fit 99% of all contact wearers. Learn more at Job Summary:The Senior Manager, Digital Marketing Communications, Global (hereafter the... ...insight-led content optimisation by leveraging data and insights to improve content effectiveness, user experience and...SeniorWork at office- ...service agency that challenges our clients to get clear. Because data, content and creativity are only as good as the problem they... ...and enduring: That’s our kind of progress. ABOUT THE ROLE: The Senior Public Relations Manager will serve as DS+CO’s senior PR lead within...SeniorFlexible hours
Dixon Schwabl
Victor, NY1 day ago $176.63k - $271.73k
At CooperVision, a business unit of CooperCompanies (Nasdaq: COO), we’re driven by a unified purpose of helping people experience life’s beautiful moments. We are connected through our shared values - dedicated, innovative, friendly, partners, and do the right thing. As...SeniorPermanent employmentFull timeH1bWork at officeRelocation package- Senior Commercial Analyst (Finance) At CooperVision , a business unit of CooperCompanies (Nasdaq: COO), we're driven by a unified purpose... ...to the Sr. Manager, Commercial Analytics, the Analyst enables data-driven decision-making across the U.S. commercial organization....SeniorPermanent employmentFull timeH1bRelocation package
$84.14k - $112.18k
...Senior Internal Auditor At CooperCompanies, you have the opportunity to be part of a company that helps people experience life's beautiful... ...Office, including Word, Excel, PowerPoint, and Excel. Data analytics skills a plus. IT controls experience a plus. Understanding...SeniorPermanent employmentFull timeH1bWork at officeLocal areaRelocation packageCooper Cos.
Victor, NY3 days ago- ...ML Engineer Location: CA, WA, FL, NY (Disney Hubs) – Onsite Orlando, Florida San Francisco, California Seattle, Washington... ...Skills: Machine learning, and deep learning techniques, exploratory data analysis (EDA), data science Key Responsibilities:...
Software Technology Inc
Farmington, NY2 days ago $97.9k - $179.5k
...Risk Consulting - Risk Technology - SAP Controls - Senior Consultant Location: New York Other locations: Anywhere in Region Salary: Competitive Date: Jul 22, 2026 At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected...SeniorWork experience placementSummer holidayFlexible hoursEY
Farmington, NY4 days ago$75k - $90k
Overview Senior Accountant Needed // Financial Reporting // Technical Accounting -- $75,000 - $90,000 per year in Victor, NY. This Jobot... ...accuracy and completeness of reports; reconcile with source data. Liaise with departments for reporting inputs. Adhere to reporting...SeniorWork at officeLocal area- ...Position Summary We are seeking an experienced and detail-oriented Senior Payroll Specialist to lead and oversee all aspects of payroll... ...policies and applicable laws. Review and validate payroll data, including earnings, deductions, commissions, bonuses, garnishments...SeniorLocal area
FirstLight
Victor, NY4 days ago $97.63k - $120k
...Reporting to the Sr. Manager, Commercial Analytics, the Analyst enables data-driven decision-making across the U.S. commercial organization.... ...partnering with stakeholders across Commercial, Operations, and Senior Leadership to identify business needs, document requirements,...SeniorPermanent employmentFull timeH1bWork at officeRemote workRelocation packageCooperSurgical
Victor, NY19 hours ago- ...opportunity to grow and make an impact. Senior Optics Technician Reports to:... ...complex optical configurations. Follow engineering drawings, manufacturing instructions, procedures... .... Maintain accurate notes, record data, track job time, and properly fill out...SeniorPermanent employmentFull timeTemporary workWork at officeMonday to FridayFlexible hoursWeekend work
Vertex Optics
Victor, NY9 days ago - ...Data Scientist I This is a Hybrid position based out of the Fairport, New York Office Position Summary: The Data Scientist will... ...Systems, Business Analytics, Statistics, Mathematics, Engineering, or related discipline preferred Master's Degree in Data Science...Permanent employmentWork experience placementWork at officeRemote work
ConServe
Fairport, NY1 day ago - ...Sr. Automation Engineer Exact work location NJ/NY • Bachelor of Technology or equivalent college degree in relevant discipline 10+ years of related experience in applicable field • Hands-on experience with Selenium, Java, BDD for automated QA test implementation •...Senior
ClifyX
Farmington, NY4 days ago $150k - $200k
...purpose radios for government customers and licenses DF and geolocation solutions to multiple OEMs. Position Summary As a Senior RF Engineer, you will drive the design, development, testing, and debugging of advanced RF systems. This role requires a proven leader...SeniorHourly payFull timeTemporary workWork at officeMonday to FridayFlexible hoursShift workMetrea
Victor, NY1 day ago$110k - $120k
...Senior Network Engineer New York, United States Established in 1744, Sotheby's promotes access and ownership of exceptional art and luxury... ...network team, IT management, and key departmental users on data communication requirements and the coordination of issues. Strong...SeniorWork at officeLocal areaFlexible hoursAfternoon shiftSotheby's
Farmington, NY1 day ago$130k - $160k
...purpose radios for government customers and licenses DF and geolocation solutions to multiple OEMs. Position Summary A Senior Software Engineer shall be capable of leading the design, development, testing, and debugging of software components for embedded systems....SeniorHourly payFull timeTemporary workWork at officeMonday to FridayFlexible hoursShift workMetrea
Victor, NY1 day ago$24 - $32 per hour
...Overview: The senior technician must be capable of assembling and/or testing a variety... ...tests using common and/or computerized data acquisition equipment (i.e. Labview), and... ...industry standards. Interprets blueprints, engineering orders, assembly routes, test...SeniorHourly payContract workG.W. Lisk Company, Inc.
Clifton Springs, NY2 days ago$37.38k - $43.68k
...follow written and verbal instructions Familiar with Health Department Regulations Previous experience working with the senior population preferred Strong background in food production and line serving Experience: Minimum 3 years working in the...SeniorHourly payDaily paidPart timeWeekend workDay shiftAfternoon shift- ...Senior Product Architect – Enterprise Analytics Services Location: India or United States Reports To: Director of Engineering – Enterprise Software & Analytics Services (Agile Value Stream Leader) Position Summary Qualitrol is building an AI-Native Product...SeniorFull time
Ralliant
Fairport, NY1 day ago - Job Description YOUR ROLE As a part-time Sr Brand Ambassador, you bring our brand to life every day! Your goal is to provide everyone who comes in the store with an amazing shopping experience, making their day better than before they came in. You are the face of ...SeniorFull timePart timeCasual workSeasonal workLocal areaFlexible hoursWeekend workAfternoon shift
American Eagle Outfitters
Victor, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
