Data Platform Engineer
3B Staffing LLC
Position: Data Platform Engineer
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools . The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law
Location: Rochester, NY
Duration: 12+ Months
Hadoop and Informatica experience are a MUST
Description:
The Data Platform Engineer engages in the design, development and maintenance of the big data platform. This platform hosts structured and non-structured data sets that support various business operations and enable data-driven decisions. The role involves administering various data-hub ecosystem open source software tools along with other vendor supported tools like HortonWorks Hadoop, CISCO DV, IBM COGNOS tools . The DPE will work closely with Data Scientists, infrastructure Administrators and Data Platform Architects to ensure the platform meets business demands.
Essential Resource Responsibilities / Accountabilities: Level I- Installs and /or upgrades, configures, administers and troubleshoots the data hub software environment in order to achieve a reliable, highly available, well performing system- Provides direct technical support to data warehouse user community, and triages support to appropriate personnel when technical support is not sufficient.- Develops standards, policies and procedures for the form, structure and attributes of the data warehouse tools and systems - Develops data/information quality metrics- Develops processes to monitor cluster performance and resource usage- Works with Server Engineers to install new nodes, resolve node failures, and apply patches and upgrades- Maintains processes that feed data from various systems across the enterprise, ensuring data quality and process efficiency- Follows and helps streamline procedures for provisioning access to the BI system and establishing security Minimum Resource Qualifications:- Bachelor's degree in Information Technology, Computer Science, Software Engineering, or closely related field (or four additional years related work experience in lieu of bachelors)- Related work experience (i.e. Co-ops/Internships) preferred- Ability to take initiative and have a strong vision for driving large scale distributed data platforms- Experience with ecosystem components such as Hadoop, Cisco DV, Cognos, etc- Familiarity with Linux system administration, Linux scripting and networking skills- Proficiency in a programming language such as Python or Java is a plus- Experience with relational and NoSQL databases, including modeling and writing complex queries is a plus- MUST have EXCELLENT communication and
analytical skills Level I - Ability to perform routine tool maintenance working with the vendors and others on the team- Ability to identify data warehouse application and data issues- Monitor system uptime and performance- Escalate appropriately to management and/or more senior Tool Administrators- Minimum of 3 years' experience in tool administration- Demonstrated experience with Data Warehousing- Proactively identify and address risks on system before they become systems issues- Research and resolve data warehouse application and data issues
Physical Requirements- Ability to travel across regions Physical Requirements: In support of the Americans with Disabilities Act, this resource requirements document lists only those responsibilities and qualifications deemed essential to the position Equal Opportunity
Employer: As such, requires all suppliers of temporary staffing resources to affirm the rights of every person to participate in all aspects of employment without regard to race, color, sex/gender, age, disability, religion, creed, citizenship status, national origin, veteran status, military status, marital status, familial status, domestic violence victim status, sexual orientation, gender identity, predisposing genetic characteristic, genetic information, or any other status protected under the law
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Platform Engineer in Rochester, NY vacancy
- ...'re Looking For Megazone Cloud is looking for a Senior Data Engineer to help lead and define our data-driven culture. You are a "... ...and lead: Architect and own scalable, high-performance data platforms and pipelines on AWS, not just maintain them. Define the data...SuggestedImmediate startFlexible hours
$99k - $232k
...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...of experienceWhat Sets You Apart- Certification in Cloud Platforms [e.g., AWS Solutions Architect, AWS Data Engineer, Google...SuggestedFull timeH1b$76.73k - $127.88k
...wants to work in a collaborative environment? As an experienced Data Engineer - Project Delivery Senior Analyst, you will have the ability... ...designing, building, and operating modern data products and platforms across a scale delivery program (onshore/offshore). Your...SuggestedLocal areaVisa sponsorship- ...bringing clarity to global brands through Data & AI. From cloud-based ecosystems for... ...of 100+ tech specialists—including Data Engineers, Data Scientists, and more—delivers innovative... ...power downstream AI and BI systems. Data platform reliability — building the foundations (...SuggestedWork at officeRemote work
- ...Satori Analytics is seeking a Senior Data Engineer to design and operate large-scale data systems powering AI-driven marketing intelligence. You will own end-to-end pipelines, data platforms, and model workflows, collaborating with data scientists and software engineers...Suggested
- ...Who We’re Looking For Megazone Cloud is looking for a Data Engineer Co‑op who is a "builder" at heart and eager to apply technical skills to real‑world customer problems. We need students who are curious, driven, and comfortable asking "what if?" to solve complex challenges...Immediate start
- ...project management, and communication skills. Troubleshooting skills Previous information technology experience. Prior data center, server, or network engineer experience – especially with Cisco IOS or NX-OS platforms – is preferred. COVID-19 vaccination #J-18808-Ljbffr...Work at officeRelocationRelocation package
$124k - $280k
...SectorNot ApplicableSpecialismManaged ServicesManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Data Engineer - Senior Manager, you will leverage data and analytics to provide strategic insights and drive informed decision-making for clients...Full timeH1b$137.7k - $229.5k
Position Summary Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant impact on our clients... ...Work You’ll Do Lead complex Medicaid encounter and data delivery workstreams that help government clients...Local area$112k - $168k
...subsidiaries by implementing core technologies across industrial platforms in diverse growth markets. Our goal is to help revitalize the... ..., working closely with security, IT personnel, software engineers, and partners across our businesses to identify and remediate...Permanent employmentWork at officeRemote work1 day per week$108k - $122k
...is looking for a qualified IT Service Management professional in Rochester, NY. This role involves managing the service management platform, mentoring team members, and enhancing workflows. Ideal candidates have extensive IT experience and strong communication skills....Full time$153k - $297k
...join our team.KPMG is currently seeking an Associate Director, Platform Engineering to join our Enterprise Security Services organization.... ...continuous improvement of tool interoperability, workflow automation, data exchange, and operational effectivenessDrive the...H1bLocal area$84.63k - $112.84k
...the trusted network for the AI‑powered world, connecting people, data, and applications through our expansive fiber network and... ...in a Candidate ~3–5 years of experience in data science, data engineering, analytics, or a related role ~ Strong Python and SQL skills...Full timeTemporary workRemote workWork from home- Our Benefits - Designed with You in Mind Comprehensive Health & Well-being Coverage From your very first day, you’ll have access to medical, dental, vision, and prescription drug coverage - ensuring you and your family stay healthy and protected. Generous Paid Time...Full timeImmediate start
$100k
...We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers for full time positions with clients. Who Should Apply Recent Computer science/Engineering /...Full timeH1b- ...for all . Join our mission as our next Senior DevOps Engineer to join our R&D Instrument Platforms organization. This role will focus on the design,... ...addition to internal equity and alignment with market data. At QuidelOrtho, it is not typical for an individual to...Local areaRemote workFlexible hours
$107.66k - $161.7k
...Quora : a global knowledge sharing platform with over 400M monthly unique visitors,... ...About the Team and Role: Our small engineering team works on challenging problems every... ...Machine Learning systems -- from prototyping, data pipelines and training, to realtime LLM...Remote jobFull timeWork experience placementInternship- ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with... ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning...Permanent employmentFull timeWork at officeRemote workWork from homeFlexible hours
- ...Job Description Job Description As a Data & AI Engineer, you’ll build and deploy modern data pipelines and generative AI solutions on AWS — from scalable ETL/ELT workflows and cloud data platforms to production-grade RAG systems and AI agents. One engagement you may...
$125k - $350k
...in technology, research, and finance to create innovative solutions that impact the financial markets and take data analysis to new levels. Software Engineers create next generation software solutions to support business areas across the firm. Software Engineers work closely...- ...and fulfillment. We use machine learning and Internet-scale data to elevate customer experience, improve efficiency, and reduce... ...and Discovery ML team at Instacart works alongside world-class engineers, data scientists, and product managers to shape the future of search...Remote jobPermanent employmentWork experience placementInternshipWork at officeWork from homeFlexible hours
- ...AI Engineer This position is available for US based applicants only. Location... ...and Payroll problems. Leads creation of data analytics capability for identifying key... ...solutions. ~2 years of experience in cloud platforms (e.g. AWS, Azure, Google Cloud) and containerization...Contract workWork visa
- ...on what matters most. As an AI Solutions Engineer, you'll design, build, deploy, and continuously... ...expert for Glean, our enterprise AI platform, helping troubleshoot complex issues,... ...tracked so your Strategist partners have the data they need to assess impact. Contribute...
$113.5k - $153.6k
...Job Details: Job Description: Join Intel as an AI Software Engineering Graduate Intern, where you will contribute to the development and optimization of cutting-edge AI software solutions. In this role, you will work on designing algorithms, frameworks, and AI software...Remote jobInternshipStart working todayLocal areaImmediate startWork from homeShift work- ...external DNS and domain registration using industry-standard platforms.Administer F5 GSLB, BIG-IP, and XC for dynamic, scalable deployments... ...of F5 or similar technologies.6-8 years in IT network engineering roles, including LAN, wireless, WAN, SD-WAN, and routing protocol...
- Job Title AVANGRID MANAGEMENT COMPANY, LLC. Mobility Information Please note that any applicant who is not a citizen of the country of the vacancy will be subject to compliance with the applicable immigration requirements to legally work in that country. At...Local area
- ...work directly with clients to guide technical strategy, mentor engineering teams, and deliver scalable applications across a variety of industries... ...decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us....
$100k - $160k
...Full Stack Cloud Engineer As a Full Stack Cloud Engineer, you'll build and modernize scalable... ...,.NET Framework ~ Experience using AWS platforms including but not limited to Cognito and... ...applications on AWS Working with AWS data storage solutions like DynamoDB, NoSQL,...$142.6k - $261.5k
...for our communities. The opportunity The Platforms Practice specializes in mission-critical, intelligent... ...digital future. Our elite team of product leaders, data scientists, designers, and software engineers enable our clients to solve their most complex product...Summer holidayFlexible hours- EY is seeking a Cloud Security Consultant in Rochester, NY, specialized in Microsoft Azure security architecture and Wiz CNAPP technology. This role focuses on integrating cloud security within a DevSecOps model, developing best practices, and monitoring compliance. The...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Platform Engineer. Be the first to apply!
Related searches
- data developer Rochester, NY
- data science developer Rochester, NY
- finance data engineer Rochester, NY
- data engineer machine learning Rochester, NY
- data engineering intern summer Rochester, NY
- data engineer Rochester, NY
- senior data center engineer Rochester, NY
- data center engineer Rochester, NY
- data engineer analytics Rochester, NY
- data coordinator Rochester, NY



