Big Data Developer - II

Senior Teradata ETL Data EngineerLooking for a Senior Teradata ETL Data Engineer to work with a small team responsible for building a Teradata solution that will enable operations for a large enterprise environment. Must be able to design, build and maintain Enterprise Level Data Pipe-Lines/Curation utilizing the tools available within Big Data Eco-System. As a Senior Big Data Engineer - You will work on Advanced Analytics using Big Data technologies such as Hadoop and Data Warehousing.Build analytical solutions to enable Data Scientist by manipulating large data sets and integrating diverse data sources.Perform ad-hoc analysis and develop reproducible analytical approaches to meet business requirements.Perform exploratory and targeted data analyses using descriptive statistics and other methods.Use complex algorithms to develop systems & applications that deliver business functions or architectural components.Work closely with the data scientists, and database and systems administrators to create data solutions.Follow best practices on design and implementation to aid in company-wide data governance.Improve existing data pipelines by simplifying and increasing performance.Design, build, and deploy new data pipelines within Tearadata Eco-Systems.Documents new/existing pipelines, Data Sets and Data Sets.Abides by department development standards and SOP's.Attends all department meetings.All other duties as assigned.Keeps updated on latest technologies relevant to positions duties.Has great knowledge of commonly used software concepts and design.Great knowledge of the development lifecycle.Keeps management updated on projects and assigned work.You will need to have:Bachelors degree or six or more years of work experience.Six or more years of relevant work experience.Even Better If You Have:Experience of designing, building, and deploying production-level data pipelines using tools from Teradata Utilities (Mload/Fload Tpump TPT)Experience with various SQL databases and very strong in SQL queryExperience with analytic or feature engineer programming with procedureExperience implementing open source frameworks & exposure to various open sourceExperience troubleshooting Process failure issues.Experience with SQL databases and Change Data Capture.Experience and strategies to deal with mutable data in Hadoop.Experience with Stream with TPTExperience of Agile and DevOps methodologies.Relies on limited experience and judgment to plan and accomplish goals.Works under general supervision.Experience in full development life cycle and significant experience in delivering applications and architecture services.Addon Experience: (Good if you have)Experience on Big Data with SparkExperience evaluating and implementing cutting-edge digital technologies.Experience with Cloud technologies (AWS, GCP, PCF, Docker, Kubernetes and application migration.Experience in data visualization tools like Kibana, Grafana, Tableau and associated architectures.