Big Data Developer
Full-time
Unisys
- We are seeking a highly skilled and experienced Big Data Engineer to design, develop, and optimize large-scale data processing systems. In this role, you will work closely with cross-functional teams to architect data pipelines, implement data integration solutions, and ensure the performance, scalability, and reliability of Big Data platforms.
- The ideal candidate will have deep expertise in distributed systems, cloud platforms, and modern Big Data technologies such as Hadoop, Spark etc.
- Demonstrated technical expertise in Object Oriented and database technologies/concepts which resulted in deployment of enterprise quality solutions.
- Design, develop, and maintain large-scale data processing pipelines using Big Data technologies (e.g., Hadoop, Spark, Python, Scala).
- Design, develop, test, implement, and support technical solutions within an Agile development environment, utilizing distributed microservices architecture, big-data technologies (HIVE, Presto, Spark, Hadoop, Trino), and full-stack systems.
- Partner with cross-functional teams to understand application requirements and testing scenarios, delivering scalable technical solutions that meet business objectives.
- Build and maintain high-performance API platforms on AWS infrastructure, enabling interactive-speed access to big data while adhering to AWS Well-Architected Framework principles.
- Leverage AI tools and technologies to enhance development efficiency, code quality, and solution innovation throughout the software development lifecycle.
- Drive technical innovation by staying current with emerging technology trends, including AI/ML advancements, evaluating new tools and frameworks, and actively contributing to internal and external technology communities.
- Demonstrate a growth mindset, take ownership of deliverables, maintain customer-centric focus, and exercise sound technical judgment in decision-making.
- Python and/or Scala
- Big data (we work with terabytes per day)
- AWS
- SQL
- Orchestration, deployment understanding
- Kubernetes (troubleshooting, configuring for scale), can be AWS, GCP, or Azure Kubernetes. Should have maintained existing Kubernetes infrastructure
- GenAI for use in engineering (ex: Kiro), LLMs, etc.
- 8+ years of professional software engineering experience with demonstrated leadership capabilities.
- 3+ years of hands-on development experience in Data Engineering, Python / Scala / Java, SQL.
- 3+ years working with Big Data technologies such as Hadoop, Spark, or Presto, etc.
- 2+ years developing REST/web services and writing complex SQL queries for relational databases.
- Proven experience with AWS services including EMR (Hive/Presto), Glue, Athena, ECS, Lambda, and S3.
- Proficiency with DevOps practices and CI/CD pipelines using tools like Jenkins, Cloud Formation, etc.
- Working knowledge of scripting languages.
- Bachelor’s degree in computer science, information technology, engineering, or related technical field.
Responsibilities:
Must have skills:
Qualifications:
#LI-CGTS
#TS-3142
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
