Software Engineer

Job SummaryPosition Duties:Develop real time data pipelines and solve big data problems utilizing modern technologies like Spark, Python, Java/Scala, SQL, and AWS cloud environment. Write reliable, maintainable, well-documented code that will scale to support millions of respondents. Create and maintain optimal data pipeline architecture. Execute the full software development life cycle as part of an Agile team. Collaborate with Product Managers to refine and modify requirements. Follow established design paradigms and design patterns. Utilize abilities in unit testing and integration testing. Participate in the on-call rotation to monitor shipped features for success and issues. Support the business teams and product managers in data extracts and data analysis. Demonstrate proficiency in developing software for the user interface, business logic, data modeling and systems, and component integration. Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics. Perform pull requests reviews and CI/CD pipeline integration. Develop and manage end-to-end ETL pipelines for both real-time and batch processing, ensuring the secure and efficient migration of large-scale datasets from MSSQL environments to cloud-based data warehouses. Engineer robust streaming architecture using SNS, Kinesis Data Streams, and Kinesis Data Analytics to enable real-time insights and schema-validated ingestion, ensuring high-quality data delivery. Utilize the following tools and technologies: Github, SQL, REST APIs, and Jira. Position allows work from home anywhere in the United States. Headquarters located at 1235 Saint Thomas Street, Suite 201, New Orleans, LA 70130.Position Requirements:The position requires a Master's degree or foreign equivalent degree in Computer Science, Technology Management, or closely related field. The qualified candidate must have at least 1 year (12 months) of experience in a software engineer position or closely related occupation. The qualified candidate must also have at least 1 year (12 months) of experience with all of the following: (a) performing pull requests reviews and CI/CD pipeline integration; (b) developing and managing pipelines ensuring secure and efficient migration of large-scale datasets; (c) writing and optimizing complex, performance-oriented SQL queries; (d) engineering advanced data features/architectures to ensure high-quality data delivery; and (e) utilizing the following tools and technologies: Github, SQL, REST APIs, and Jira. All experience may be gained concurrently.