Staff Data Engineer (Big Data) - Data Product Development
Job Description
- Development and programming functions to ensure that projects are delivered on time and within budget with good code quality.
- Work with architects, systems analysts, project managers, QA, and other developers to successfully implement business requirements while applying the latest available tools and technology.
- Responsible for the architecture, design, development, implementation of data-based software applications. This includes working with both business and technical stakeholders to deliver high quality products and services that meet business requirements and expectations.
- Interact with business units to define requirements/modifications and use case to utilize in designing appropriate solutions.
- Provide recommendation on scope and scale of effort required to develop solution.
- Design, develop, document, and implement new programs and subprograms, as well as enhancements, modifications, and corrections to existing software - Develop testing and debugging routines.
- Create documentation and procedures for installation and maintenance.
- Build and maintain relationship with global and virtual teams and third parties on software development or support issues.
- Identify opportunities for further enhancements and refinements to standards, best practices, and development methodologies.
- Work directly with Architects, System Analysts, Dev leads, and QA team leads to manage the technical aspects of a development pipeline.
Job Requirement
- Extensive experience in architecting and developing real-time applications that are fault-tolerant, scalable and can handle high volumes.
- Experience in best practices for API development and design patterns.
- Experience in all phases of software development life cycle including project management, functional requirements definition, technical design, development, testing, quality assurance, system certification, systems implementation, and system validation.
- Consistently able to assess and evaluate problems in a production environment and manage risk to the service when recommending change.
- Strong secure coding practices.
- Good Knowledge on Hadoop framework and related Big Data Technologies (HDFS, Map Reduce, Spark, HBase, Kafka).
- Strong knowledge in Java or Scala or Python.
- Strong knowledge of database concepts, systems architecture, and data structures is a must.
- Java/J2EE/Angular, Spring Cloud, Microservices and strong knowledge on API development is desired.
- Experience working in an Agile and Test-Driven Development environment.
- Process oriented with strong analytical and problem-solving skills.
- Work independently and mentor others in the team and with minimal supervision.
- Ability to juggle multiple projects and change direction mid-course based on business drivers.
- Ability to work independently in a high throughput environment.
- Demonstrated intellectual and analytical rigor, strong attention to detail, team oriented, energetic, collaborative, diplomatic, and flexible style.