Big Data Tech Lead
Citi Expired |
||
Mississauga, Canada |
Responsibilities
- Provide architectural and technical leadership for the CitiVelocity Data Platform.
- Design & develop various data processing pipelines, data access services and APIs
- Able to develop and articulate technical architecture and solutions as well as explain the competitive advantages of various technology alternatives to a broad audience entailing members within and outside the organization with backgrounds of being highly technical leaders to business partners with strong business and data acumen.
- Build processes and tools to maintain high data availability, quality, and maintainability.
- Ability to translate business concepts to technical terms.
- Collaborate with key stakeholders, other product development groups and software vendors to identify and define solutions for complex business and technical requirements.
- Engage with business partners to understand their needs and provide suggestions/guidance on appropriate solutions to solve their problems with pros/cons articulated clearly
- Drive internal proof of concept initiatives. When needed, quickly design and implement a prototype of a system or component with a proper architecture that can be fully built-out once validated.
- Provide mentorship and help team growth
- Experienced technology leader with a minimum of 8+ years of software development experience including 5+ years of data application or data platform architecture experience with deep technology expertise in the following:
- Architecture design and development of large scale data platforms and data application with simple solutions
- Extensive hands on design/coding experience/skills in languages Java and preferably Python
- Deep knowledge and hands on experience on big data and cloud computing technologies including Spark, Hive, HBase and preferably in AWS/Snowflake
- Expertise in Spring Boot Framework for developing APIs
- Expertise in Kafka and Elastic Search
- Expertise in design and management of complex data structures and data processes
- Expertise in metadata management, ETL processing, reference data management.
- Expertise in streaming and batching data processing
- Strong on elegant coding, can write very solid prototypes or core components quickly.
- Strong service architecture and development experience with high performance and scalability
- Technical background in data with deep understanding of issues in multiple areas such as data acquisition and processing, data management, distributed processing, and high availability is required.
- Experience in statistics, data mining, machine learning and operational excellence of production systems is a plus.
- Strong at technical goal setting for a project with actionable success metrics. Good knowledge and experience on measuring a service from user experience angle.
- Strong on driving for results and self-motivated, strong learning mindset, with good understanding of related advanced/new technology. Keep up with the technology development in the related areas in the industry, which could be leveraged to enhance current architectures and build durable new ones.
- Good verbal, written, presentation, facilitation, and interaction skills, including ability to effectively communicate architectural issues and concepts to multiple organization levels and executive management.
- Strong skills on mentoring/growing junior talent
- Bachelor's degree in Computer Science or related technical discipline required; advanced degree is a plus.
- Bachelor's degree in Computer Science or related technical discipline required; advanced degree is a plus.