Job Description

POSITION GENERAL SUMMARY

The Manager - Data Engineer will be part of the Analytics department.

The Manager - Data Engineers will be responsible for implementing ETL processes and ensuring optimal performance by monitoring and advising on any necessary infrastructure changes. To implement such changes, Data Engineers will work with the data steward to ensure that the information used is in compliance with the regulatory and security policies put in place. They will require advance knowledge of Big Data analysis and management tools in order to be able to recommend and provide industry best practices. 

As a Manager - Data Engineer the role requires the candidate to work with the IT team and Data Scientists to assess and extract, transform and load large volumes of data. You will work with the team leaders and members to recommend ongoing improvements to methods and algorithms that lead to findings and present the rationale of those findings in easy to understand terms for the business. 

ESSENTIAL POSITION FUNCTIONS

• Lead in providing solutions by adapting to developed framework
• Contributes to the success of the Analytics department
• Synthesize research findings in easy-to-understand terms for the business
• Design and implement scalable big data solutions
• Develop and maintain data pipelines and ETL processes
• Optimize data storage and retrieval systems
• Defining data retention policies
• Ensure data security and compliance with MAHB standards
• Build robust data processing systems and analytics platforms
• Develop APIs for data integration across multiple systems
• Implement machine learning models in production
• Create data visualization solutions
• Monitoring performance and advising any necessary infrastructure changes
• Devising and integrating any Big Data tools and frameworks required to provide requested capabilities
• Develops, constructs, tests and maintains architectures, such as databases and large-scale processing systems
• Lead initiatives for continual improvements

Key Challenges

• Synchronizing liaison work to meet implementation datelines of various initiatives.
• Coordination and the development of a unified digital platform.
• Ensure the availability of the "Data Lake" as a corporate "single source of truth"

Skills

• Able to work independently, good communication skills and able to liaise across different levels of management, dedicated, and have endurance.
• Logical and enthusiastic statistical genius
• Intuitive data junkie with high “figure-it-out” quotient
• Strong communication skills with the ability to articulate findings in easy to understand terms for the business and team members

Education

External

• Degree preferably with specialization in Data Science/ Data Management, Computer Science, Statistics.
• Master degree would be an added advantage

Relevant Industries

External

• Degree with minimum 5 years relevant experience
  • Strong programming skills in Python, Java, or Scala
  • Expertise in big data technologies (Hadoop, Spark, Kafka)
  • Experience with cloud platforms (GCP, AWS, Azure)
  • Knowledge of SQL and NoSQL databases
  • Understanding of data warehousing concept
  • Knowledge of machine learning and AI concepts
  • Experience with data visualization tools (Looker, PowerBI, Tableau)

Additional Information

Open for Malaysian citizens only.
Please be reminded that only online applications will be entertained.
Applications should reach us by 28 January 2025.
Only the shortlisted will be notified.