Your new role:
As a Big Data Engineer, you will be instrumental in creating and maintaining data pipelines, data analysis, and data governance that are fast and reliable. Your main duty will be to facilitate seamless data flow into the data lake or data warehouse, allowing Data Scientists, Analysts, and other users to access and analyze the data. You will leverage various AWS services such as MSK/Kafka, S3, EMR or Glue, Lakeformation, Athena, QuickSight, and handle data ingestion from various databases such as MS SQL, MySQL, Oracle, and PostgreSQL.
What to expect:
Data Pipeline Build:
-Work with Data Engineers to create, execute, and improve data pipelines.
-Make sure data ingestion processes are fast and reliable from various sources into the data lake or data warehouse.
-Perform data validation and quality checks to ensure data consistency throughout the pipeline.
Data Analysis Support:
-Help Data Scientists and Analysts with their regular analytical work by giving them data access and query support.
-Enhance data storage and retrieval mechanisms to improve performance and efficiency.
-Work with stakeholders to find and implement solutions for data analysis and reporting needs.
Data Governance and Security:
-Use AWS Lakeformation and other appropriate tools to set up and enforce data governance policies.
-Apply security measures and access controls to safeguard sensitive data.
-Work with stakeholders to comply with data privacy regulations.
What you'll get in return
-Excellent remuneration package and benefits
-Flexible work culture
-Long term career opportunities
What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV. If this job isn't quite right for you but you are looking for a new position, please contact Li Ann at 03-7890-6301 or email to liann.mah@hays.com.my for a confidential discussion on your career.
Telephone: +60378906301