Description:
Lead Data Engineer
Sydney, Australia
$205,000 + Super
Role Overview:
As the Lead Data Engineer, you will play a crucial role in driving the migration of our data infrastructure from on-premises to the cloud, specifically in Azure. You will lead a team of skilled engineers, architecting and implementing scalable and efficient data solutions while ensuring the seamless integration of our systems with the cloud environment. This role requires a combination of technical expertise in Python/PySpark, SQL Azure Cloud, Data Bricks, as well as proven leadership and managerial skills.
Key Responsibilities:
- Lead the end-to-end migration process from on-premises to Azure cloud infrastructure.
- Architect, design, and implement scalable data solutions leveraging Python/PySpark, SQL Azure Cloud, and Data Bricks.
- Collaborate closely with cross-functional teams to gather requirements, define project scope, and drive the successful delivery of data migration projects.
- Provide technical leadership and mentorship to a team of data engineers, ensuring best practices and standards are followed throughout the migration process.
- Develop and maintain documentation related to data engineering processes, systems, and configurations.
- Stay updated on emerging technologies and industry trends to continuously improve our data engineering practices.
Requirements:
- Bachelor's degree in Computer Science, Engineering, or related field. Advanced degree preferred.
- 5-7+ years of experience in data engineering roles, with a focus on cloud migration projects.
- Proven experience with Python/PySpark, SQL Azure Cloud, and Data Bricks.
- Strong understanding of cloud-based data architectures and services, particularly within the Azure ecosystem.
- Demonstrated leadership and managerial experience, including leading teams through complex technical projects.
- Excellent communication and interpersonal skills, with the ability to effectively collaborate with cross-functional teams.
- Experience working in the insurance or financial services industry is a plus.
If you possess the relevant skills to the above, apply now with most updated CV!
17 Apr 2024;
from:
adzuna.com.au