Lead Data Engineer - AWS/Azure

Roles & Responsibilities

Key Responsibilities

• Develop & deploy snowflake DW in a cloud environment on AWS or Azure
• Source System Analysis, Data Modelling, ETL development, and deployment to Cloud Service
• Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams
• Contribute towards Snowflake competency building initiatives outside your project.

Key Requirements

• 3 to 7 years of Hands-on experience in the field of data warehousing, ETL
• Hands on development experience in Snowflake.
• Experience in Snowflake modelling - roles, schema, databases.
• Experience in Integrating with third-party tools, ETL, DBT tools
• Experience in Snowflake advanced concepts like setting up resource monitors and performance tuning would be preferable
• Strong programming knowledge in SQL
• Applying object-oriented and functional programming styles to real-world problems using Scala/Python
• Strong knowledge in implementing Snowflake core features such as Cloning, Sharing, Streams, Tasks
  and Pipes.
• Develop data pipelines to perform batch and Real - Time/Stream analytics on structured and
  unstructured data.
• Basic understanding of AWS S3, Lambda, EMR, Glue
• Good understanding of different file format (ORC, Parquet, AVRO) to optimize queries/processing and compression techniques
• Familiar with DevOps. Preferable – having deployment knowledge
• Have working experience in an Agile base delivery methodology (Preferable)
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution.
• Good analytical skills and enjoys solving complex technical problems
• Proficiency in Software Development Best Practices
• Good debugging and optimization skills
• Good communicator (written and verbal formal and informal).