Azure Data Engineer (Lead) with skills Data Engineering, ETL, Informatica, snowflake, synapse, databricks, snowflake, Azure Datalake, Azure Data Factory for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)
ROLES & RESPONSIBILITIES

Job Description:

We are seeking a highly skilled and experienced Snowflake Data Engineer to join our dynamic team. The ideal candidate will have between 6 to 11 years of experience in data engineering with a strong focus on building and optimizing data pipelines using Snowflake. You will play a critical role in designing, developing, and maintaining our cloud-based data warehouse, ensuring efficient data processing, and enabling advanced analytics across the organization.

Key Responsibilities:

Data Warehouse Design & Development:

Design and implement scalable, efficient, and secure data pipelines to ingest, process, and store large volumes of structured and semi-structured data in Snowflake.

Develop and maintain robust ETL/ELT processes using Snowflake features such as Streams, Tasks, and Snowpipe.

Performance Optimization:

Optimize Snowflake queries and data models for performance, ensuring low latency and high throughput.

Implement clustering keys, materialized views, and other Snowflake best practices to enhance query performance.

Data Management & Security:

Manage data access controls and security measures in Snowflake using role-based access control (RBAC).

Implement data governance policies, ensuring compliance with data privacy regulations.

Automation & Monitoring:

Automate routine data tasks using Snowflake’s automation tools and integrate them with CI/CD pipelines.

Monitor data pipeline performance and troubleshoot issues to ensure data availability and reliability.

Collaboration & Documentation:

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions.

Document data models, pipeline workflows, and best practices to ensure knowledge sharing within the team.

Continuous Improvement:

Stay updated with the latest Snowflake features and industry trends, recommending and implementing improvements to the data platform.

Participate in code reviews and mentor junior engineers, fostering a culture of continuous learning and improvement.

Key Qualifications:

Experience:

6 to 11 years of experience in data engineering, with at least 3+ years of hands-on experience working with Snowflake.

Technical Skills:

Strong expertise in Snowflake architecture, including virtual warehouses, micro-partitioning, and data sharing.

Proficiency in SQL and experience with performance tuning in Snowflake.

Experience with ETL/ELT processes and tools (e.g., dbt, Informatica, Matillion).

Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and integration of Snowflake with cloud storage services.

Knowledge of data modeling concepts and best practices.

Experience with scripting languages (e.g., Python, Shell) for automation.

Soft Skills:

Excellent problem-solving and analytical skills.

Strong communication skills, with the ability to articulate complex technical concepts to non-technical stakeholders.

Ability to work collaboratively in a fast-paced environment, managing multiple priorities.

Education:

Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.

Preferred Certifications:

Snowflake SnowPro Certification or equivalent.

Certifications in cloud platforms (e.g., AWS Certified Solutions Architect, Microsoft Certified: Azure Data Engineer).

EXPERIENCE
  • 8-11 Years
SKILLS
  • Primary Skill: Data Engineering
  • Sub Skill(s): Data Engineering
  • Additional Skill(s): ETL, Informatica, snowflake, synapse, databricks, snowflake, Azure Datalake, Azure Data Factory
ABOUT THE COMPANY

Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).

Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.

Express Application
Upload Microsoft word, PDF file upto 500KB.
Recent Jobs
Posted on October 21, 2024
QA Automation Engineer (Standard) | 3-4.5 Years | SDET - Node.js, Apache Maven, Jenkins, Automated Testing, Selenium...
Posted on October 21, 2024
QA Automation Engineer (Standard) | 3-4.5 Years | SDET - Node.js, Apache Maven, Jenkins, Automated Testing, Selenium...
Posted on October 21, 2024
AWS Data Engineer (Standard) | 4.5-6 Years | Data Engineering - Data Modeling, snowflake, SQL, AWS DBA, Fine-tuning Models
Posted on October 21, 2024
.NET Core Developer (Lead) | 11-12 Years | .NET Development - .NET Core, ASP.Net, C#, AWS-Apps, Entity Framework Core...