Data Technical Architect (Principal) with skills Data Architecture, ETL, Data Architecture, databricks, Pyspark for location Bangalore, India
ROLES & RESPONSIBILITIES
· Lead the architectural design for migration project, leveraging Azure services, SQL, Databricks, and PySpark to create scalable, efficient, and reliable solutions.
· Utilize Databricks to design and implement advanced data transformation and processing tasks using Databricks, PySpark and ADF
· Design, deploy, and manage Databricks clusters for data processing, ensuring performance and cost efficiency, and troubleshoot cluster performance issues as needed.
· Mentor and guide developers on the use of PySpark for data transformation and analysis, sharing best practices and reusable code patterns.
· Document architectural designs, migration plans, and best practices to ensure alignment and reusability within the team and across the organization.
· Collaborate with stakeholders to translate business requirements into technical specifications and design robust data pipelines, storage solutions, and transformation workflows.
· Experience with AI testing tools and methodologies
EXPERIENCE
- 16-18 Years
SKILLS
- Primary Skill: Data Architecture
- Sub Skill(s): Data Architecture
- Additional Skill(s): ETL, Data Architecture, databricks, Pyspark
ABOUT THE COMPANY
Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).
Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.