EY - GDS Consulting - AI And DATA - Databricks Architect - Gig

EY GDS – Data and Analytics - D and A –Gig- Databricks Architect

As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance.

The opportunity

We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.

Education/Qualification: Bachelor’s degree in Computer Science or related field, or equivalent education and experience

Requirements

• 8+ years of proven enterprise Data Architecture experience with expertise in designing and building data platforms and solutions in Azure Databricks and pyspark
• Extensive hands-on experience in Azure Databricks fundamentals/architecture, including setting up and optimizing Azure Databricks clusters and modules (Data Engineering and SQL warehouse).
• Experience building solutions for migrations, batches, and real-time ingestions.
• Strong experience architecting big data solutions using Data Lakes, Data Warehouses, and Data Products.
• Design, develop, and maintain custom connectors or utilize existing frameworks to integrate Databricks with Collibra for metadata ingestion, lineage propagation, and data quality rule mapping.

Job Summary:

• Collaborate with key stakeholders in an Agile environment to understand advanced data requirements and develop technology target states and roadmaps that align with short and long-term business goals.
• Define and implement best practices for data quality, data governance, and data security within Azure Databricks architecture.
• Provide knowledge on advanced concepts such as medallion architecture, DLT, unity catalog within Azure Databricks
• Lead and participate in code reviews, documentation, and knowledge-sharing sessions related to Azure Databricks
• Lead and mentor junior resources
• Support business development efforts (proposals and client presentations)
• Identify opportunities to add value to the client's organization by effective use of information management
• Build relationships with key stakeholders responsible for information and performance management in client's organization

Skills:

• Databricks
• Pyspark
• Collibra
• Data Modelling

Ideally, you’ll also have

• Client management skills

What we look for

• Minimum 7 years of experience as Architect on Analytics solutions and around 5 years of experience with Azure Databricks / Pyspark and Collibra
• People with technical experience and enthusiasm to learn new things in this fast-moving environment

What working at EY offers

At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.

You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:

• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you