EY - GDS Consulting - AI And DATA - Databricks Administrator - Gig

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

EY GDS – Data and Analytics (D&A) – Gig- Databricks Administrator

As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in sectors like Banking, Insurance, Manufacturing, Government Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance.

The opportunity

Design, provision, and operate Azure Databricks workspaces; enforce security, cost, and performance policies; and serve as the escalation point for data engineering and ML teams. Success in this position means delivering a reliable, well-governed platform that accelerates product teams while meeting enterprise compliance obligations.

Your key responsibilities

• Platform Administration & Governance – Create and manage clusters, cluster policies, and pools; schedule DBR upgrades; configure VNet-injected workspaces, SCIM user/group provisioning, and secret scopes; monitor jobs, audit logs, and system tables for health & cost anomalies.
• Unity Catalog Stewardship – Stand up metastores, catalogs, and schemas; implement object ownership, row/column security, data lineage, and privilege delegation.
• ETL & Delta Live Tables Support – Partner with data engineers to build and optimize Spark/Delta pipelines, streaming jobs, and orchestration in Databricks Workflows.
• Security & Data Privacy – Integrate AAD SSO, network security controls
• Automation & IaC – Implement Terraform/Databricks Terraform provider, Databricks CLI, and CI/CD pipelines for workspace and Unity Catalog objects.
• Cost Optimisation & Observability – Tag resources, set auto-termination, right-size clusters
• Documentation & Knowledge Transfer – Maintain runbooks, SLA playbooks, and deliver platform onboarding sessions.

Skills and attributes for success

• Databricks Platform Administrator Accreditation
• Databricks Certified Data Engineer Professional
• Databricks Lakehouse Fundamentals Accreditation
• Microsoft Azure Administrator Associate (AZ-104)
• (Preferred) Microsoft Azure Data Engineer Associate (DP-203) or successor certification

Nice-to-Have

• Immuta implementation or comparable data-privacy platform experience.

To qualify for the role, you must:

• 5+ yrs administering cloud big-data platforms, 2+ yrs Azure Databricks
• Proven track record supporting Spark ETL and ML workloads at scale.
• Deep knowledge of Apache Spark 3.x, Delta Lake, Databricks REST API
• Azure core services (ADLS Gen2, Key Vault, VNets)
• Scripting/IaC: Python, PowerShell/Bash, Terraform.
• Hands-on Unity Catalog privilege model, lineage, and audit tables.
• Excellent incident-management, documentation, and stakeholder-communication skills.

What working at EY offers

At EY, we’re dedicated to helping our clients, from start–ups to Fortune 500 companies — and the work we do with them is as varied as they are.

You get to work with inspiring and meaningful projects. Our focus is education and coaching alongside practical experience to ensure your personal development. We value our employees and you will be able to control your own development with an individual progression plan. You will quickly grow into a responsible role with challenging and stimulating assignments. Moreover, you will be part of an interdisciplinary environment that emphasizes high quality and knowledge exchange. Plus, we offer:

• Support, coaching and feedback from some of the most engaging colleagues around
• Opportunities to develop new skills and progress your career
• The freedom and flexibility to handle your role in a way that’s right for you

EY | Building a better working world 

 
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  

 
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  

 
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.