DE-Multi Cloud Data Platform Engineer-GDSN02

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. 

The opportunity

Your role will be a Technology Lead or Senior Technology Lead in the Cloud Data Engineering team. You will be responsible for designing and delivering scalable data platforms across Azure and GCP for global clients. 

Your role will be a Technology Lead, or Senior Technology Lead in the Cloud Engineering team. You will be responsible to be a part of the delivery of IT projects for our customers across the globe.

Your key responsibilities

• Architect and manage scalable, secure, and cost-effective data platforms on Azure and GCP, supporting analytics and data processing workloads.
• Establish and enforce data governance frameworks including access control, data lineage, and compliance across cloud and hybrid environments.
• Design and implement DataOps and MLOps pipelines for automated data ingestion, transformation, model training, deployment, and monitoring.
• Automate infrastructure provisioning using Infrastructure as Code (Terraform, ARM Templates, Bicep) for data platforms, compute, storage, and supporting services.
• Integrate data platforms and pipelines with enterprise CI/CD frameworks (Azure DevOps, GitHub Actions, Jenkins) to enable end-to-end lifecycle management for code, data, and models.
• Implement monitoring, logging, and alerting for data workloads using native cloud services (Azure Monitor, GCP Cloud Monitoring) and third-party tools (Datadog, Prometheus, Grafana).
• Optimize data processing workloads and platform performance including autoscaling, resource utilization, and cost efficiency.
• Ensure security best practices by managing identity and access (IAM), secrets, network isolation, encryption, and compliance with organizational and regulatory standards.
• Collaborate with data engineering, analytics, and machine learning teams to enable seamless data integration, processing, and workflow automation.
• Drive adoption of DevSecOps practices, integrating security scanning, compliance validation, and governance into data and ML pipelines.
• Lead incident management, troubleshooting, and root cause analysis for data platform issues to ensure high availability and reliability.
• Document architecture designs, processes, standards, and best practices for operational excellence and knowledge sharing.
• Design and manage modern data architectures including data lakes, data warehouses, streaming platforms, and analytics services across Azure and GCP.
• Build and maintain data pipelines for batch and real-time ingestion, transformation, and analytics workloads using cloud-native services.
• Implement data governance and metadata management solutions using tools such as Azure Purview and GCP Dataplex (or equivalent).
• Develop and maintain CI/CD workflows for data and ML pipelines, ensuring versioning, testing, and controlled deployments.
• Implement cost optimization strategies across storage, compute, and data processing layers.
• Ensure secure, scalable, and resilient data platform design, aligning with enterprise architecture and compliance requirements.

Skills and attributes for success

• Expertise in data platform administration and management across Azure and GCP, including workspace/resource management, compute orchestration, and job scheduling.
• Strong knowledge of cloud platforms (Azure and GCP), including networking, identity and access management (IAM), and cost optimization strategies.
• Proficiency in Infrastructure as Code (Terraform, ARM Templates, Bicep) and automation scripting using Python, Bash, and PowerShell.
• Experience with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins) and version control systems (Git) for managing code, data pipelines, and deployments.
• Strong understanding of DataOps and MLOps concepts, including pipeline orchestration, versioning, monitoring, and lifecycle management.
• Familiarity with data governance tools and frameworks (e.g., Azure Purview, GCP Dataplex, or equivalent) for managing metadata, lineage, and compliance.
• Ability to design secure, scalable, and compliant data architectures across multi-cloud environments (Azure & GCP).
• Strong troubleshooting and performance optimization skills for distributed data processing and analytics workloads.
• Excellent communication, stakeholder management, and leadership skills, with the ability to collaborate across cross-functional teams and drive platform adoption.
• Experience with monitoring and observability tools (Azure Monitor, GCP Cloud Monitoring, Datadog, Prometheus, Grafana).
• Knowledge of DevSecOps practices, including integrating security controls, vulnerability scanning, and compliance checks into data pipelines.
• Ability to mentor and upskill teams on data engineering, DataOps, and MLOps best practices.
• Strong analytical and problem-solving skills, with the ability to assess risks and define mitigation strategies.
• Experience with regulatory compliance standards (e.g., GDPR, HIPAA) in cloud data environments is an added advantage.
• Capability to evaluate tools, platforms, and solutions for data platform requirements, including participation in RFPs, vendor evaluation, and solution selection.
• Ability to design and develop modern cloud-native data platform frameworks, incorporating automation, DevOps, and AI/ML capabilities.

To qualify for the role, you must have

• BE/B.Tech/MCA with a sound industry experience of 4 to 8 years
• BE/B.Tech/MCA with 4–7 years of relevant industry experience in cloud and data platform engineering.
• Strong knowledge of cloud computing in multi-cloud environments (Azure and GCP).
• Hands-on experience in data platform implementation and administration across Azure and/or GCP, including management of compute, storage, and data processing services.
• Experience in DevOps practices, including setting up CI/CD pipelines using tools such as Azure DevOps, GitHub Actions, or GitLab CI.
• Strong understanding of DataOps and MLOps practices, including pipeline orchestration, monitoring, governance, and lifecycle management.
• Hands-on experience with containerization and orchestration technologies, including Docker and Kubernetes (AKS/GKE).
• Proficiency in scripting and automation using PowerShell, Python, Groovy, Shell scripting, and cloud-native CLI tools.
• Strong experience in Infrastructure as Code (IaC) tools such as Terraform, ARM Templates, or Bicep for automating cloud deployments.
• Experience with configuration management tools such as Ansible, Chef or Puppet for infrastructure and platform automation.

Your people responsibilities

• Foster teamwork and lead by example
• Participating in the organization-wide people initiatives
• Ability to travel in accordance with client and other job requirements
• Excellent written and oral communication skills; writing, publishing, and conference-level presentation skills a plus

Technologies and Tools

• Cloud platform – Azure,AWS
• Cloud Platforms – Microsoft Azure, Google Cloud Platform (GCP)
• SDLC Methodologies – Agile / Scrum
• Version Control Systems – GitHub / Bitbucket / GitLab
• CI/CD & Automation Tools – Azure DevOps / GitHub Actions / Jenkins / Harness / similar enterprise CI/CD platforms
• Container & Orchestration Tools – Docker / Kubernetes (AKS / GKE)
• Application Performance Monitoring (APM) – Prometheus / Dynatrace / AppDynamics / cloud-native monitoring tools
• Monitoring & Observability Tools – Azure Monitor / GCP Cloud Monitoring / Splunk / Datadog / Grafana
• Infrastructure as Code (IaC) – Terraform / ARM Templates / Bicep
• Configuration Management Tools – Ansible / Chef / Puppet
• Test Automation Tools – Selenium / Cucumber or equivalent automation frameworks
• Artifact Management Tools – JFrog Artifactory / Nexus / Cloud-native artifact repositories
• Scripting & Automation – Python / Groovy / PowerShell / Shell scripting / cloud-native CLI tools
• Security Testing (SAST/DAST) – SonarQube / Veracode / Fortify or equivalent security tools
• GitOps Tools – Argo CD / Flux CD or similar deployment automation tools
• AI / GenAI Technologies – AI-assisted development tools (e.g., GitHub Copilot, OpenAI, or equivalent platforms)

What we look for

• Has successfully demonstrated CI/CD Automation skills and technologies during many relevant projects
• Demonstrated experience in implementing CI/CD pipelines and automation frameworks across multiple projects for data and application workloads.
• Strong experience working with DevOps and cloud-native tools, including containerization and orchestration technologies.
• Proven expertise in infrastructure automation using Infrastructure as Code (IaC) and configuration management tools, along with application and data pipeline automation using enterprise CI/CD platforms.
• Hands-on experience with Azure and/or GCP, with a strong understanding of cloud architecture principles and solution design strategies.
• Good exposure to cloud monitoring, logging, and observability, including troubleshooting of distributed systems and containerized workloads.
• Strong understanding of cloud computing concepts, services, and best practices, with the ability to apply them effectively in real-world data platform scenarios.
• Experience in evaluating, researching, and adopting emerging technologies, including conducting experiments and proof-of-concepts for modern data and cloud solutions.

What we offer

EY Global Delivery Services (GDS) is a dynamic and truly global delivery network. We work across six locations – Argentina, China, India, the Philippines, Poland, and the UK – and with teams from all EY service lines, geographies, and sectors, playing a vital role in the delivery of the EY growth strategy. From accountants to coders to advisory consultants, we offer a wide variety of fulfilling career opportunities that span all business disciplines. In GDS, you will collaborate with EY teams on exciting projects and work with well-known brands from across the globe. We’ll introduce you to an ever-expanding ecosystem of people, learning, skills, and insights that will stay with you throughout your career.

• Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
• Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
• Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
• Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.

EY | Building a better working world 

 
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.  

 
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.  

 
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.