EY - GDS Consulting - AI and DATA - Azure DBX - Senior
Job description
At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all.
EY GDS – Data and Analytics (D&A) – Azure Databricks - Senior
We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.
Data Engineering Lead manages the daily activities of the team responsible for the design, implementation, maintenance, and support of data warehouse systems and related data marts. Oversees data design and the creation of data pipelines to transform raw data into curated datasets.. Effectively collaborates with other members of the team, customers and/or stakeholders to align work efforts, develop/execute strategic and tactical plans that enable successful business operations. Ensures accurate accounting of and appropriate deployment of resources. Effectively manages multiple initiatives by prioritizing, organizing and tracking to meet the deadlines. Provides guidance regarding the use of data warehouse systems, capability of systems to deliver information, and subject matter expertise regarding current systems and emerging technology. Lead team of Data Engineers both onshore and offshore resources. The position will take a leadership role in implementing architecturally coherent solutions to address the information needs.
Responsibilities
- Leads the activities of data warehouse project teams in the design, development and implementation of data pipelines; and the configuration and auditing of data pipelines to ensure quality control of data.
- Architectural understanding of data movement techniques including streaming, messaging, replication, and real time data transfer
- Understanding of backend infrastructure and network architectures
- Knowledge of security approaches and tools for data storage, movement and access
- Perform Data Acquisition requirements/information gathering and design cost-effective data acquisition patterns
- Provides guidance regarding the use of data engineering tools, capability of tools to deliver information, and subject matter expertise regarding current systems and emerging technology.
- Lead governance and enforcement of data pipeline patterns and standards
- Analyze and recommend changes to increase productivity level of developers in working environment.
- Understanding user needs as well as understanding the technical requirements and limitations when building platform services.
- Managing cross dependencies across teams to ensure alignment, as well as adjusting team directions when gaps exist
- Setting a strategy vision for various platform components and related services to increase adoption and deliver business results
- Defines and promotes best practices and design principles for data engineering pipelines development techniques and architecture independently and in partnership with other members of the data team leadership
- Develops and proposes options with pros/cons and risk, and works with stakeholders to finalize the best solution that meets business needs.
- Establishes credibility with partners while managing expectations. Ensures frequent, continuous and effective communications with team members, within IT, and with stakeholders to set expectations and negotiate priorities appropriately, via both formal and informal channels / mechanisms.
- Understand the underlying technologies and applications utilized within specified area of responsibility to direct how to design, develop, test, and implement requirements.
Qualifications:
- Deep understanding
- Strong experience with Azure Data Factory, Azure Databricks,, and other Azure data services.
- Experience working in Snowflake is good to have
- Strong SQL skills
- 5 years management experience of onshore, offshore and indirect reports
- 3-7 years data warehouse and data engineering experience
EY | Building a better working world
EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.
Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.
Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.