Databricks Data Engineer, Senior Associate, AI Data, Technology Consulting
Job description
At EY, we develop you with future-focused skills and equip you with world-class experiences. We empower you in a flexible environment, and fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams.
We work together across our full spectrum of services and skills powered by technology and AI, so that business, people and the planet can thrive together.
We’re all in, are you?
Join EY and shape your future with confidence.
About the opportunity
EY AI & Data is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors. We implement information-driven strategies, data platforms and advanced data analytics solution systems that help grow, optimize and protect client organizations. We go beyond strategy and provide end to end design, build and implementation of real-life data environments and have some of the best architects, project managers, business analysts, data scientists, big data engineers, developers and consultants in the region. We are seeking a Data Engineer with strong experience in Databricks.
Your key responsibilities
- Ability to design data pipelines with scalability, high performance and resilience in-built
- Ability to code complex requirements as part of large complex data platforms - develop, refine, and implement high quality delivery executions
- Deliver project deployments on public clouds and highly secure environments
- Integrate with data governance tools, ecosystem products across the cloud landscape
- Ability to understand the business requirements and translate into high-level and low-level designs to successfully meets the business objectives.
- Collaborate with stakeholders, presenting findings to a non-technical audience
- Bring in best practices for coding and building modular data engineering code that can be reused
- Stay current with technical and industry developments and standards to ensure effective and advanced applications of data analysis techniques and methodologies. Including AI integrations.
To qualify for the role, you must have
- Min Bachelor’s degree in Computer science, Mathematics, Engineering, Statistics, or a related field
- Databricks certifications, Azure certifications on data engineering
- At least 4 years of experience on various data platform solutions across data and analytics across the entire SDLC
- Atleast 2 years’ experience on designing and mapping requirements to technical capabilities of data pipelines on databricks across Azure, AWS or GCP cloud
- Proficiency in programming leveraging Python, Spark, Scala and other programming languages
- Understanding of end-to-end data analytics domain and insights delivery
- Excellent understanding of data modelling techniques and leading trends on data platforms including AI
- Possess strong problem-solving, analytical and strategic thinking abilities
- GCC experience will be an added advantage
- Proficiency with agile boards like JIRA, Atlassian products
Ideally, you’ll also have
- Strong hands-on knowledge and project experience in technical delivery of data platform projects across any of the – Databricks on Azure cloud, Google cloud, AWS cloud.
- Must have hands-on experience with ELT, data pipeline and orchestration tools.
- Experience in end-to-end technical project delivery following agile delivery methodologies
- Understanding of data modelling techniques and data governance tools will be an added advantage
- Experience in estimation, infrastructure sizing for data platform solutions
What we look for
Highly motivated individuals with excellent problem-solving skills and the ability to prioritize shifting workloads in a rapidly changing industry.
An effective communicator, you’ll be a confident leader equipped with strong people management skills and a genuine passion to make things happen in a dynamic organization.
What working at EY offers
EY offers a competitive remuneration package where you’ll be rewarded for your individual and team performance. We are committed to being an inclusive employer and are happy to consider flexible working arrangements. Plus, we offer:
Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.
Company description
EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.
Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.
EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.
All in to shape the future with confidence.