TC - Data Engineer Databricks - Senior

Job Description for Senior Consultant - Data Engineer (Databricks)

EY GDS – Data and Analytics (D&A) – Data Engineer (Databricks) - Senior Consultant

Your Key Responsibilities:

• Design, Implement and manage Databricks environments across various cloud platforms.
• Design and execute ETL processes, ensuring efficient data flow into cloud-based services.
• Collaborate with global teams to understand business objectives and deliver solutions.
• Optimize data models and algorithms for improved performance and scalability.

Skills and Attributes for Success:

• Demonstrated expertise in Databricks for big data solutions with 3+ years of relevant experience.
• Proven experience (3+ years) in building data pipelines, data ingestion, and analytical frameworks for various database systems.
• Proficient in data migration and processing using cloud-based services.
• Skilled in Python or PySpark for data manipulation and analysis.
• Solid understanding and practical experience with data warehousing tools.
• Knowledgeable in DevOps practices, including CI/CD for streamlined deployments.
• Expertise in SQL, including advanced procedural SQL.
• Strong problem-solving abilities with a focus on delivering high-quality technical solutions.

To Qualify for the Role, You Must Have:

• A degree in Computer Science or a related field with 3+ years of relevant industry experience.
• Primary skills: 3+ years of hands-on experience with Databricks on any major cloud platform.
• Secondary skills: Proficiency in Python and experience with at least one ETL tool.
• Prior experience in Power & Utilities, Oil & Gas, or Manufacturing domains preferred
• Databricks Data Engineer certification is preferred
• Experience with Agile methodologies is preferred.
• Self-motivated with a proactive approach to problem-solving.
• Ability to analyse complex technical issues and provide effective solutions.
• Commitment to software development best practices.
• Proficient in debugging and optimizing enterprise-level applications.
• Capable of translating business challenges into robust technical solutions.
• Excellent communication skills, both written and verbal.
• Experience in managing client relationships and understanding client needs.