Senior Consultant - Business Consulting PI - National - CNS - BC - Finance - Chennai

Job Title: Data engineer

JD -

• Develop, maintain, and optimize data pipelines and workflows using SQL, S3, AWS Glue, AWS Lambda, Pyspark, and AWS SageMaker-Machine Learning platform.
• Exposure to Gen AI models.
• SQL proficiency, including CTE (Common Table Expressions) and tuning SQL queries for performance. (Snowflake-preferred)
• Ensure seamless data integration with databases like Aurora DB, Dynamo DB, Redshift.
• Implement CI/CD pipelines and scheduling tools like Stonebranch to streamline data operations.
• Perform data profiling, data analysis, and present actionable insights to stakeholders.
• Apply Data Warehousing and Data Modeling concepts, including 3NF, Star, and Snowflake schemas to ensure scalable data architecture.
• Leverage AWS SageMaker for machine learning model deployment and management in production environments.
• Collaborate with cross-functional teams to ensure adherence to development best practices, including peer reviews, unit testing, and process optimization.

Experience:

Good understanding of IT Project Lifecycles.

Experience with Data Profiling and Data Analysis tasks, presenting data insights to the business.