Senior Consultant - Data Engineer-Mumbai

Job Summary: We are seeking a skilled Data Engineer with 3-5 years of experience to join our data team. The ideal candidate will bring expertise in AWS, PySpark, SQL, Python, and have a strong background in campaign and marketing analytics. As a Data Engineer in our organization, you will play a crucial role in developing and enhancing data systems that provide deep insights into customer behaviors and the effectiveness of marketing campaigns, ultimately driving strategic business decisions.

Must have- Tech stack-  AWS, EMR , PYSPARK, SQL, Airflow, CICD, Kafka.

Key Responsibilities:

• Design, construct, and maintain data architectures and pipelines that support campaign and marketing analytics.
• Utilize AWS cloud services (Redshift, EMR, RDS, Glue, Athena, S3) to build scalable and reliable data storage and processing solutions.
• Create and fine-tune PySpark jobs for big data transformations and aggregations necessary for marketing analysis.
• Write complex SQL queries to analyze campaign performance, customer segmentation, and ROI.
• Create pipelines for campaigns that needs to be triggered on daily basis in real time for eligible customers.
• Would add new logics as per the campaign’s requirement and new customer bases to this pipeline.
• Collaborate with Campaign managers and various bank businesses i.e. (Debit Card, Wealth and Insurance etc.) to understand the requirement every week.
• Develop data sets and pipelines that enable real-time analysis of marketing campaigns.
• Collaborate with marketing teams to understand their data needs and provide insights through advanced analytical models.
• Integrate various data sources to deliver a comprehensive view of customer interactions across channels.
• Implement tracking and measurement solutions for online and offline campaigns.
• Contribute to the improvement of data quality and the enrichment of data sources for accuracy in reporting and analysis.
• Work on predictive modelling of customer behaviour and campaign outcomes using Python.
• Develop dashboards and visualizations in reporting tools to communicate actionable insights to the marketing team.
• Drive data governance and compliance initiatives related to marketing data.
• Stay updated with the latest trends in marketing analytics, campaign management tools, and data processing technologies.

Qualifications and Skills:

• Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field.
• 3-5 years of hands-on experience in a Data Engineering role with a focus on marketing analytics.
• Proficiency in Python and PySpark for data processing and analysis.
• Strong knowledge of SQL and experience with cloud-based data warehousing solutions, especially in an AWS environment.
• Demonstrated experience with end-to-end architecture and pipeline creation for marketing and campaign data.
• Familiarity with campaign management platforms, web analytics, SEO/SEM, and social media analytics.
• Experience with data visualization and BI tools (e.g., Tableau, Power BI, Looker).
• Ability to translate business requirements into technical specifications and data solutions.
• Excellent communication and teamwork abilities.