Senior Consultant - Data Engineer-Mumbai
EY
Data Science
Mumbai, Maharashtra, India
Posted on Thursday, May 2, 2024
Job Summary: We are seeking a skilled Data Engineer with 3-5 years of experience to join our data team. The ideal candidate will bring expertise in AWS, PySpark, SQL, Python, and have a strong background in campaign and marketing analytics. As a Data Engineer in our organization, you will play a crucial role in developing and enhancing data systems that provide deep insights into customer behaviors and the effectiveness of marketing campaigns, ultimately driving strategic business decisions.
Must have- Tech stack- AWS, EMR , PYSPARK, SQL, Airflow, CICD, Kafka.
Key Responsibilities:
- Design, construct, and maintain data architectures and pipelines that support campaign and marketing analytics.
- Utilize AWS cloud services (Redshift, EMR, RDS, Glue, Athena, S3) to build scalable and reliable data storage and processing solutions.
- Create and fine-tune PySpark jobs for big data transformations and aggregations necessary for marketing analysis.
- Write complex SQL queries to analyze campaign performance, customer segmentation, and ROI.
- Create pipelines for campaigns that needs to be triggered on daily basis in real time for eligible customers.
- Would add new logics as per the campaign’s requirement and new customer bases to this pipeline.
- Collaborate with Campaign managers and various bank businesses i.e. (Debit Card, Wealth and Insurance etc.) to understand the requirement every week.
- Develop data sets and pipelines that enable real-time analysis of marketing campaigns.
- Collaborate with marketing teams to understand their data needs and provide insights through advanced analytical models.
- Integrate various data sources to deliver a comprehensive view of customer interactions across channels.
- Implement tracking and measurement solutions for online and offline campaigns.
- Contribute to the improvement of data quality and the enrichment of data sources for accuracy in reporting and analysis.
- Work on predictive modelling of customer behaviour and campaign outcomes using Python.
- Develop dashboards and visualizations in reporting tools to communicate actionable insights to the marketing team.
- Drive data governance and compliance initiatives related to marketing data.
- Stay updated with the latest trends in marketing analytics, campaign management tools, and data processing technologies.
Qualifications and Skills:
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field.
- 3-5 years of hands-on experience in a Data Engineering role with a focus on marketing analytics.
- Proficiency in Python and PySpark for data processing and analysis.
- Strong knowledge of SQL and experience with cloud-based data warehousing solutions, especially in an AWS environment.
- Demonstrated experience with end-to-end architecture and pipeline creation for marketing and campaign data.
- Familiarity with campaign management platforms, web analytics, SEO/SEM, and social media analytics.
- Experience with data visualization and BI tools (e.g., Tableau, Power BI, Looker).
- Ability to translate business requirements into technical specifications and data solutions.
- Excellent communication and teamwork abilities.