Data Engineer (Python, Spark and SQL)- Associate Sr.

Job Summary:

We are seeking a talented senior data engineer to join our team and play a key role in designing, developing, and maintaining data solutions on the cloud platform(AWS and Snowflake). You will leverage your expertise in Snowflake, Python, SQL, Spark, Tableau and cloud technologies to build efficient and scalable data pipelines and applications. This role requires a strong understanding of data warehousing concepts, data modeling, and best practices for building secure and performant data solutions.

Job Responsibilities
 Design, develop, test, deploy, and maintain data pipelines on python ecosystem.
 Connect with US stakeholders to understand requirement and create project plans
 Desing end to end solutions for the projects with documentation
 Experience in JIRA , confluence , Kanban and data modeling tools.
 Write, optimize, and troubleshoot complex Snowpark and SQL code.
 Integrate Snowflake with various data sources and third-party tools (e.g., Alteryx, Airflow)
 Utilize AWS services like S3 for data storage and Lambda for serverless functions
 Design and implement data models for efficient data storage and retrieval
 Ensure data security and compliance with industry standards
 Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and deliver solutions
 Guide junior developers in various projects.
 Basic understanding and development of tableau dashboard.

Required Skills, Qualification and Capabilities:
 Experience w.r.t. Data architecture, Implementation of large scale Enterprise-level Data Lake/Data Warehousing, Big Data and Analytics applications.
 Professional with a background in Data and Analytics, should have led multiple engagements in Data & Analytics in terms of solutioning, architecture and delivery.
 Should have excellent client interaction and presentation skills
 Expertise in SQL, Python, and Spark
 Experience with cloud technologies like AWS S3 and Lambda
 Experience with data integration tools like Alteryx or Airflow
 Excellent problem-solving and analytical skills
 Ability to work independently and as part of a team
 Banking domain knowledge is a plus,