Data Engineering Lead

We are seeking a highly motivated and experienced Data Engineering Lead to join our young team. The ideal candidate will possess a deep understanding of data engineering principles, a proven track record of leading data engineering initiatives, the ability to drive the development and implementation of robust data infrastructure and an understanding of the BFSI domain. As a Data Engineering Lead, you will be responsible for managing a team of data engineers, designing and optimizing data systems and architectures, and ensuring the efficient flow of data across various systems.

Key Responsibilities:

Leadership and Team Management:

Lead, mentor, and manage a team of data engineers.

Foster a collaborative and innovative team culture.

Provide technical guidance, support, and training to team members.

Bring structure and process in a unstructured, start-up mode workplace.

Data Infrastructure Design and Optimization:

Design and implement scalable and efficient data. architectures.

Optimize existing data infrastructure to improve performance and reliability.

Stay abreast of industry best practices and emerging technologies in data engineering.

Data Pipeline Development:

Oversee the development of end-to-end data pipelines for ingesting, processing, and storing large volumes of data.

Ensure data pipelines are robust, scalable, and maintainable.

Collaborate with cross-functional teams to understand data requirements and implement solutions.

Data Governance and Quality:

Implement and enforce data governance policies and best practices.

Ensure the integrity and accuracy of data.

Establish and maintain documentation for data processes and pipelines.

Collaboration with Stakeholders:

Collaborate with data analysts and, business anlaysts and other business stakeholders to understand data needs and deliver solutions.

Work closely with IT and software development teams to integrate data solutions into business applications.

Performance Monitoring and Optimization:

Monitor data system performance and implement optimizations as needed.

Troubleshoot and resolve issues related to data processing and storage.

Implement proactive monitoring and alerting for data systems.

Qualifications:

Bachelor's or Masters degree in Computer Science, Information Systems, or a related field.

Proven experience in a leadership role within data engineering.

Experience in BFSI vertical

Strong proficiency in programming languages such as Python

Experience with big data technologies and cloud platforms

In-depth knowledge of database technologies (e.g., SQL, NoSQL) and data warehousing solutions.

Excellent problem-solving and communication skills.

If you are a hands-on technical leader, and have a passion for building scalable and reliable data solutions, have an understanding of the BFSI domain we encourage you to apply. Join us in driving innovation through data engineering excellence,