Senior Azure Data Engineer

Company Description

Bilwaa Technologies Pvt Ltd is an IT service-based organization in India, with over 20 years of IT experience in various domains including Banking, Healthcare, eCommerce, and Telecom.

Work Location: Remote/Work from Home.

Please provide me below details along with your updated resume As soon as possible.

1) Current CTC:

2) Expected CTC:

3) Notice Period: (how soon can you join )

Role Description

As a Senior Azure Data Engineer, you will be responsible for designing, implementing, and managing complex

data solutions using Microsoft Azure technologies. You will work closely with data scientists, analysts, and

business stakeholders to ensure the efficient and secure handling of data, while optimizing data pipelines and

contributing to data architecture decisions.

Key Responsibilities:

 Data Architecture and Design:

o Implement robust, scalable, and efficient data pipelines and architectures.

o Develop and maintain data models and data flow diagrams.

o Ensure data solutions align with business requirements and industry best practices.

 Data Integration and ETL:

o Develop and manage ETL processes using Databricks workflows, Azure Data Factory and other

relevant tools.

o Integrate data from various sources such as on-premises databases, cloud platforms, and

third-party APIs.

o Optimize data ingestion and transformation processes for performance and reliability.

 Data Storage and Management:

o Implement data storage solutions using Azure Data Lake, Azure Blob Storage, Azure SQL

Database, Synapse etc.

o Ensure data is stored securely, with appropriate access controls and compliance with relevant

regulations.

o Implement data retention and archival strategies.

 Data Quality and Governance:

o Establish and enforce data quality standards and best practices.

o Implement data governance frameworks to ensure data accuracy, consistency, and security.

o Monitor data pipelines for errors and performance issues, and implement corrective actions as

needed.

 Collaboration and Communication:

o Collaborate with data scientists, analysts, and business stakeholders to understand data needs and

requirements.

o Provide technical guidance and mentorship to junior data engineers and team members.

o Document data engineering processes, architectures, and standards.

 Continuous Improvement:

o Stay updated with the latest Azure data technologies and industry trends.

o Continuously evaluate and improve existing data solutions for performance, scalability, and

cost-effectiveness.

o Participate in code reviews, testing, and deployment processes to ensure high-quality deliverables.

Required skills:

 Solid understanding of data modeling, ETL processes, and data warehousing concepts.

 Experience with big data technologies (e.g. Spark).

 Experience with programming languages such as Pyspark, and Python.

 Excellent problem-solving skills and the ability to work independently and in a team environment.

 Strong communication skills, with the ability to convey technical concepts to non-technical stakeholders.

Good to have skills:

 Azure Data Engineering and/or Databricks Data Engineering certifications.

 Deep understanding of Azure data services including integration and authentication methods.

 Experience with DevOps practices and tools (e.g., CI/CD pipelines, Azure DevOps, Jenkins).

 Strong experience with SQL and NoSQL databases, including performance tuning and optimization.

 Experience with code quality methods (static code analysis, dynamic code analysis); static code analysis

tools (ex. SonarQube, Black) and automated testing frameworks (ex. pytest); integrating quality assurance

with CI/CD.

Thanks & Regards

Murali N

Sr. Hiring Manager

hidden_email,