Senior Associate L2 Data Engineering

Experience Guidelines:
Mandatory Experience and Competencies: 
Competency

Overall, 5+ years of IT experience with 3+ years in data-related technologies
Minimum 2.5 years of experience in Big Data technologies and working exposure on atleast one cloud platform on related data services (AWS, Azure / GCP)


Hands-on experience with the Hadoop stack: HDFS, sqoop, kafka, pulser, NiFi, Spark Streaming, Flink, Storm, hive, oozie, airflow, and other components required in building an end-to-end data pipeline.


Strong experience in at least one of the programming languages: Java, Scala, Python. Java preferable


Hands-on working knowledge of NoSQL and MPP data platforms like Hbase, MongoDB, Cassandra, AWS Redshift, Azure SQLDW, GCP BigQuery, etc


Well-versed and working knowledge with data platform-related services on at least

 
Preferred Experience and Knowledge (Good to Have): 
 

1. Good knowledge of traditional ETL tools (Informatica, Talend, etc) and database technologies (Oracle, MySQL, SQL Server, Postgres) with hands-on experience
Knowledge on data governance processes (security, lineage, catalog) and tools like Collibra, Alation, etc


Knowledge on distributed messaging frameworks like ActiveMQ, RabbiMQ, Solace, search & indexing, and microservice architectures


Performance tuning and optimization of data pipelines.
CI/CD infrastructure provisioning on cloud, auto-build & deployment pipelines, code quality
Cloud data specialty and other related Big data technology certifications

Thanks.