Senior Data Engineer

What would a typical day at your work be like 

 You will lead and manage the delivery of projects and be responsible for the delivery of project and team goals.

 Build & support data ingestion and processing pipelines. This will entail extract, load and transform of data from a wide variety of sources using latest data frameworks and technologies.

 Design, build, test, and maintain machine learning infrastructure and frameworks to empower data scientists to rapidly iterate on model development.

 Own and lead client engagement and communication on technical projects. Define project scopes and track project progress and delivery.

 Plan and execute project architecture and allocate work to team.

 Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume.

 Partner with software engineering teams to drive completion ofmulti-functional projects.

What Do We Expect 

 Minimum 4 years of overall experience in data engineering and 2+ years leading a team as team lead and doing project management.

 Experience working with a global team and remote clients.

 Hands on experience in building data pipelines on various infrastructures.

 Knowledge of statistical and machine learning techniques. Hands on experience in integrating machine learning in data pipelines.

 Ability to work hands-on with the data engineers in the team in design and development of the solution using the relevant big data technologies and data warehouse concepts Strong knowledge of advanced SQL, data warehousing concepts, DataMart designing.

 Have strong experience in modern data platform components such as Spark, Python, etc.

 Experience with setting up and maintaining Data warehouse (Google BigQuery, Redshift, Snowflake) and Data Lakes (GCS, AWS S3 etc.) for an organization.

 Experience in building data pipeline with AWS Glue, Azure Data Factory and Google Dataflow.

 Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.

 Strong problem solving and communication skills,