AWS Cloud Data API Engineer ( Pyspark / Databrick - Entity and Transaction APIs )

Who We Are

Artmac Soft is a technology consulting and service-oriented IT company dedicated to providing innovative technology solutions and services to customers.

Job Description

Job Title : AWS Cloud Data API Engineer ( Pyspark / Databrick - Entity and Transaction APIs )

Job Type : Full Time / Contract

Experience : 3-20 years

Location : Remote

Responsibilities
 Experience in data engineering with a focus on AWS cloud technologies.
 Proven experience in developing APIs using PySpark and Databricks.
 Strong experience with AWS services such as Lambda, S3, EMR, Glue, and Redshift.
 Proficiency in building and optimizing ETL pipelines.
 Expertise in PySpark, Databricks, and AWS cloud services.
 Strong knowledge of data structures, algorithms, and software design principles.
 Proficiency in SQL, Python, and API development.
 Experience with version control systems (e.g., Git) and CI/CD pipelines.
 Familiarity with monitoring tools like CloudWatch, Datadog, or similar.
 Experience with data governance and data security best practices.
 Familiarity with machine learning workflows and integration of ML models into data pipelines.
 Experience with real-time data processing and streaming technologies.
 Ability to work in an Agile/Scrum environment.
 Build and maintain Entity and Transaction APIs using PySpark and Databricks on AWS.
 Work closely with data architects, data scientists, and other engineers to integrate APIs into broader data solutions.
 Set up monitoring, logging, and alerting for data pipelines and APIs. Troubleshoot and resolve issues related to data integration and API performance.
 Manage and maintain AWS services such as S3, Lambda, Glue, EMR, and Redshift as part of the data processing and API ecosystem.
 Create and maintain comprehensive documentation for APIs, data pipelines, and cloud infrastructure.

Qualification
 Bachelors degree in Computer Science, Information Technology, or a related field.,