Professional Documents
Culture Documents
Consultant-Data Engineer
Consultant-Data Engineer
● Should have experience in Data and Analytics and overseen end-to-end implementation of
data pipelines on cloud-based data platforms.
● Strong programming skills in Python, Pyspark and some combination Java, Scala (good to
have)
● Experience writing SQL, Structuring data, and data storage practices.
● Experience in Pyspark for Data Processing and transformation.
● Experience building stream-processing applications (Spark steaming, Apache-Flink, Kafka,
etc.)
● Maintaining and developing CI/CD pipelines based on Gitlab.
● You have been involved assembling large, complex structured and unstructured datasets
that meet functional/non-functional business requirements.
● Experience of working with cloud data platform and services.
● Conduct code reviews, maintain code quality, and ensure best practices are followed.
● Debug and upgrade existing systems.
● Nice to have some knowledge in Devops.
Qualifications:
● Bachelor’s degree in computer science or related field
● Experience in Snowflake and Knowledge in transforming data using Data build tool.
● Strong programming skills in Python, Pyspark and some combination Java, Scala (good to
have)
● Experience in AWS and API Integration in general with knowledge of data warehousing
concepts.
● Excellent communication and team collaboration skills