Company Name: Cloud Kinetics
Location: Jakarta Raya
Posted Date: 03/10/2024 22:27
Salary:
Job Description
- Working in the Service Delivery department on projects across Southeast Asia and collaborating on data warehouse projects. With a specialization in AWS data engineering, particularly in AWS Glue, Redshift, EMR, S3, etc. Excel in architecting and implementing robust solutions. Hands-on in Snowflake and DBT, leveraging these technologies to build unified data warehouses and drive transformative projects.
- Requirements
- 6+ years of hands-on data engineering experience
Expertise with AWS services:
S3, Redshift, EMR, Glue, Kinesis, DynamoDB
- Building batch and real-time data pipelines
- Python, SQL coding for data processing and analysis
- Data modeling experience using Cloud based data platforms like Redshift, Snowflake, Databricks
- Design and Develop ETL frameworks
- Expertise with Cloud Data services
- Batch & real-time data integration
- Star Schema, Partitioning, Incremental Load setup
- Building data lake and Lakehouse
- Step functions/AMWAA/Airflow
- Building data pipeline using Spark
- SQL, Python
- Real-time pipelines with tools like Kafka/Kinesis
- Metadata management
- Data Encryption