We are seeking a skilled Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The ideal candidate will have experience in data modeling, ETL processes, and working with large datasets in cloud and on-premises environments. You will collaborate with data scientists, analysts, and software engineers to ensure efficient data processing and storage.
Responsibilities:
- Develop scalable, high-performance ETL pipelines that efficiently process and transform large datasets, ensuring seamless data integration across multiple platforms.
- Develop and optimize data models for structured and unstructured data storage.
- Work with cloud platforms such as AWS, Azure, or GCP to build and manage data infrastructure.
- Implement data governance, security, and compliance best practices.
- Collaborate with data scientists and analysts to improve data availability and quality.
- Monitor and optimize database performance, ensuring efficient query execution.
- Automate data workflows using Python, SQL, Spark, or Apache Airflow.
- Work with big data technologies like Hadoop, Spark, and Kafka for real-time data processing.
Required Skills:
- Programming Languages: Python, SQL, Scala, Java (Nice to have).
- Data Technologies: Spark, Hadoop, Kafka, Airflow, PySpark and Big Data Analytics. Should know about Star Schema and Snowflake schemas.
- Database Management: Relational (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra).
- Cloud Platforms: AWS (Glue, Redshift, S3), Azure (Data Factory, Synapse, Databricks), GCP (BigQuery, Dataflow).
- ETL Tools: Informatica, Talend, DBT, Apache NiFi.
- Version Control: Git, Bitbucket, CI/CD pipelines (Docker, Jenkins)
- Other Skills: Strong problem-solving abilities, teamwork, and communication skills.
Experience:
- Min 3-5 years in data engineering or related fields.
What are we offering?
- Health Insurance
- Provident Fund
- Annual Paid Leaves
- Compensation Plans
- Paid Certifications & Training
- Car Finance Program
- Bike Finance Program
- Child Education Program
- Two Annual Trips
- Stars Of the Month Rewards
- Quarterly Meetups
- Referral Bonuses
- Birthday & Eid Gifts
Skills:
ETL Tools, Cloud Platforms, Database Management, Programming Language, Communication Skills,
