Data Engineer
Full Time
full time
18 Feb 2024
About the job
Job Purpose
Aim to empower all areas of the organization with the insights they need to make informed and strategic decisions. By leveraging the latest in business intelligence technologies and techniques, we will help unlock the full potential of our data assets and transform raw data into actionable insights. Our goal is to build a culture of data-driven decision making across the organization, where data is viewed as a strategic asset and not just a byproduct of day-to-day operations. Together, we can unlock the full potential of our business and drive success through the power of data.Job Responsibilities
- Create and enhance data solutions enabling seamless delivery of data and is responsible for collecting, parsing, managing, and analyzing large sets of data across different domains for analysis.
- Use different Data warehousing concepts to build a Data warehouse for internal departments of the organization.
- Designs and develops data pipelines, data ingestion and ETL processes that are scalable, repeatable, and secure for stakeholder needs.
- Build Data architecture to support data management strategies to support business intelligence efforts for various stakeholders.
- Develops near real-time and batch ETL data processes aligned with business needs, manages and augments data pipeline from raw OLTP databases to data solution structures.
- Documents data flow diagrams, security access, data quality and data availability across all business systems.
Job Requirements
- Bachelor’s degree in computer science, Information Technology or equivalent.
- Knowledge of functions, Fintech, and e-payment
- Proven experience in Linux and Windows Server OS and Oracle/MySQL/MS-SQL, Mongo DB environments.
- Strong experience in Python
- Proven experience in ETL development (Apache spark, kafka, airflow, Apache impala, Hadoop, hdfs)
- Be able to work with ambitious timelines in a dynamic, high-growth environment
- Strong understanding for ODS, DDS and data marts
- Good communications skills, with both technical and business audiences.
