Data Engineer
Kiambu, Kenya, Full Time. N/A -
About the Role:
Our Client is looking for the best data warehouse engineer to add to our technology leadership team. Reporting to the Vice President Technology, you must have experience translating concepts and specifications into usable analytic resources. Specifically, you will:
- Design, implement, and support a platform providing ad hoc access to large datasets.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL.
- Implement data structures using best practices in data modeling, ETL/ELT processes, and SQL, Redshift, and OLAP technologies.
- Model data and metadata for ad hoc and pre-built reporting.
- Interface with business customers, gathering requirements and delivering complete reporting solutions.
- Build robust and scalable data integration (ETL) pipelines using SQL, Python and Spark.
- Build and deliver high quality datasets to support business analyst and customer reporting needs.
- Continually improve ongoing reporting and analysis processes, automating or simplifying self-service support for customers.
- Partner with technical teams to implement data capture, ETL, validation, and test methods.
- Assist with multiple projects and adjust to rapidly changing priorities. Focus on, and be able to balance project timeliness, while maintaining overall quality across multiple projects and consultations.
- Maintain and assist in data model documentation, data dictionary, data flow, data mapping and other MDM and Data Governance documentation.
- Participate in strategic & tactical planning discussions, including annual budget processes.
- The candidate will manage and enhance the data warehousing environment and to take it through the future iterations.
- Partner with technical teams to implement data capture, ETL, validation, and test methods.
About You:
- You have a bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering).
- You have 3+ years proven experience in managing and executing data warehouse initiatives along with providing project management/process support to IT teams.
- You have experience with Big Data technologies, AWS or Azure cloud environment, and Real-Time Integration methodologies.
- You can adapt quickly in a rapidly changing environment while effectively managing multiple projects and priorities simultaneously.
- You have experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
- You have experience with AWS services including S3, Redshift, EMR and RDS.
- You have experience with software coding practices is a strong plus.
- You have experience using Linux/UNIX to process large data sets.
- You have 3+ years of hands-on experience in writing complex, highly optimized SQL queries across large datasets.