Title:	AN ETL PATTERN FOR LOG CONFIGURATION AND ANALYSIS
Author(s):	Bruno Oliveira, Óscar Oliveira, Telmo Matos, Vasco Santos and Orlando Belo
ISBN:	978-989-8533-92-0
Editors:	Ajith P. Abraham and Jörg Roth
Year:	2019
Edition:	Single
Keywords:	Data Warehousing, ETL Systems, Logging, Log Pattern, ETL Patterns, Process Mining, Graph Databases
Type:	Full Paper
First Page:	39
Last Page:	46
Language:	English
Cover:
Full Contents:	click to dowload
Paper Abstract:	In many scenarios, such as the ones related to Data Warehousing Extract-Transform-Load (ETL) processes, logging techniques are usually applied for capturing event metrics across system levels for system auditing and system recovery. The diversity of strategies and architectures of the toolset used to support the ETL implementation introduces another layer of complexity, both for system development and audit. Although a valuable system diagnosis resource for the development team, logging is generally underestimated, being used only when the system reveals unexpected behaviours and not to drive the ETL system evolution. We believe that the use of logs for steering ETL development and maintenance can improve significantly global system quality. However, this approach is only effective if flexible and efficient logging systems exist. In this paper, we describe a Log Pattern used in a pattern-oriented approach for ETL systems development, which provides a configurable and flexible component for using to drive ETL development and maintenance phases.
	Go Back