Extraction, Transformation, and Loading

When developing analytical solutions based on data warehouses, it is often necessary to transfer information from diverse sources to a single database. This process consists of three stages: extraction (data extraction from the external sources), transformation (cleansing and transformation), and loading (into the warehouse).

Loginom contains all the tools necessary for the ETL process. They are simple to use and require minimal training of the user. An analyst or an IT specialist can visually set up the scenarios for the data import from various sources, perform all the necessary operations and load the information into Loginom Warehouse:

• Wide range of data sources. The system supports virtually all the popular storage systems: commercial DBMS, data warehouses, XML, office applications, file systems and generic drivers.
• Data cleansing and transformation. Loginom contains powerful tools for data cleansing: searching for duplicates and conflicts, gap-filling, outlier detection, filtering and smoothing. After the data are cleansed, all the necessary transformation and pre-processing actions can be performed, including type conversion, indicator calculation, replacement, grouping, merging etc.
• Data enhancement. Since it contains modeling tools, Loginom not only allows data to be transferred from one system to another, but can also enhance the information by evaluating its reliability, calculating risks, forecasting, and segmenting objects. Both internal and external data can be used for this purpose. The enhanced information is of much greater interest and allows more balanced decisions to be made.
• Controlling the data transfer process. Loginom has a task scheduler, a number of tools for logging, load balancing, alerting, and other mechanisms required for controlling the ETL process and optimizing the data processing speed.

The mechanisms implemented in Loginom do more than simply allow the ETL tools to be used for transferring data - from data storage systems to data warehouses. Their capabilities are much broader; they allow uploading of the data to web sites, exchanging files with remote branches, automatically mailing of reports, etc. Loginom can be easily and conveniently used as an ETL system anywhere it is necessary to transfer data from one system to another.