Before you start to develop any data transformation you should explore your data (make data profiling). There are a lot of tools on the market that can help you with data profiling. But why to install and learn another software when you can use the tool you are familiar with? CloverETL is mainly data transformation tool but it can be easily used for data profiling as well (as I will show you in this blog post).[Continue reading]
New CloverETL version 2.9. was just released. This version brings a new Infobright Data Writer component, enhances the connectivity by adding Web Services component and adds features that simplify common data transformation tasks.[Continue reading]
As I have promised I bring you a complex comparison of ETL tools: CloverETL, Talend and Pentaho.
Short summary of my previous posts: For testing I used two transformations based on TPCH test and the input data generated by dbgen utility. The transformations were run on my laptop with Windows Vista Home Premium. For detail information see part 1 and part 2.[Continue reading]
Before we will release a complete comparison of open source ETL tools and after a success of my previous blog post I decided to publish the second transformation that we used in the comparison.[Continue reading]
In October release 2.8.1 of Clover we introduced a new component which definitely should attract your attention – the Parallel Reader. The name itself already suggests the goal of the component – improve reading speed by going parallel. The component is very similar to Universal Data Reader in function – it reads delimited flat files like CSV, tab delimited, etc. - much hasn't changed here. But the real difference comes from under the hood.[Continue reading]
The very typical usage of ETL tools is loading the data warehouse (DWH). So I decided to write a tutorial that will describe typical data warehouse tasks (slowly changing dimensions, date dimension, filling fact tables) and propose solutions with using of CloverETL. Let me guide you through the process of building data warehouse with CloverETL.[Continue reading]
We have great news for users of on-line database QuickBase from Intuit . CloverETL became a next tool which can be used to manipulate the data in this database. Now you can work with data in QuickBase without restraints and with full power of CloverETL. We introduced several specialized components dedicated for this purpose.[Continue reading]
As of today (Mar 31st), Clover Engine 2.7 branch has been created and the testing/QA process has started. Within approx 2 weeks, brand new version of CloverETL will be ready. It brings many small new features and bug fixes, but also several significant improvements - mostly in speed.[Continue reading]
Can ETL be used for something useful - aside extract, transform & load ?
I played with an idea that common applications, which include data entry & data processing, can be split into simple, web based data entry application (optionally also data presentation) and business logic implemented as an ETL process. With CloverETL, the transformation piece can be also called as a WEB application - thank to Clover's "launch services" which seamlessly convert any transformation into WEB service where data are passed-in and sent-out through HTTP protocol (POST request).[Continue reading]