Accessing Google API – Google Analytics using CloverETL

ClientIdCreated_2x

Today, reporting and analytics are big. There’s a visible shift in the perception of business intelligence among medium and small businesses. Previously, BI was a domain of big enterprises and intimidating IT budgets; now, it can be achieved DIY-style, with affordable, easy-to-use tools. Data, of course, is a bare necessity for a successful BI project. Thus, having accurate, complete, and effectively combined data sources is a must.[Continue reading]

How Small a Footprint Can Enterprise Software Actually Have?

raspberry-pi-cloveretl

We keep saying that CloverETL has a small footprint and is multiplatform out of the box. So why not test this assertion – in an extreme situation? Instead of just taking the core, we’ll go with the full installation of the CloverETL Server, put it onto the smallest machine possible, and see if it can still perform something useful. Sound like fun? Let’s do it![Continue reading]

Custom CTL functions in CloverETL

custom-ctl-function-navigator-structure

A few weeks ago I published a blog post about how to create a custom CloverETL component. This is great if you have special logic that operates on whole records. But what if you have specific needs when it comes to processing single values, or more precisely, field values? This is where custom CTL functions come into play. In this post, I’ll cover how to extend CTL2, the embedded data transformation language inside CloverETL.[Continue reading]

Deploying a custom component plugin to the CloverETL Server

custom-plugin-on-server

A few weeks ago, we published a blog post about how to create a custom component. It described all of the necessary steps to implement your own component and how to integrate it into the CloverETL Designer. However, if you use the CloverETL Server and want to be able to use your component there, you need to go one step further. In this post, I'll show you how to deploy the plugin into the Server so that your components also work in transformations living on the Server.[Continue reading]

CloverETL Data Quality – An Introduction to Validator

validator_available_rules_active_rules

Before your data enters the ETL process, it's in your best interest to only work with "good" data – that is, data that conforms to its respective domain rules, ranges, allowed values, and perhaps other unusual restrictions. If it doesn't, you'll want to log and remove all erroneous records so as not to pollute your transformation, as well as to have means to report and fix the data later on.[Continue reading]

Creating Custom Component in CloverETL Step By Step

component-04a

CloverETL is designed to be an extensible system. Although it already contains a lot of components, there can be cases where you need to create your own – be it a specific and often-used task, use of an external library, your own connector, etc. The full guide for creating a custom component is described in the documentation, but for those of you who want a quick look at the process without the lengthy details, I’ve prepared some brief instructions. If you follow this guide step by step, you’ll be able to create custom components in no time.[Continue reading]