CloverETL Manifesto

DavidPavlis-library

Founded in 2002, CloverETL was the first open source ETL/Data Integration project back when Open Source was a hot topic. At that time, the Open Source was not about marketing strategy to disrupt markets and bring in money. It was about the enthusiasm of developers trying to come up with better (and cheaper) solutions to problems. To allow software technology to be accessible to everyone. It was a whole new philosophy.[Continue reading]

Custom CTL functions in CloverETL

custom-ctl-function-navigator-structure

A few weeks ago I published a blog post about how to create a custom CloverETL component. This is great if you have special logic that operates on whole records. But what if you have specific needs when it comes to processing single values, or more precisely, field values? This is where custom CTL functions come into play. In this post, I’ll cover how to extend CTL2, the embedded data transformation language inside CloverETL.[Continue reading]

CloverETL 3.5 ­– What to Expect?

It’s been few months since we released CloverETL 3.4, our most recent production version. As we make significant progress on the next version, I’d like to share a few of the features available in CloverETL 3.5. In fact, some of these were released a few days ago in the milestone version. Want to try CloverETL for yourself? Download it here.[Continue reading]

CloverETL Designer User Interface Improvements in 3.4

UImprovements_4

Here at CloverETL we not only work to create new and exciting features, but also have a workgroup specifically dedicated to improving the “little things”. I’m talking about those little things that can help you avoid aimlessly clicking around while trying to do work, or make you think in a quick, intuitive, and productive manner. Listed below are some of the most important tweaks and improvements that CloverETL 3.4 can provide. We think you will find them useful in that they will make working with the CloverETL Designer not only more comfortable, but also more effective.[Continue reading]

Big Time with Big Records

Those of you who have ever tried to process big records with CloverETL already learned that it required some tweaking and special care to make it run smoothly and efficiently. In some cases, CloverETL could get too greedy with memory requirements for a graph run, making it quite cumbersome to set up. With CloverETL 3.2 we have introduced improved memory management in the runtime layer that has optimized memory usage when running graphs with big records.[Continue reading]

Performance Optimization of Metrics in CloverETL Data Profiler

clock-icon

The first beta version CloverETL Data Profiler was released in October, and since then we have been working on improvements for the second beta version, which was released at the end of last year. Besides bug fixing and adding a few new features, we also worked on performance optimization of profiling metrics. This article will describe this improvement and how profiling is interconnected with CloverETL Engine.[Continue reading]