Execution View – Helping you with Complex Graphs

pic 8 - recalled job

As data keep getting bigger and more complex, so do the graph and workflows used for processing these data––especially when they are nested within each other. While also granting users much more sophisticated options and functionalities with their graphs, subgraphs also added another layer of complexity for debugging graphs. It is easy to get lost in a complex graph; analyzing a long text log can be very difficult and time consuming to search for potential problems and correct them.[Continue reading]

Metadata propagation makes your data integration jobs much easier

Metadata propagation

In the CloverETL 4.0, along with subgraphs, we've introduced another very interesting feature: metadata propagation, that will make your data integration jobs much easier to prepare. Previously, you needed to assign metadata manually to every edge. In case you changed metadata in a graph, you would have to manually re-assign new metadata to each edge afterwards.[Continue reading]

Introducing the most important feature of CloverETL 4.0 – Subgraphs

clover-120-ver4

CloverETL 4.0 is now out, and with it comes a ton of new features. You can read the complete release notes here. In our previous article , we briefly introduced the new main features in 4.0. Today, we are going to dive deeper into subgraph functionality, explaining why are subgraphs a very important feature of CloverETL 4.0 and how they will help you with your data jobs.[Continue reading]

New Features of CloverETL 4.0

clover-120-ver4

Latest production version of the new CloverETL 4.0 is out and our developers are working hard on the next version of CloverETL. You can read release notes for CloverETL 4.0 here.  We will try to explain the biggest changes and new features you can look forward to. Today, we will give you an overview of the most important new features. In the following weeks, we will publish future articles and videos, where we will explain those features in detail and present you with real life examples of these features in action.[Continue reading]

CloverETL 4.0 Milestone 2 released. Brace for subgraphs!

Rapid data integration easy with tweaked UI interface.

The second milestone of 4.0 is here so it’s about time to show you what it involves. Milestone releases give you early access to new features and improvements in CloverETL. The second milestones are usually very close to the final production version - nearly all features of the production version are in the milestone release so you can start preparing for the transition.[Continue reading]

CloverETL Manifesto

DavidPavlis-library

Founded in 2002, CloverETL was the first open source ETL/Data Integration project back when Open Source was a hot topic. At that time, the Open Source was not about marketing strategy to disrupt markets and bring in money. It was about the enthusiasm of developers trying to come up with better (and cheaper) solutions to problems. To allow software technology to be accessible to everyone. It was a whole new philosophy.[Continue reading]

Custom CTL functions in CloverETL

custom-ctl-function-navigator-structure

A few weeks ago I published a blog post about how to create a custom CloverETL component. This is great if you have special logic that operates on whole records. But what if you have specific needs when it comes to processing single values, or more precisely, field values? This is where custom CTL functions come into play. In this post, I’ll cover how to extend CTL2, the embedded data transformation language inside CloverETL.[Continue reading]