CloverETL Designer

CloverETL Designer is a visual tool for development, debugging and manual execution of data transformations.

DOWNLOAD TRIAL

Design data transformations visually, with instant visibility into the data flow at any point, using a wide selection of customizable out-of-the-box connectors and operations. Additionally, you can create, share and reuse your own components from existing building blocks or using code, effectively shielding users from internal complexities with a simple user interface.

Good for

Features

  • Out-of-the-box connectivity

    Save time and effort trying to connect to data sources. We’ve gone through solving connectivity to data for you. All those exceptions to standards, erratic behaviours and complexity, it is a long journey every time you have a new data type in the mix. Over time, we’ve built and tested a vast selection of connectors, from simple CSV files, structured delimited or fixed length text files, binary or even text/binary combinations, through Excel spreadsheets with multiple sheets, formatting, horizontal and multi-line records, to relational and NoSQL databases, JSON, gigabytes-long XML structures, Hadoop HDFS, messages queues, etc. It’s all there, ready to use.

  • Instantly find problems during development

    CloverETL gives you instant feedback with clear error messages and warnings to help you develop smoothly. You don’t need to re-run and wait for the execution to fail just to learn you’ve incorrectly configured a parameter somewhere. Designer continually validates component attributes, expressions and inline code and points you directly to problems.

  • Inspect data along the way

    You can visualize data in each step of the transformation and immediately see the current structure, types and actual values. With this visual check inside the transformation, you can promptly uncover and fix problems and immediately validate effects of the change. CloverETL can collect debug data either for all or only selected points of interest along the transformation to speed up development and save disk resources. Even very large data sets can be debugged by simply sampling only a fraction of the data, giving you visibility into the whole set and not just a few hundreds rows, again, without filling up your disk.

  • Build once, then reuse and share

    With CloverETL you can create your own components really easily. Being developers at heart, we love saving time by creating reusable building blocks instead of having to tediously redo things again and again. Simply take a bunch of components that form a functional block in a transformation and wrap it up into something we call a subgraph. This will be a new component that you will reuse elsewhere in your project. Or you can publish it for your team, define a clear interface that hide the complexities inside, allowing them to focus on their area of expertise.

  • Design workflows visually

    Designer makes workflows transparent for everyone. Having a nicely working data transformation quickly becomes just one piece of a bigger puzzle. Additional data sources, multiple targets, long running jobs with checkpoints, error reporting, managing and fixing rejects - all these need to be orchestrated in a workflow. Multiple workflows then require oversight, master orchestration and monitoring. Similarly to transformations, you can design, inspect and easily navigate through multiple layers of workflows. Note, jobflows require Server to run, Designer is your visual front end.

  • Automatically document jobs

    To keep record of how your business logic works, Designer comes with a unique documentation generator. You can automatically create HTML documentation, with images, connections, metadata and expressions either from a single transformation or for multiple projects at once.

  • Validate data quality

    Data is often messy and it’s great to have tools to quickly draft rules and conditions your data must meet before being eligible to processing. Validator is a data quality component, that allows you to drag and drop data quality rules, from simple type and range checks to more advanced phone numbers, zip codes and custom conditions. Additionally, you can save and share rule sets to standardize data quality across projects.

  • Profile your data

    With our built-in Data Profiler, you can discover elementary stats and characteristics about your data sets. Quickly see typical patterns, missing values, convertibility of values, outliers and histograms and analyze where to focus your data quality rules and what anomalies you need to account for.

  • Although coding is optional, it’s greatly supported

    You can fix things sometimes quicker in code and CloverETL let’s you do that anywhere any time. From simple expressions and function calls, if-then-else statements to pages of code with intricate logic, we provide a robust coding platform inside Designer with code assist, syntax highlighting, function libraries and runtime debugging. You can either use CTL - a simple Java-like language best used for expressions and simple logic, or let yourself loose with full blown built-in Java JDK. Other languages are also supported, although not built-in, so there’s no need to throw away your Python, Javascript or shell scripts. However, no matter what you do, you never lose the ability to switch back and forth between visual design and code.

  • Keep and leverage existing code

    If you already have some data logic implemented in Java, Python (or any other programming or scripting language) you can embed it into a transformation and use CloverETL as a framework for running these bits and pieces. It might be, that in the future you’ll reimplement them, but for now there’s no need to throw them away, yet you can switch to using a full data integration platform. (For some languages you will need to use external interpreters)

  • Put your work under Version Control

    Use any common version control system (Git, SVN, Bitbucket, …) with files and projects created in CloverETL to unlock full team collaboration. Designer comes bundled with standard Git support, you can easily install Eclipse plugins for the tool of your choice. All project files, transformation graphs, jobflows, metadata definitions etc. are plain XML or text files, no binaries or database configurations. The files are designed to live naturally under version control - you can use standard revision compare tools as only meaningful changes affect the files structures.

  • Built on Eclipse and Java. Runs on all platforms.

    Designer is built on top of the Eclipse IDE platform and all our code is pure Java, no proprietary binaries. We ship Designer with full Java development toolkit to make it easy for you to develop pieces of code in Java and plug them directly into your transformations. Designer runs and is fully supported on all platforms - Windows, Mac and Linux.

Need to know more about automation, scheduling and workflows?

Learn more about Server

CloverETL pricing

Includes Subgraphs and Data Quality packages. Includes embedded runtime for manual execution of jobs.

Click here