CloverETL 3.4.0-M1

CloverETL shifts to parallel data processing and Big Data

We proudly release the first milestone of CloverETL 3.4 for early adopters. There are a lot of features and enhancements planned for the production release due in Spring 2013. With this release, we focus on features in the CloverETL Cluster, distributed processing, and Big Data. The combination of the new Cluster features and Hadoop connectivity gives you a lot more power to solve your Big Data challenges. Also, we are finishing full integration of the Data Profiler to the CloverETL Server, now allowing you to share results via Profiler's Reporting Console and fully utilize Server built-in automation support.

Released Dec 19, 2012
  • Milestone
Recent Releases
4.8.0 Dec 13, 2017
4.7.1 Nov 28, 2017
4.7.0 Oct 10, 2017
4.6.1 July 19, 2017
4.5.0 Mar 14, 2017
4.4.1 Feb 14, 2016
4.3.1 Nov 10, 2016

See all releases

Want to try? Learn how to get started or sign in to download

Release 3.4.0-M1 Contents

  • Designer
  • Server
  • Major New Feature

Hadoop Big Data

Hadoop
Smoothly use CloverETL to integrate data with Hadoop HDFS data storage and HIVE data warehouse.

Be it just for storage or archiving, or staging for a MapReduce job, CloverETL provides tools for data ingest and preprocessing to power your Hadoop-based analytics solutions.

  • Server Cluster
  • Major New Feature

Cluster Control in Your Hands

Take precise control over parallel data flows – spread load for resource-intensive components, route data based on proximity of resources, dynamically change level of parallelism for execution.

  • Designer
  • Server
  • New Feature

Load Balancing

Optimize data throughput by using automatic load balancing of data flows.

  • Server
  • Improvement

Data Profiler Reporting Console

Share and view Data Profiler reports in a web-based Reporting Console or use API for advanced integration. Trigger Profiler using Jobflows or Server automation.

  • Improvement

Usability Improvements

We care about users who need a tool that not only does things right, but also makes your life easier. We continually add features and tweak to do just that.
  • Designer
  • Feature
Insert components in onto an edge
Drag and drop components from the Palette onto an edge to insert it in between the two existing components, automatically linking it to both sides.
Hint: You can also use the Find component dialog (Shift-Space) and then place the selected component onto an edge.

Additional Features & Fixes

  • Server
  • Jobflow
ExecuteGraph/Jobflow – specify the number of parallel running jobs in synchronous mode ("Number of executors")
  • Engine
  • New
CTL2 wrapper for returning capturing groups from regular expressions
  • Engine
  • New
CTL function for writing data into lookup tables
  • Engine
  • New
SystemExecute - new attribute "Ignore exit value"
  • Engine
  • New
Write binary data without padding with 0
  • Server
  • Fix
Inconsistent input validation in "send an email" task (CLS-1007)
  • Server
  • Fix
ExecuteGraph starting clustered job fails with "RunRecord not found" (CLS-988)
  • Server
  • Fix
When Sandbox is referred from Event Listener or Scheduler and cannot be removed, there is exception instead of message (CLS-932)
  • Server
  • Fix
Task Archivator: log files are not properly cleared on Cluster (CLS-806)
  • Designer
  • Fix
Shared sandbox must be open in a Server project to use its resources (not needed anymore) (CLDOC-502)
  • Doc
  • Fix
Documentation to ExecuteGraph component does not contain any information about graph instantiation before the jobflow run (not needed anymore – graph is loaded lazily) (CLDOC-487)
  • Designer
  • Server
  • Fix
Transform editor mapping tab does not work with CTL import in Server project (CLD-4281)
  • Designer
  • Fix
Set initial component ID based on its name (CLD-3866)
  • Designer
  • Fix
Mapping URL property in XMLExtract does not escape special characters (CL-2604)
  • Engine
  • Fix
ExecuteGraph component should not construct the whole TransformationGraph instance in initialization time (CL-2551)
  • Server
  • Fix
Slave gather has output connected, but it's not allowed to write to the output port! (CLS-984)
  • Server
  • Fix
Error reading zip file when no names of compressed files are given (CLS-537)
  • Designer
  • Fix
Cannot connect to two sandboxes with the same id on different nodes in non-clustered environment (CLD-3753)

Known Issues & Compatibility

  • Server
  • Compatibility
ClusterPartition and ClusterGather functionality has changed with the new Cluster execution model.
  • Server
  • Compatibility
Reporting Console runs on all Application Servers supported by CloverETL Server except for JBoss 6 and Glassfish
  • Engine
  • Compatibility
Upgraded POI libraries to version 3.8-20120326
  • Engine
  • Compatibility
Removed openxml4j – it’s part of POI
  • Engine
  • Compatibility
Removed JAXB libraries from engine – they come bundled with Java
  • Engine
  • Compatibility
Upgraded JDBC drivers: Derby 10.5.3000000.802917 → 10.9.1000000.1344872, Firebird 2.1.6 → 2.2.1, MySQL 5.1.15 → 5.1.22, Postgre 8.3-603 → 9.2-1002
  •