CloverETL 3.4.0-M2

Strides Toward Parallel Data Processing + Complete Hadoop Support

In this second and final milestone for the upcoming CloverETL 3.4 release, we added the finishing touches to our efforts started with the M1 – improvements to the Cluster in the area of parallel processing of a single transformation; Hadoop support (now adding integration with MapReduce jobs); and improvements to the Server, such as a more legible user interface and redesigned management of database connections, both of which greatly improve the Designer-Server development experience.

Released Mar 25, 2013
  • Milestone
Recent Releases
4.8.0 Dec 13, 2017
4.7.1 Nov 28, 2017
4.7.0 Oct 10, 2017
4.6.1 July 19, 2017
4.5.0 Mar 14, 2017
4.4.1 Feb 14, 2016
4.3.1 Nov 10, 2016

See all releases

Interested in trying it out? Learn how to get started or sign in to download.

Release 3.4.0-M2 Contents

Related releases

  • Server
  • Major New Feature

Hadoop Support Complete with
ExecuteMapReduce

The new ExecuteMapReduce component closes the loop of full integration with Hadoop. Building upon support for HDFS and Hive queries introduced in the first milestone, you can now fully integrate CloverETL and Hadoop processing stacks.

  • Server Cluster
  • Major New Feature

Cluster Enhancements:
Repartitioning Parallel Flows and Detailed Tracking

CloverETL Repartition
Following the effort to bring user control over the Cluster node allocation for parallel data processing, in this milestone, we introduce Repartition – a component that lets you re-route an already parallel data flow onto a different set of nodes, efficiently and on the fly.

  • Designer
  • Server
  • Improvement

Database Connections Overhaul on the Server

Enjoy simplified development on the Server with Server-based remote database connections.

  • Profiler
  • Server

Data Profiler Automation with REST API

Enterprise applications can now access the core of the Data Profiler to manage and retrieve useful historical profile data from the Data Profiler repository. Use it for automating trends analysis, reporting, or monitoring.

Related to this update

  • Server
  • Improvement

Server User Interface Redesign

We're introducing a new look & feel to the Server Console user interface. It's geared towards continuous improvements for support personnel – better insight into the Server processes and a simpler configuration.

 

Additional Features & Fixes

  • Server
  • New
CloverETL Server – Weblogic 12c
  • Designer
  • Improvement
Metadata name is now displayed in the Join key editor
  • Profiler
  • Server
ExecuteProfilerJob – "source" and "encoding" can now be mapped from input edge
  • Profiler
  • Fix
Fixed occasional crash in histogram view (DP-954)
  • Server
  • Fix
"Suspend" sandbox button fixed (CLS-1098)

Known Issues & Compatibility

  • Engine
  • Compatibility
Changed internal record counters and sequence counters to "long" instead of "integer". Jobflows that use ExecuteGraph/Jobflow and MonitorGraph/Jobflow components and map the tracking data will need to be updated. To fix this, just change "integer" to "long" in your metadata. Note this may also affect those who implement Engine extensions, custom components, or functions. (CL-1825, CL-2652)
  • Server
  • Designer
  • Compatibility
Database connections refactored to be proxied through the Server (see above and CL-2682). This may affect those who've implemented their own connection and use the Engine's Connection interface.
  • Server
  • Compatibility
The attribute "redirectErrorOutput" in ExecuteScript can no longer be mapped from input port - it affects graph topology and thus does not make sense to be changed in runtime. (CLO-236)
  • Engine
  • Server
  • Compatibility
Changed structure of error and exception messages. This may affect those who parse the graph output logs in a certain automated way - please check your matching rules. (CL-2710)