CloverETL 3.3.0-M3

We proudly present the last milestone release of the upcoming enterprise release CloverETL 3.3. This release brings new capabilities for orchestrating processes and workflows, much improved cloud connectivity, and powerful a Data Profiler that's now integrated into the platform.

 

Want to try? Sign in to download or learn how to get started now.

 

  • Server Corporate
  • Major New Feature

Jobflows: Integrated workflow module

Integrate data-related processes into the CloverETL platform. Remove the hassle of unmanageable shell scripting, external schedulers and third-party tools – bring everything into one unified environment.
 
  • Extension
  • Feature

Data Profiler integration

Understand your data. The integrated CloverETL Data Profiler is the right tool to make data quality a standard in your data transformations.
  • Improvement

Web Services

Connect to in-house or cloud-based services such as Salesforce.com, NetSuite, etc.
Treat Web Services as data storage or means for orchestration.

Additional features & fixes

  • Engine
  • Feature
DBFDataWriter
A new component that enables direct writing to dBase .DBF files (DBFDataWriter)
  • Designer
  • Feature
Metadata templates
Some components can generate predefined metadata. This is typically used in jobflows where most of the components operate on predefined tokens.
  • Server
  • Feature
Temporary files management
CloverETL Server now acts a central authority for components, debug edges, etc. for allocating and managing temporary files. System environment variables can be used in Server configuration to setup predefined locations for the Server to manage.
  • API
  • Server
  • Feature
Graph parameters can be passed to executed graphs over JMX
Now graph properties can be passed using the JMX Server API
  • API
  • Server
  • Feature
Groovy over API
You can now call Groovy scripts over CloverETL Server API
  • Engine
  • Feature
JSONReader - New ability to read maps
  • CTL2
  • Engine
  • Feature
New aggregation hash functions
md5(), md5sum(), sha(), sha1sum(), sha256sum()
  • CTL2
  • Engine
  • Feature
New CTL2 functions to access environment variables, Java properties, graph parameters
getEnvironmentVariables(), getJavaProperties(), getParamValue(), getParamValues(), resolveParams()
  • Databases
  • Engine
  • Feature
New Microsoft Access JDBC specific
  • Databases
  • Engine
  • Feature
New Microsoft SQL Server 2012 JDBC specific
  • Server
  • Designer
  • Feature
Log level and checkconfig skipping can be configured for launched server graphs
  • Server
  • Designer
  • Feature
Improved error handling – e.g. when connection to server is lost
  • Engine
  • Improved
USE_DIRECT_MEMORY in default properties – ability to turn off usage of direct memory and use heap instead (lower performance, better manageability)
  • Designer
  • Improved
Graph names can now start with a number
  • Designer
  • Improved
Key editors show field types
  • Designer
  • Improved
Metadata editor shows default values in gray
  • Server
  • Improved
Server UI - tabs reogranized
  • Server
  • Improved
Executions History now displays nested executions for jobflows that spawn other graphs or sub-jobflows
  • Engine
  • Fix
WebServiceClient fails to download WSDL if auth required (#2011112810000012)
  • Engine
  • Fix
Provide "Write null element" property also for element with binding in ExtXmlWriter (#2012012610000097)
  • Engine
  • Fix
Print also field name when "Number is out of available precision" happen (#2012031110000012)
  • Engine
  • Fix
LookupTableReaderWriter: corrupts data when executed in more graphs (sequentially) (#2012040410000033)
  • Engine
  • Fix
DbInputTable: when incremental key is used twice, ArrayIndexOutOfBoundsException is thrown (#2012040910000024)
  • Engine
  • Fix
Fixed CloverDataWriter: append mode causes OutOfMemoryError (#2012051610000018)
  • Engine
  • Fix
Wrong escaping of FileURL property (#2012071110000014)
  • Engine
  • Fix
XmlWriter: bad default cache size (#2012071310000038)
  • Engine
  • Fix
Test of inequality of decimal number (#2012071710000031)
  • Engine
  • Fix
DBOutputTable.checkConfig() does not close connections (#2011121310000048)
  • Engine
  • Fix
ISO format in UTC timezone doesn't work in metadata (CLD-3638)
  • Engine
  • Fix
HTTPConnector: improve loggin messages (CL-2309)
  • Engine
  • Fix
JSONReader: fields containing underscore were not properly mapped
  • Profiler
  • Fix
Enable "Metric" property editing for multi-field selection (#2012071810000145)
  • Server
  • Fix
Fixed missing LDAPReader/LDAPWriter components in CloverETL Server (CLS-743)
  • Server
  • Fix
Persistent sequence can be referenced using sandbox:// URL (CLS-754)
  • Server
  • Fix
LDAP login: Comma in user DN was not handled properly (CLS-735)
  • Server
  • Fix
Fixed tabs in CloverETL Server GUI not working properly in MSIE 9 (CLS-744)

Known issues & Compatibility

  • CTL2
  • Compatibility
Special characters resolution in CTL2 code has been unified – i.e. all regular expressions in CTL2 should be written as "\\s" (not "\\\\s" as previously). Affected components (ApproximativeJoin, DBJoin, LookupJoin, ExtMergeJoin, Partition, Rollup, ComplexDataReader, RelationalJoin)
  • Compatibility
XMLExtract is more strict in parsing Mapping – previously some errors were ignored and only logged as WARN. Now they cause failure of the component.
  • CTL2
  • Compatibility
CTL2 dateDiff() function implementation changed (now computes correct results for dates far apart)
  • Compatibility
Components can no longer set their own paths to temporary folders. Any existing attributes and their values will be ignored. Applies to SortWithinGroups, ExtSort, HTTPConnector, XLSDataWriter, XMLWriter, FastSort, EmailReader. This has been replaced with temporary space management feature.
  • Compatibility
SystemExecute can no longer keep temp batch file.
  • Server
  • Compatibility
IBM WebSphere 6 is no longer supported by CloverETL Server.