CloverETL 3.3.0

We proudly present the production release CloverETL 3.3.0. It packs all its milestone features and fixes: jobflows for workflow management, the integrated Data Profiler, advanced support for Web Services, support for complex data structures, and lots of usability improvements – including unrivaled Excel spreadsheet capabilities.

This release combines all its milestone releases (3.3.0-M1-M2 and -M3) into a full production release, making it a replacement for any previous milestone. Thus, it’s an ideal candidate for an upgrade from older production releases too.

Released Oct 22, 2012
  • Production
Recent Important Releases
3.5.2 Aug 22, 2014
4.0.0-M2 Jul 31, 2014
3.5.1 May 6, 2014
4.0.0-M1 Apr 10, 2014
3.5.0 Jan 22, 2014
3.4.3 Nov 27, 2013
 
See all releases

Want to try? Learn how to Get started or sign in to download

Release 3.3.0 contents

Related milestone releases

  • Server Corporate
  • Major New Feature

Jobflows: Integrated workflow module

Integrate data-related processes into the CloverETL platform. Remove the hassle with unmanageable shell scripting, external schedulers and third-party tools - bring everything into one unified environment.
 
  • Extension
  • Feature

Data Profiler integration

Understand your data. The integrated Data Profiler is the right tool to make data quality a standard in your data transformations.
  • Improvement

Web Services

Connect to in-house or cloud-based services such as Salesforce.com, NetSuite, and more.
Treat Web Services as data storage or means for orchestration.

  • Improvement

Excel spreadsheets

Redesigned Excel support brings unparalleled control over reading and writing XLS/XLSX files. Read complex files with multiple row records, formatting, write into templates, and much more.
  • Improvement

Usability improvements

We care about users who need a tool that not only does things right, but also makes your life easier. We continually add features and tweak to do just that.

Additional features & fixes

  • Engine
  • Feature
Support for List and Map Fields

This is just one step that CloverETL is taking to enhance its support for both rich data structures and unstructured data. A field in metadata can now be declared as a list of values or as a map – a pair of a key and a value. This enhancement eases the previously rigid metadata model, which required each processed data record to be exactly described to the last item. With this new version, data coming from systems where the structure of record varies from record to record (as are CRMs, social networking systems) can now be easily processed in CloverETL by utilizing the variable length lists or even more flexible maps.

Support for lists and maps now spans across the whole platform: from the metadata editor, through CTL, to passing lists and maps over to a dictionary. Lists and maps now may become handy in processing XML, to name one use case.

  • Engine
  • Feature
DBFDataWriter
New component that enables direct writing to dBase .DBF files (DBFDataWriter)
  • Server
  • Feature
Temporary files management
CloverETL Server now acts as a central authority for components, debug edges, etc. for allocating and managing temporary files. System environment variables can be used in Server configuration to set up predefined locations for the Server to manage.
  • Designer
  • Feature
Graph elements locking
Graph elements like metadata, connections, parameter files, etc. can now be locked. A lock is a simple mechanism for cooperative environments that indicates, or warns, users that a shared resource should not be modified. The lock can be removed by team members, as graph element locks are not means of security - but anyone choosing to do so will understand to proceed with caution before modifying the team's work.
Graph Elements Locking
  • API
  • Server
  • Feature
Graph parameters can be passed to executed graphs over JMX
Now graph properties can be passed using the JMX Server API
  • API
  • Server
  • Feature
Groovy over API
You can now call Groovy scripts over CloverETL Server API
  • API
  • Server
  • Feature
Enabled compression for WebDAV
  • Engine
  • Feature
Support for Microsoft-style webservices (NTLM authentication support)
  • CTL2
  • Engine
  • Feature
New aggregation hash functions
md5(), md5sum(), sha(), sha1sum(), sha256sum()
  • CTL2
  • Engine
  • Feature
New CTL2 functions to access environment variables, Java properties, graph parameters
getEnvironmentVariables(), getJavaProperties(), getParamValue(), getParamValues(), resolveParams()
  • Databases
  • Engine
  • Feature
New Microsoft Access JDBC specific
  • Databases
  • Engine
  • Feature
New Microsoft SQL Server 2012 JDBC specific
  • Server
  • Designer
  • Feature
Log level and checkconfig skipping can be configured for launched server graphs
  • Server
Support for WebLogic 10.3.6
  • Engine
  • Fix
Fixed linking of external metadata in directory containing space under certain circumstances
  • Engine
  • Fix
Fixed race condition/deadlock in WebServiceClient (whem multiple WSC accessed one WS operation concurrently)
  • Engine
  • Fix
Fix WebServiceClient: 'Axis2 task' threads stays in waiting state without terminating (CL-2406)
  • Designer
  • Fix
Designer view no longer scrolls towards upper-left on copy-paste of a component
  • Engine
  • Fix
UniversalDataReader did not work with specific FTP wildcards
  • Engine
  • Fix
SpreadsheetWriter: When checking for extension type parameters were not substituted
  • Engine
  • Fix
DBOutputTable failed when comments in SQL contained semicolons (CL-2409)
  • Engine
  • Fix
DBInputTable, DBOutputTable, DBExecute, DBJoin: use CDATA section for SQL (CLD-3930)
  • Designer
  • Fix
Failed metadata extraction (CLD-4065, CLD-4072)
  • Designer
  • Fix
Fixed UDR opening lots of SFTP connections for "*" wildcard (CL-2539)
  • Engine
  • Fix
Reading and writing to SFTP at the same time (CL-2540)
  • Server
  • Fix
Fixed archivator sometimes cleaning non-expired items (CLS-788)
  • Server
  • Fix
Fixed: one task linked to two different jobs (CLS-919)
  • Server
  • Fix
Fixed tabs in CloverETL Server GUI not working properly in MSIE 9 (CLS-744)

Known issues & Compatibility

  • CTL2
  • Compatibility
The assignment operator '=' now assigns everything by value instead of former mixed behavior by value/by reference.
  • CTL2
  • Compatibility
Special characters resolution in CTL2 code has been unified – i.e. all regular expressions in CTL2 should be written as "\\s" (not "\\\\s" as previously). Affected components (ApproximativeJoin, DBJoin, LookupJoin, ExtMergeJoin, Partition, Rollup, ComplexDataReader, RelationalJoin)
  • Compatibility
XMLExtract is more strict in parsing Mapping – previously some errors were ignored and only logged as WARN. Now they cause failure of the component.
  • CTL2
  • Compatibility
CTL2 dateDiff() function implementation changed (now computes correct results for dates far apart)
  • Compatibility
Components can no longer set their own paths to temporary folders. Any existing attributes and their values will be ignored. Applies to SortWithinGroups, ExtSort, HTTPConnector, XLSDataWriter, XMLWriter, FastSort, EmailReader. This has been replaced with temporary space management feature.
  • Compatibility
SystemExecute can no longer keep temp batch file.
  • Server
  • Compatibility
IBM WebSphere 6 is no longer supported by CloverETL Server.
  • Compatibility
Dropped support for Eclipse 3.5
  • Compatibility
Preliminary support for Eclipse 4.2

Data integration software and ETL tools provided by the CloverETL platform offer solutions for such data management tasks such as data integration, data migration, or data quality. CloverETL is a vital part of such enterprise solutions as data warehousing, business intelligence (BI) or master data management (MDM). CloverETL’s flagship applications are CloverETL Designer and Server. CloverETL Designer is a visual data transformation designer that helps define data flows and transformations in a quick, visual, and intuitive way. CloverETL Server is an enterprise ETL runtime environment. It offers a set of enterprise features such as automation, monitoring, user management, real-time ETL, clustering, or cloud data integration.