Adapters

Extended Bulk Load is now available on the adapter for Salesforce.com, making it the very first non-SQL adapter with this capability. The Salesforce.com adapter can be found in the ERP adapter folder list.

As of Release 7.7.08, when testing a connection using [S]FTP, both reading and writing are tested and the message displayed indicates the success or failure of each.

In previous releases, when configuring a connection to an [S]FTP server for fixed or delimited flat files, the Test option would only test reading from the remote server.

However, these adapters could be used to write to the remote server, either independently or as an auxiliary connection for an adapter, such as Impala or Drill, that required a file to be transferred to the server where they were running.

In these cases, even though the test successfully passed, the use of the adapter could still fail. An example of this is if the user did not have write access to the specified directory.

Using Extended Bulk Load with selected adapters requires that intermediate data files are transferred using [S]FTP to a host server. These adapters include:

• Apache Hive
• Cloudera Impala
• Jethro
• EXASol

In previous releases, this was done by adding a connection to the Flat File adapter and was limited to a single connection per server.

As of this release, a new Configure Bulk Load option is available, and allows you to configure an additional connection for the combination of server and adapter with a unique name. This option can be accessed by right-clicking a connection for a configured data adapter.

In previous releases, attempting to create a table in Jethro or Impala from a synonym using the Recreate DBMS Table (or CREATE FILE) option in the DMC with fields described as YYMD or Date would fail with a syntax error. This was due to the fact that a data type would not be specified.

As of this release, such fields are created as TIMESTAMP and an error does not occur.

Note: Neither Jethro or Impala have a DATE datatype.

Both the Data Management Console and Web Console provide a capability to Pivot a database column or field containing multiple values, such as a delimited list or a JSON document. This creates a new segment in the synonym that describes the internal structure of the field.

This option is now available for JSON documents. In previous releases, if the source synonym was for a JSON document itself, this option was not available.