In Data Hub, a source dataset specifies which data to import from a source system. Each source dataset belongs to a connection, and a connection can have one or more source datasets. On the Integrations page, each source dataset is displayed as a child row of the connection it uses.

Which actions you can perform for a source dataset in Data Hub depends on your user role for Data Hub and on the permissions you have for the source dataset. For more information, see Sharing a Source Dataset below and User Roles in the CFO Solution Platform.

The options in the Configuration area of a source dataset in Data Hub depend on the source system. They are described in detail on the page of each integration, together with example configurations. For the available integrations, see Integrations in Data Hub.

To create a source dataset in Data Hub:

1

On the Integrations page, click the Three-dot icon icon in the row of the connection you want to use to import data and select Create new dataset.

2

Specify the options of the source dataset.

3

Click Create. The source dataset is created and displayed under the selected connection on the Integrations page.

The following options are available for a source dataset in Data Hub:

OptionDescription
NameName that identifies the source dataset on the Integrations page. Required
ConnectionConnection to the system from which the data is imported. Required.

Note: The connection from which you create the source dataset is preselected. If necessary, you can select a different connection from the drop-down list. The Configuration area then displays the options of the selected source system. After the source dataset is created, the connection can no longer be changed.

NamespaceTechnical identifier for the source dataset, used to reference its data tables in SQL queries against the Data Lake (for example, namespace.table_name). The namespace can have up to 255 characters and must be SQL-safe, with no spaces or unsupported special characters. Required
VariablesOptional placeholders in the configuration whose values are selected every time an import is started. For more information, see Variables below.
ConfigurationData to import from the source system. Required. For more information, see Source Dataset Configuration below.

In Data Hub, a variable is a placeholder in the configuration of a source dataset. Instead of a fixed value, you can enter the variable in the configuration and select a value for the variable every time you start an import. This way, a single source dataset can import the data of a specific period or a specific company, without a separate source dataset for every combination.

The Variables area is displayed as follows, for example:

Shows the 'Variables' area of a source dataset in Data Hub with the columns 'Variable name', 'Display name', 'Data type', and 'Selection type', and the variables 'PERIOD' (display name 'Period') and 'YEAR' (display name 'Fiscal year'), both with the data type 'String' and the selection type 'Single value'. The 'PERIOD' variable displays '3 values', and the 'Add variable' option is displayed below the table. Highlighted in red is the 'Configure values' option of the 'YEAR' variable.
Variables area of a source dataset

You can define the variables either while you create the source dataset or later, using the Edit option. Click Add variable and specify the following for each variable:

OptionDescription
Variable nameName of the variable, used to reference the variable in the configuration of the source dataset
Display nameName that is displayed for the variable when an import is started, for example Period
Data typeData type of the values. Currently, only String is available.
Selection typeNumber of values that can be selected for one import:
• Single value: Exactly one value can be selected.
• Set of values: Several values can be selected. The import extracts the data for each of the selected values separately.

To define the values that can be selected for a variable in Data Hub:

1

In the row of the variable, click Configure values.

2

Click Add value and specify the following:

  • Label: Text that is displayed for the value when an import is started, for example January
  • Value: Value that replaces the variable in the configuration when the import is executed, for example 01
3

Click Save.

The allowed values of a variable are displayed as follows, for example:

Shows the 'Configure allowed values for Period' dialog in Data Hub with the labels 'January', 'February', and 'March' and the values '01', '02', and '03', and the 'Add value', 'Cancel', and 'Save' options.
Allowed values of the variable 'Period'

To remove a variable from the source dataset, click the Trash bin icon icon in the row of the variable.

In the options of the Configuration area, you can enter a variable in a text field or in a table cell. Write the variable name in double curly brackets, for example {{PERIOD}}.

Every variable of a source dataset requires a value before an import can be executed. For more information, see Importing Data.

In Data Hub, the configuration of a source dataset defines which data is imported. The connection template of the source system determines which tabs the Configuration area displays and which options each tab contains. The configuration of an SAP S/4HANA source dataset therefore differs from the configuration of a Microsoft Dynamics 365 source dataset, and the options can change with the version of the connection template.

The tabs and options of each integration in Data Hub are described on the page of the integration, together with example configurations. For the available integrations, see Integrations in Data Hub. In the Microsoft Dynamics 365 Business Central Beta integration, the area is called Configurations and contains one tab per table.

The options of the configuration can contain variables. For more information, see Variables.

You can manage an existing source dataset from the Three-dot icon icon in the row of the source dataset on the Integrations page in Data Hub. Which options are displayed depends on your user role for Data Hub and on your permissions for the source dataset. For example, Start import requires the Import permission, and Edit, Deactivate, and Delete require the Manage permission. The following options are available:

OptionDescription
Start importOption to start an import for the source dataset. For more information, see Importing Data.
View execution detailsOption to display the execution history of the source dataset. For more information, see Importing Data.
EditOption to display and change the settings of the source dataset and to display the users with whom the source dataset has been shared
Deactivate / ActivateOption to set the source dataset to Inactive or back to Active. An inactive source dataset cannot be imported.
ShareOption to share the source dataset with other users. For more information, see Sharing a Source Dataset below.
Change ownerOption to transfer the source dataset to a new owner. This option is only available to users with the Administrator role for Data Hub. For more information, see Changing the Owner of a Source Dataset below.
DeleteOption to delete the source dataset

After the first import, a source dataset can no longer be edited. Before the first import, all options except the connection can still be changed.

In Data Hub, a source dataset can be shared with other users. When you share a source dataset, you decide for each user which permissions the user receives.

The following permissions are available when you share a source dataset in Data Hub:

PermissionDescription
ImportEnables the user to import data into the source dataset
QueryEnables the user to query the data of the source dataset
ManageEnables the user to edit, share, and delete the source dataset

You can combine the permissions as required. The Manage permission can only be shared with users who have the Data Manager role for Data Hub.

Users with a permission for a source dataset also see the connection of the source dataset on the Integrations page, but cannot change the connection.

The following users can share a source dataset in Data Hub:

  • The owner of the source dataset
  • Users with a permission for the source dataset. These users can only share the permissions that they have themselves.
  • Users with the Administrator role for Data Hub. These users can share all permissions.

To share a source dataset in Data Hub:

1

On the Integrations page, click the Three-dot icon icon in the row of the source dataset and select Share. The Share Dataset dialog is displayed as follows, for example:

Shows the 'Share Dataset' dialog in Data Hub for the source dataset 'ds-v120', with the 'Share with' drop-down list displaying 'Select users', the 'Import', 'Query', and 'Manage' check boxes under 'Shared permission', the hint 'Select at least one permission and one user.', and the 'Cancel' and 'Share' buttons.
'Share Dataset' dialog
2

Under Shared permission, activate the check boxes of the permissions that the users are to receive.

3

In the Share with drop-down list, select the users with whom you want to share the source dataset. You can select several users. Which users the list contains depends on the selected permissions:

  • Import or Query: All users
  • Manage: Only users with the Data Manager role for Data Hub
4

Click Share. The source dataset is shared with the selected users.

The users with access to a source dataset in Data Hub are listed on the Shared tab of the source dataset. The Shared tab is only available if both of the following conditions are met:

  • You are the owner of the source dataset or have the Manage permission for the source dataset.
  • You have shared the source dataset with at least one user.

To display the tab, click the Three-dot icon icon in the row of the source dataset on the Integrations page and select Edit from the context menu. Then click the Shared tab.

The Shared tab of a source dataset is displayed as follows, for example:

Shows the 'Shared' tab of a source dataset in Data Hub, next to the 'Configuration' tab. The table with the columns 'Name', 'Owner', 'Permissions', and 'Conditions' lists three users with blurred names: the owner with 'Yes', the permissions 'Manage', 'Import', and 'Query', and the 'Edit' action; a second user with 'No', the permissions 'Import' and 'Query', and the 'Edit' and 'Revoke' actions; and a third user with 'No', the permissions 'Manage', 'Import', and 'Query', and the 'Edit' and 'Revoke' actions. The 'Conditions' column displays 'No restrictions' for all users. Below the table is the 'Share dataset' button.
'Shared' tab of a source dataset

The Shared tab of a source dataset in Data Hub displays the following information for each user:

ColumnDescription
NameE-mail address of the user
OwnerIndicator of whether the user is the owner of the source dataset
PermissionsPermissions of the user for the source dataset. The available permissions are Manage, Import, and Query.
ConditionsRestrictions that apply to the access of the user. If the access is not restricted, No restrictions is displayed.

On the Shared tab of a source dataset in Data Hub, you can manage the access of the users as follows:

  • Change permissions: Click Edit in the row of the user. The Edit Shared Permission dialog is displayed with the current permissions of the user.
  • Revoke access: Click Revoke in the row of the user and confirm. If the user has shared the source dataset with other users, the other users keep their access.
  • Change the owner: Click Edit in the row of the owner. The Change Dataset Owner dialog is displayed. This option is only available to users with the Administrator role for Data Hub. For more information, see Changing the Owner of a Source Dataset below.
  • Share with further users: Click Share dataset below the table.

In Data Hub, users with the Administrator role can transfer a source dataset to a new owner, for example when the owner of the source dataset leaves the company. The new owner must have the Data Manager role for Data Hub.

To change the owner of a source dataset in Data Hub:

1

On the Integrations page, click the Three-dot icon icon in the row of the source dataset and select Change owner. The Change Dataset Owner dialog is displayed as follows, for example:

Shows the 'Change Dataset Owner' dialog in Data Hub for the source dataset 'ElementAttribute-GLAccountWithEntityVariable', with the current owner blurred under 'Owner', the required 'New owner' drop-down list displaying 'Select user', and the 'Cancel' and 'Change owner' buttons.
'Change Dataset Owner' dialog
2

In the New owner drop-down list, select the user who is to become the owner of the source dataset.

3

Click Change owner and confirm the change. The selected user becomes the owner of the source dataset.

When the owner of a source dataset in Data Hub changes, the previous owner loses all permissions for the source dataset. All other users keep their access. If the previous owner is to continue working with the source dataset, share the source dataset with the previous owner after the change.

This content was generated using AI and reviewed by Lucanet subject matter experts before publication.