Connecting to Databricks

Getting Started

Global Functions

Administration

Extended Planning & Analysis (xP&A)

xP&A Video Tutorials

User Roles in Lucanet xP&A

Lucanet xP&A User Interface

All Steps at a Glance

Basic Concepts and Elements

Creating a Model

Integrating Data

Connecting to a Data Source

Connecting to a Spreadsheet

Connecting to an Accounting System

Connecting to a BI/Database System

Defining Database Queries

Connecting to BigQuery

Connecting to Postgres

Connecting to Databricks

Connecting to Microsoft SQL Server

Connecting to MySQL

Connecting to Redshift

Connecting to Snowflake

Connecting to Looker

Connecting to a CRM System

Connecting to an HRIS/Payroll System

Connecting to a Lucanet CFP Data Source

Connecting to a Source System Using a Webhook

Sharing Data Connections

Working With Integrated Data

Guideline for Exchanging Data Between xP&A and CFP

Modeling Your Data

Viewing and Visualizing Data

Working with Models

Using Comments and Descriptions

Comparison: xP&A vs. Excel Performance

Consolidation & Financial Planning

ESG Reporting

Disclosure Management

XBRL Tagger

Lease Accounting

Banking & Cash Management

Data Collection

Tax Compliance & Reporting

Glossary

You can establish a direct connection to Databricks to pull in data into xP&A.

This article contains a description of the prerequisites and the individual steps of the set-up process.

The fields that are pulled in must be defined during the set-up process using a database query. For a detailed instruction on how to structure such a query, see Defining Database Queries.

Before connecting Databricks with xP&A, you have to whitelist the following IP address in your Databricks database:

52.59.129.235

Choose one of the following options:

Open the

Data

workspace from the overview on the start page and click

+ New.

Shows the start page of Lucanet xP&A. Highlighted are the buttons that need to be used to create a new data source connection from the start page. — New data source connection from the Data workspace

Open the model into which you would like to integrate the data, click the

sign next to

Data

in the overview, and choose

New data source

In the Data sources dialog, open the BI/Database tab and choose Databricks.

Shows the Data Sources dialog. Highlighted in red is the 'BI/Database' tab. — 'BI/Database' tab

The New Data Source dialog is displayed as follows:

Shows the 'New Data Source' dialog for a Databricks connection — 'New Data Source' dialog for Databricks

Configure the steps as described in the following section.

Click Create data source.

Choose an existing connection, or, if you have not configured a connection yet, click New Connection and enter the following in the New Databricks connection dialog:

Host

name of the Databricks cluster you want to connect

Port

of the Databricks cluster you want to connect

HTTP path

of the workspace/warehouse you want to connect

Authentication type to be used when connecting to Databricks. Choose one of the following options:

Personal account token

: If you choose this option, copy the personal access token to be used to access Databricks into the

Token

field. (For more information on how to get the access token, see

Authenticate with Databricks personal access tokens

Machine-to-Machine OAuth

: If you choose this option, enter the

client ID

and the

Client secret

used in the machine-to-machine authentication workflow with Databricks. (For more information on the client ID and client secret, see

Authenticate access to Databricks using OAuth token federation.)

Enter the following:

Data Source Name

Query

to define the fields which are to be pulled in. For more information, see

Defining Database Queries

Name of the

Date column

, which must be one of Databricks' date formats

Names of the columns that contain

variables

(which must have a

numeric

data type)

Any remaining columns will be treated as dimensions, and must have a string data type.

An exception is the cohort dimension, which must be a date, with the column header explicitly labelled Cohort.

Last updated on Aug 16, 2023

Connecting to Databricks

Overview

Prerequisites for the Setup

Overview

Prerequisites for the Setup

Whitelist IP Address in Databricks

Set-up Steps

Choose a connection

Complete the query form

Table of Contents

Company

Legal Notice

Connecting to Databricks

Overview

Prerequisites for the Setup

Whitelist IP Address in Databricks

Set-up Steps

Choose a connection

Complete the query form

Table of Contents

Related Articles

Company

Legal Notice