All Integrations
Databricks
x

Connect Databricks to Pigment and plan from current actuals

Bring financial and operational data from your Databricks lakehouse into Pigment through two native connectors, so planning models start from the latest data. Scheduled imports keep forecasts and reports current. IT controls access in Databricks and decides which applications can use each connection.

Databricks

Databricks

Connect Databricks to Pigment to forecast and report from the most current actuals in your lakehouse

Category

Data Warehouses & Lakehouses

Integration method

Native Connector
API

Best for

Actuals consolidation · Rolling forecasts · Variance analysis

See documentation

What can you do with Databricks and Pigment?

  • Keep forecasts current across teams. Schedule imports of financial and operational data so every planning team updates forecasts from the same Databricks data.
  • Shape data before it lands. With Databricks SQL, a data lead filters, joins, and aggregates tables in SQL, so Pigment gets data at the model’s grain.
  • Build revenue plans from operational data. Import orders, transactions, or sales data from Databricks as inputs for revenue forecasts and assumptions.
  • Compare plans against actual performance. Bring the latest Databricks data into Pigment to analyze variances across financial and operational KPIs without building data extracts.

How the Databricks integration works

Pigment offers two native connectors for Databricks, both importing data into Lists, Metrics, and Tables. The Databricks SQL connector runs SQL queries against a SQL warehouse and authenticates with OAuth M2M through a Databricks-managed service principal.

The Databricks OpenSharing connector (formerly Delta Sharing) reads data from Unity Catalog shares using an open recipient token profile, and Pigment automatically discovers the available shares, schemas, and tables. It works with Databricks deployments on Azure, AWS, and GCP. For either connector, a Workspace Admin sets up the connection in Pigment and chooses which Applications can use it.

Key capabilities

  • Choose the right connection method. Use Databricks SQL to query lakehouse data directly, or OpenSharing to access curated datasets published through Unity Catalog.
  • Keep connections independent of individual users. Databricks SQL authenticates through a Databricks-managed service principal with read-only access to the catalogs and schemas you grant, so imports don’t depend on anyone’s personal account.
  • Restrict shares to Pigment’s IP addresses. Limit the OpenSharing recipient token to Pigment’s IP addresses, so the share can’t be read from anywhere else.
  • Restrict access to approved Applications. Workspace Admins choose which Applications can use each Databricks connection.
  • Set imports to run on their own. Schedule each import up to 4 times, each with its own start time and frequency, and get notified if a run fails.

Frequently Asked Questions

What Databricks data can I import into Pigment?

With Databricks SQL, you import the results of any SQL query the service principal has permission to run, using fully qualified catalog.schema.table names. With Databricks OpenSharing, you import the tables and views your team adds to a Unity Catalog share, with tables up to 1 GiB and views up to 100,000 rows. Both connectors load data into Pigment Lists, Metrics, and Tables.

Can FP&A teams pull Databricks data without writing SQL?

Yes, with the Databricks OpenSharing connector. Once your data team shares the tables, FP&A users pick the share, schema, and table from drop-down menus in Pigment. Use Databricks SQL when you need to filter, join, or aggregate data before it reaches your model.

Can Pigment send data back to Databricks?

Not through the Databricks connectors, which only import data. Pigment can export data to cloud storage such as Amazon S3, Azure Data Lake Storage, or Google Cloud Storage through the Pigment REST API, and your team can load it into Databricks from there.

See Pigment in action

The fastest way to understand Pigment is to see it in action. Sign up today and explore how agentic AI can transform the way you plan.

Three colleagues focused on an iMac screen in a bright office with plants and modern artwork.

From 8 days to 4 min

Update P&L actuals & financial forecasting

80%

Time cut on data aggregation

12 hours

Saved per month on executive reporting

6 days faster

For scenarios creation and analysis