Skip to main content

Databricks Delta share

Mitchell Harris
Updated

databricks.svg

Overview​

The Databricks connector allows you to pull data from your Databricks Delta share.
 

warning.png Graft Role

You will need to configure a specific Delta share for Graft's access, current instructions can be found here. For step 4 you need to use OpenSharing and for step 6 rather than sending the credentials link to Graft we recommend that you download the token file generated as part of open sharing; you will need to manually complete the information from this file into the Graft connector set up screen.
 

Data Source Selection

Once on the Data source screen click on the CREATE DATA SOURCE button 

datasource-entry-create.png

 

datasource

  • Double-Click the Delta Share icon from the list of available data source connectors

OR

  • Select the Delta share icon and Click NEXT

 

Connector Configuration​

You will be presented with the required fields for creating a Delta share connector

db-deltashare-basicinfo.png

Connector name

  • Enter a unique name for this data source connector

Share details

  • Enter Share name
  • Enter Schema name
  • Enter table name
  • Enter Delta table version (default of -1 provides the latest information to Graft)
  • Enter Credentials version (default 1)
  • Enter Bearer token
  • Enter Delta Share endpoint
  • Retain Share Expiration (as this will be overridden by your share configuration in Delta share)
  • Click NEXT

Schema Configuration​

Graft presents the available fields and automatically sets the field type. You have the option to change any field type to suit the underlying data. For example you may need to switch a field listing URIs to images from the default text to Image URI. 

 

warning.pngIt is important to double check the field types now as they can not be changed later.

databricks-schema.png

 

  • Make any changes that are needed for your specific data source
  • Click NEXT to move to the data preview or FINISH to skip

Data source preview (optional)​

In the preview screen a sample of the available fields is displayed, initially in a table view. You can select User, Project, Issue and Comment Objects.

Table View

by default the table.svgtable preview is displayed

databricks-preview-table.png

 

Gallery view

Toggling to the eye.svg gallery view displays the fields of a single item, if there is an image file this is also displayed. You can step between preview items using the left and right arrows.

 

Click FINISH to complete the connector configuration, you will be presented with the Data Source Summary dashboard

 

Congratulations, your new data connector has now been configured!

Powered by Zendesk