Using third party models to embed your data
Overview
Graft supports connecting to third party models via API. All you need is an active account from one of our supported third party vendors (OpenAI and Cohere), you will then be able to use those Trunk Models to embed your data. You can then add Enrichments and take your models into production with Graft.
You can set up your third party API keys HERE Once API keys are in place you can add one or more Data sources and then Create an Entity
Selecting a third party model
When you reach the Define Embeddings stage in the Entity creation workflow Select the field(s) that you wish to Embed.
- Click on the drop down list to see the available Trunk Models
API KEY SET UP
If you haven't already set up your API key Click on the Manage API Keys link to add in the appropriate key. Note that Third party Models are Greyed Out until a key is added
Advanced Settings
Advanced users may change the Embedding Strategy for the third party Trunk models by Clicking on the pencil icon.
Options include
-
-
Truncate + Classification Token
-
Chunk Average + Classification Token
-
-
Click FINISH to complete the Entity configuration and follow the standard Processing workflows