Closed
Description
Modules header names:
X-Friendli-BaseURL to configure the base url
X-Friendli-Token to pass FRIENDLI_TOKEN used for auth
Module mandatory settings:
model - defaults to meta-llama-3.1-70b-instruct
baseURL - defaults to https://inference.friendli.ai/
Module additional settings:
temperature - defaults to 0
maxTokens - defaults to 2048
Metadata
Metadata
Assignees
Labels
No labels