Skip to content

Commit 2e80514

Browse files
committed
add other metrics
1 parent c177727 commit 2e80514

File tree

1 file changed

+9
-4
lines changed

1 file changed

+9
-4
lines changed

promptsource/templates/khalidalt/HuffPost/templates.yaml

Lines changed: 9 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -15,6 +15,7 @@ templates:
1515
choices_in_prompt: true
1616
metrics:
1717
- Accuracy
18+
- Other
1819
original_task: true
1920
name: infer_from
2021
reference: ''
@@ -26,12 +27,13 @@ templates:
2627
News||| Arts & Culture||| Environment||| College||| Latino Voices||| Culture
2728
& Arts||| Education
2829
id: 21973a70-f643-4172-a5f3-624aaf0d339a
29-
jinja: 'Given the following news headline: {{headline}}. What is a correct category
30-
class? ||| {{answer_choices[label]}}'
30+
jinja: "Given the following news headline and short description: \n{{headline}}\n\
31+
{{short_description}}\nWhat is a correct category class? ||| {{answer_choices[label]}}"
3132
metadata: !TemplateMetadata
3233
choices_in_prompt: true
3334
metrics:
3435
- Accuracy
36+
- Other
3537
original_task: true
3638
name: class
3739
reference: ''
@@ -49,6 +51,7 @@ templates:
4951
choices_in_prompt: true
5052
metrics:
5153
- Accuracy
54+
- Other
5255
original_task: true
5356
name: Classify_category
5457
reference: ''
@@ -73,6 +76,7 @@ templates:
7376
choices_in_prompt: true
7477
metrics:
7578
- Accuracy
79+
- Other
7680
original_task: true
7781
name: correct_category
7882
reference: ''
@@ -84,13 +88,14 @@ templates:
8488
News||| Arts & Culture||| Environment||| College||| Latino Voices||| Culture
8589
& Arts||| Education
8690
id: deac9d78-f784-47f6-8cac-3cc6bbdf9f1a
87-
jinja: "Given the following article headline and short passage of the article\
88-
\ What is the category of this news report? \nArticle headline: {{headline}}\n\
91+
jinja: "Given the following article headline and short passage of the article,\
92+
\ what is the category of this news report? \nArticle headline: {{headline}}\n\
8993
Short passage: \"{{short_description}}\" \n ||| {{answer_choices[label]}}"
9094
metadata: !TemplateMetadata
9195
choices_in_prompt: true
9296
metrics:
9397
- Accuracy
98+
- Other
9499
original_task: true
95100
name: category_of
96101
reference: ''

0 commit comments

Comments
 (0)