Skip to content

Commit dcff8f6

Browse files
authored
Add LinCE sentiment analysis prompts (#757)
* add prompts for lince sa task * add period, fix answer choices, add more prompts with diverse phrasing
1 parent dfbb18c commit dcff8f6

File tree

1 file changed

+100
-0
lines changed

1 file changed

+100
-0
lines changed
Lines changed: 100 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,100 @@
1+
dataset: lince
2+
subset: sa_spaeng
3+
templates:
4+
24eba864-8859-4a15-a7a9-0fdf42d9f6cf: !Template
5+
answer_choices: positive ||| negative ||| neutral
6+
id: 24eba864-8859-4a15-a7a9-0fdf42d9f6cf
7+
jinja: '{{words | join(" ") }}. What is the sentiment expressed by the original
8+
poster? ||| {{ sa }}'
9+
metadata: !TemplateMetadata
10+
choices_in_prompt: false
11+
metrics:
12+
- Accuracy
13+
original_task: true
14+
name: original poster expressed sentiment
15+
reference: imdb
16+
29756194-c221-48b8-8d25-db1e681d9eeb: !Template
17+
answer_choices: positive ||| negative ||| neutral
18+
id: 29756194-c221-48b8-8d25-db1e681d9eeb
19+
jinja: '{{words | join(" ") }}. What sentiment is this post trying to express?
20+
||| {{ sa }}'
21+
metadata: !TemplateMetadata
22+
choices_in_prompt: false
23+
metrics:
24+
- Accuracy
25+
original_task: true
26+
name: sentiment trying to express
27+
reference: ''
28+
52708ad1-0029-4d97-a5e9-e179da16e452: !Template
29+
answer_choices: positive ||| negative ||| neutral
30+
id: 52708ad1-0029-4d97-a5e9-e179da16e452
31+
jinja: "{{ words | join(\" \") }}. This is definitely \n||| \n{% if sa == \"negative\"\
32+
\ %} \nnot a positive post. \n{% elif sa == \"positive\" %} \nnot a negative\
33+
\ post. \n{% else %} \na neutral post.\n{% endif %}"
34+
metadata: !TemplateMetadata
35+
choices_in_prompt: false
36+
metrics:
37+
- Accuracy
38+
original_task: false
39+
name: negation template
40+
reference: imdb
41+
5dd871bc-140e-43a1-bf8d-6139863d85cd: !Template
42+
answer_choices: positive ||| negative ||| neutral
43+
id: 5dd871bc-140e-43a1-bf8d-6139863d85cd
44+
jinja: What sentiment does following post express? Positive, negative, or neutral?
45+
{{words | join(" ") }}. ||| {{ sa }}
46+
metadata: !TemplateMetadata
47+
choices_in_prompt: true
48+
metrics:
49+
- Accuracy
50+
original_task: true
51+
name: express sentiment
52+
reference: imdb
53+
6186210a-a902-4f9b-b34a-25b01f193842: !Template
54+
answer_choices: positive ||| negative ||| neutral
55+
id: 6186210a-a902-4f9b-b34a-25b01f193842
56+
jinja: From this post, "{{words | join(" ") }}". Does the author seem positive,
57+
negative or neutral? ||| {{ sa }}
58+
metadata: !TemplateMetadata
59+
choices_in_prompt: true
60+
metrics:
61+
- Accuracy
62+
original_task: true
63+
name: the author seem
64+
reference: ''
65+
684d3d19-3100-432a-beb7-5fc0f8de72b5: !Template
66+
answer_choices: positive ||| negative ||| neutral
67+
id: 684d3d19-3100-432a-beb7-5fc0f8de72b5
68+
jinja: What sentiment is the following post trying to express? {{words | join("
69+
") }}. ||| {{ sa }}
70+
metadata: !TemplateMetadata
71+
choices_in_prompt: false
72+
metrics:
73+
- Accuracy
74+
original_task: true
75+
name: sentiment trying to express 2
76+
reference: ''
77+
a036a20f-8192-4af8-83cd-e56f60fd6a0f: !Template
78+
answer_choices: positive ||| negative ||| neutral
79+
id: a036a20f-8192-4af8-83cd-e56f60fd6a0f
80+
jinja: '{{ words | join(" ") }}. The sentiment expressed in this post is ||| {{
81+
sa }}'
82+
metadata: !TemplateMetadata
83+
choices_in_prompt: false
84+
metrics:
85+
- Accuracy
86+
original_task: true
87+
name: express sentiment 2
88+
reference: imdb
89+
e26e9b00-f33a-43d2-98f7-5164d102fe7b: !Template
90+
answer_choices: positive ||| negative ||| neutral
91+
id: e26e9b00-f33a-43d2-98f7-5164d102fe7b
92+
jinja: '{{words | join(" ") }}. Does this post sound positive, negative or neutral?
93+
||| {{ sa }}'
94+
metadata: !TemplateMetadata
95+
choices_in_prompt: true
96+
metrics:
97+
- Accuracy
98+
original_task: true
99+
name: sentence sounds
100+
reference: ''

0 commit comments

Comments
 (0)