Skip to content

Add english prompts for GEM/wikilingua (18 languages) #765

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
May 31, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
79 changes: 79 additions & 0 deletions promptsource/templates/GEM/wiki_lingua/ar/templates.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
dataset: GEM/wiki_lingua
subset: ar
templates:
26a2c187-0667-41bf-b375-da0436aba830: !Template
answer_choices: null
id: 26a2c187-0667-41bf-b375-da0436aba830
jinja: '{{source}}


TL;DR in Arabic: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: tldr_ar
reference: xsum templates
4f05d015-f132-41ad-a2da-75eb1e650c13: !Template
answer_choices: null
id: 4f05d015-f132-41ad-a2da-75eb1e650c13
jinja: "First, read the Arabic article below. \n\n{{source}}\n\nNow, please write\
\ a short abstract for it in Arabic. ||| {{target}}\n\n"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: write_abstract_ar
reference: xsum templates
578e4464-fe13-4eff-960d-0ac1c430e8f7: !Template
answer_choices: null
id: 578e4464-fe13-4eff-960d-0ac1c430e8f7
jinja: '{{source}}


===


Write a summary of the text above in Arabic. ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: summarize_above_ar
reference: xsum templates
c3288886-c6b6-465e-acb4-fe2ea3fcd002: !Template
answer_choices: null
id: c3288886-c6b6-465e-acb4-fe2ea3fcd002
jinja: 'Article in Arabic: {{source}}


Summary in Arabic: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: article_summary_ar
reference: xsum templates
f09797cd-252b-4817-9f85-92b5c349b67b: !Template
answer_choices: null
id: f09797cd-252b-4817-9f85-92b5c349b67b
jinja: '{{source}}


How would you rephrase that briefly in Arabic? ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: rephrase_ar
reference: xsum templates
79 changes: 79 additions & 0 deletions promptsource/templates/GEM/wiki_lingua/cs/templates.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
dataset: GEM/wiki_lingua
subset: cs
templates:
6cb95f93-b6b7-4da8-a27f-e334d30ed856: !Template
answer_choices: null
id: 6cb95f93-b6b7-4da8-a27f-e334d30ed856
jinja: '{{source}}


How would you rephrase that briefly in Czech? ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: rephrase_cs
reference: xsum templates
7d5c5019-7728-4052-9a2b-434646682398: !Template
answer_choices: null
id: 7d5c5019-7728-4052-9a2b-434646682398
jinja: 'Article in Czech: {{source}}


Summary in Czech: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: article_summary_cs
reference: xsum templates
7f2bd973-52c0-486c-ab3b-913892dfee92: !Template
answer_choices: null
id: 7f2bd973-52c0-486c-ab3b-913892dfee92
jinja: "First, read the Czech article below.\n\n{{source}} \n\nNow, please write\
\ a short abstract for it in Czech. ||| {{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: write_abstract_cs
reference: xsum templates
a43cb97f-eeca-403c-85e0-1f1f83725900: !Template
answer_choices: null
id: a43cb97f-eeca-403c-85e0-1f1f83725900
jinja: '{{source}}


TL;DR in Czech: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: tldr_cs
reference: xsum templates
d8d4f3e8-88cd-471a-a29c-17e5822d779e: !Template
answer_choices: null
id: d8d4f3e8-88cd-471a-a29c-17e5822d779e
jinja: '{{source}}


===


Write a summary of the text above in Czech: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: summarize_above_cs
reference: xsum templates
79 changes: 79 additions & 0 deletions promptsource/templates/GEM/wiki_lingua/de/templates.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
dataset: GEM/wiki_lingua
subset: de
templates:
039c2189-9fb2-4afb-b690-251af7ee89df: !Template
answer_choices: null
id: 039c2189-9fb2-4afb-b690-251af7ee89df
jinja: '{{source}}


===


Write a summary of the text above in German: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: summarize_above_de
reference: xsum templates
1f3a6173-9741-4ada-98fc-44b4ac78dec2: !Template
answer_choices: null
id: 1f3a6173-9741-4ada-98fc-44b4ac78dec2
jinja: '{{source}}


TL;DR in German: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: tldr_de
reference: xsum templates
2977b652-d313-4a3b-b197-f9e0e5e468db: !Template
answer_choices: null
id: 2977b652-d313-4a3b-b197-f9e0e5e468db
jinja: "First, read the German article below. \n\n{{source}}\n\nNow, please write\
\ a short abstract for it in German. ||| {{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: write_abstract_de
reference: xsum templates
6ef08ab1-5d00-4d13-876f-e06c3bd96747: !Template
answer_choices: null
id: 6ef08ab1-5d00-4d13-876f-e06c3bd96747
jinja: 'Article in German: {{source}}


Summary in German: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: article_summary_de
reference: xsum templates
fd7fa7ca-b87f-4ecd-bc89-d5ee6deca03d: !Template
answer_choices: null
id: fd7fa7ca-b87f-4ecd-bc89-d5ee6deca03d
jinja: '{{source}}


How would you rephrase that briefly in German? ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: rephrase_de
reference: xsum templates
79 changes: 79 additions & 0 deletions promptsource/templates/GEM/wiki_lingua/en/templates.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
dataset: GEM/wiki_lingua
subset: en
templates:
088288f3-7516-4cf7-9406-0e082053bf54: !Template
answer_choices: null
id: 088288f3-7516-4cf7-9406-0e082053bf54
jinja: '{{source}}


===


Write a summary of the text above in English : ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: summarize_above_en
reference: xsum DOC_write_summary_of_above template
2038df7b-5420-4a33-87ec-09715419deef: !Template
answer_choices: null
id: 2038df7b-5420-4a33-87ec-09715419deef
jinja: 'Article in English: {{source}}


Summary in English: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: article_summary_en
reference: xsum 'article_DOC_summary' template
753f0a46-aeff-4cd2-932c-8548897cebe5: !Template
answer_choices: null
id: 753f0a46-aeff-4cd2-932c-8548897cebe5
jinja: '{{source}}


How would you rephrase that briefly in English? ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: rephrase_en
reference: xsum 'DOC_how_would_you_rephrase_few_words' template
d3c5baa3-5e37-46f8-b1b2-5b834181c9da: !Template
answer_choices: null
id: d3c5baa3-5e37-46f8-b1b2-5b834181c9da
jinja: '{{source}}


TL;DR in English: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: tldr_en
reference: xsum 'DOC_tldr' template
dff7b314-7385-4855-bb90-253073a34fde: !Template
answer_choices: null
id: dff7b314-7385-4855-bb90-253073a34fde
jinja: "First, read the English article below.\n\n{{source}} \n\nNow, please write\
\ a short abstract for it in English. ||| {{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: write_abstract_en
reference: xsum 'read_below_DOC_write_abstract' template
79 changes: 79 additions & 0 deletions promptsource/templates/GEM/wiki_lingua/es/templates.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,79 @@
dataset: GEM/wiki_lingua
subset: es
templates:
0bcbc702-a23b-45a1-8c79-67919d8ff2df: !Template
answer_choices: null
id: 0bcbc702-a23b-45a1-8c79-67919d8ff2df
jinja: '{{source}}


===


Write a summary of the text above in Spanish: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: summarize_above_es
reference: xsum templates
3c79eb35-ae2f-4e0d-b50c-3088e32ab16e: !Template
answer_choices: null
id: 3c79eb35-ae2f-4e0d-b50c-3088e32ab16e
jinja: "First, read the Spanish article below.\n\n{{source}} \n\nNow, please write\
\ a short abstract for it in Spanish. ||| {{target}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: write_abstract_es
reference: xsum templates
59be0be3-dcf3-4413-8ec8-f8a68c326bb6: !Template
answer_choices: null
id: 59be0be3-dcf3-4413-8ec8-f8a68c326bb6
jinja: '{{source}}


TL;DR in Spanish: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: tldr_es
reference: xsum templates
96c3d1f4-2e7d-468e-aca3-faa6519f768d: !Template
answer_choices: null
id: 96c3d1f4-2e7d-468e-aca3-faa6519f768d
jinja: 'Article in Spanish: {{source}}


Summary in Spanish: ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: article_summary_es
reference: xsum templates
bca06c7a-d447-4fd9-a5b3-b789dcd4048a: !Template
answer_choices: null
id: bca06c7a-d447-4fd9-a5b3-b789dcd4048a
jinja: '{{source}}


How would you rephrase that briefly in Spanish? ||| {{target}}'
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- ROUGE
- BLEU
original_task: true
name: rephrase_es
reference: xsum templates
Loading