Skip to content

Add XQuAD [ more prompts + Arabic prompts ] #770

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
May 31, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
69 changes: 69 additions & 0 deletions promptsource/templates/xquad/xquad.ar/templates.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
dataset: xquad
subset: xquad.ar
templates:
9f65fb49-4dc8-40b8-bd7f-107d78b5c296: !Template
answer_choices: null
id: 9f65fb49-4dc8-40b8-bd7f-107d78b5c296
jinja: "{{context}}\n\u0628\u0646\u0627\u0621 \u0639\u0644\u0649 \u0645\u0627\
\ \u0648\u0631\u062F \u0641\u064A \u0627\u0644\u0633\u064A\u0627\u0642 \u0623\
\u0639\u0644\u0627\u0647 {{question}} ||| \n{{answers[\"text\"][0]}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- Squad
original_task: true
name: answer_the_question
reference: ''
a6fcd1c6-766d-4383-bc24-0f027881adb5: !Template
answer_choices: null
id: a6fcd1c6-766d-4383-bc24-0f027881adb5
jinja: "{{context}}\n\u0633: {{question}}\n\u0627\u0644\u0625\u062C\u0627\u0628\
\u0629 \u0627\u0644\u0635\u062D\u064A\u062D\u0629 \u0628\u0646\u0627\u0621 \u0639\
\u0644\u0649 \u0645\u0627 \u0648\u0631\u062F \u0641\u064A \u0627\u0644\u0642\
\u0637\u0639\u0629 \u0623\u0639\u0644\u0627\u0647.||| {{answers[\"text\"][0]}}\n"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- Squad
original_task: true
name: answer_given_context_and_question
reference: ''
b0db8e5c-25c8-4331-bb54-1b95755c8606: !Template
answer_choices: null
id: b0db8e5c-25c8-4331-bb54-1b95755c8606
jinja: "\u0627\u0642\u0631\u0623 \u0627\u0644\u0642\u0637\u0639\u0629 \u0627\u0644\
\u062A\u0627\u0644\u064A\u0629 \u062B\u0645 \u0623\u062C\u0628 \u0639\u0646\
\ \u0645\u0627 \u0648\u0631\u062F\n{{context}}\n{{question}} |||\n{{answers.text[0]}}\n"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- Squad
original_task: true
name: read_passage
reference: ''
ceb0cb46-bc84-43c3-aa54-b78766180074: !Template
answer_choices: null
id: ceb0cb46-bc84-43c3-aa54-b78766180074
jinja: "\u0623\u0637\u0644\u0639 \u0639\u0644\u0649 \u0627\u0644\u0646\u0635 \u0627\
\u0644\u062A\u0627\u0644\u064A \u062B\u0645 \u0623\u062C\u0628 \u0639\u0646\
\ \u0627\u0644\u0633\u0624\u0627\u0644 \u0627\u0644\u0645\u0637\u0631\u0648\u062D\
\n\u0627\u0644\u0646\u0635: {{context}}\n\u0633\u0624\u0627\u0644: {{question}}\n\
|||\n{{answers[\"text\"][0]}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- Squad
original_task: true
name: answer_question_given_context
reference: ''
e0a38584-49a6-4a07-92e4-c29a2d03a403: !Template
answer_choices: null
id: e0a38584-49a6-4a07-92e4-c29a2d03a403
jinja: "{{context}}\n\u0633: {{question}}\n\u062C: ||| {{answers[\"text\"][0]}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- Squad
original_task: true
name: given_context_answer_question_variation
reference: ''
12 changes: 12 additions & 0 deletions promptsource/templates/xquad/xquad.en/templates.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -100,3 +100,15 @@ templates:
original_task: true
name: given_context_answer_question_variation
reference: ''
f3d9ac66-1188-40d4-9ac9-17e0af50b788: !Template
answer_choices: null
id: f3d9ac66-1188-40d4-9ac9-17e0af50b788
jinja: "Read the following passage and answer the question that follows: \n{{context}}\
\ \n{{question}}\n||| {{answers.text[0]}}"
metadata: !TemplateMetadata
choices_in_prompt: false
metrics:
- Squad
original_task: true
name: read_passage
reference: ''