Flores 101 prompts (#779)

* added first templates for DiaBLa dataset rbawden/DiaBLa

* declared previous_ref at beginning of templates

* declared more variables at beginning of templates

* declared more variables at beginning of templates

* declared more variables at beginning of templates

* declared more variables at beginning of templates

* corrected ref for mt in one template

* corrected ref for mt in one template

* moved condition to just target side rather than around entire prompt

* allow template even when no context (beginning of dialogue)

* corrected templates that use past history

* corrected multiple choice answer field

* updated templates - simplified some targets and added translation completion tasks (simpler?)

* updated templates - simplified some targets and added translation completion tasks (simpler?)

* corrected duplicate name

* updated duplicate definition

* corrected error of only two pipes in answer choices

* corrected -2 index to -1 - duplicate defintiions

* pulled new branch eval-hackathon & added diabla templates

* merged with eval-hackathon updates

* corrected discriminate mt ref

* removed directional templates and only keep both directions (analysis to be done separately later. Also some slight modifs such as removing excess words and quotes

* simplified names, changed random to choice

* added automatically generated prompts for flores-101 (all subset) - all possible BS language directions

* changed choice of template to one of the form: SRC: src_text = TRG: ||| trg_text

* style and format

* update with new prompt

Co-authored-by: Rachel Bawden <[email protected]@users.noreply.github.com>
Co-authored-by: Victor SANH <[email protected]>

Author: 3 people

promptsource/templates.py

@@ -27,16 +27,7 @@
 # These are users whose datasets should be included in the results returned by
 # filter_english_datasets (regardless of their metadata)
 
-INCLUDED_USERS = {
-    "Zaid",
-    "craffel",
-    "GEM",
-    "aps",
-    "khalidalt",
-    "shanya",
-    "rbawden",
-    "BigScienceBiasEval",
-}
+INCLUDED_USERS = {"Zaid", "craffel", "GEM", "aps", "khalidalt", "shanya", "rbawden", "BigScienceBiasEval", "gsarti"}
 
 
 def highlight(input):