Flores 101 prompts #779
Merged
Flores 101 prompts #779
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…pletion tasks (simpler?)
…pletion tasks (simpler?)
… to be done separately later. Also some slight modifs such as removing excess words and quotes
|
Adding @fyvo for info |
VictorSanh
approved these changes
Jun 25, 2022
There was a problem hiding this comment.
looks good to me, thank you @rbawden !
(nice usage of anchors in yaml btw! :) )
I don't have a strong opinion on the format so will defer to the evaluation folks!
|
(Actually python seems to have dealt with that automatically since I created the templates automatically, so I won't take too much credit)! |
added 2 commits
June 29, 2022 20:25
…tsource into flores-101-prompts
|
thank you @rbawden for the fixes! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Automatically created prompts for MT using the Flores-101 dataset.
Contains prompts for all language directions using 31 BigScience languages (1 English prompt per language direction = 930 templates).
Question: is this format ok or should I separate out those that are for inclusion in the upcoming evaluation (i.e. only into and from English). This depends on how the notion of subtask is going defined and whether there is a possibility of selecting only certain templates.