Closed
Description
Background Description
Ref: #12791 (comment)
This won't be a simple renaming, but we also need to update some logic:
I'll do this after having the logits matching automated test. The problem is that changing name
n_swa
ton_pattern_aux
make the code checkingif (n_swa) then using SWA
becomes invalid. It should now becomeif (n_pattern_aux && is_swa) then use SWA
I think it's better to add an enum called
llama_mask_aux
having 3 values: none, swa, chunked ; so that the code will become more clear
Possible Refactor Approaches
Add enum llama_mask_aux
Metadata
Metadata
Assignees
Labels
No labels