WIP: Update outlines (and outlines prompts) and transformers versions #256
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
@eveenhuis @jadie1 @barry-ravichandran FYSA
This is a WIP, but wanted to draw attention to some of the changes that need to be made for the latest outlines version. Specifically:
Theoutlines.pomptdecorate has been removed, now the guidance is to use theoutlines.Template.from_stringfunction.outlines.Template.from_stringwe also need to change how these templates are invoked wherever they're used, and that's scattered around several algorithms; not worth) future templates should strongly considering using this new approach thoughsamplerhas been removed from outlines, instead inference control parameters are just passed through to whatever backend is loading / serving the model (so for determinstic sampling using transformers as the model provider we would setdo_sample=Falsein thegeneration_kwargs)