By default, Meta provided us with top_p sampler only. Again, Shawn added an alternative top_k sampler, which (in my tests) performs pretty well. If you wish to switch to top_k sampler, use the following parameters:
By default, Meta provided us with top_p sampler only. Again, Shawn added an alternate top_k sampler, which (in my tests) performs pretty well. If you wish to switch to top_k sampler, use the following parameters: