Skip to content

v0.3

Compare
Choose a tag to compare
@kuprel kuprel released this 07 Jul 18:51
· 82 commits to main since this release
  • added is_reusable parameter. Turning it off saves memory (e.g. for command line script) and keeping it on makes multiple calls to generate_image faster
  • added log2_k parameter to control top-k image token sampling
  • added log2_supercondition_factor parameter to control the super conditioning amount
  • added log2_mid_count and generate_image_stream to stream intermediate outputs. Incomplete tokens are detokenized to an image multiple times during the decoding process. This adds very little time to the overall run time
  • added dtype parameter to autocast operations to float32, float16, or bfloat16
  • a grid size of 8x8 now generates in 35 seconds on an A100