Skip to content

Port of llama2.c to the Dreamcast (and potentially other consoles)

License

Notifications You must be signed in to change notification settings

sega-dreamcast/llama2c

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

llama2.c port for Sega Dreamcast

Here's a port of llama2.c port for Sega Dreamcast using TinyStories (262K parameters) models. Currently it makes use of FMAC/FSSRA along with other SH-4 specific optimizations, altho the benefits are somewhat small but noticeable :p.

If you want to replace the model with yours, you can go ahead and replace the model.bin/tok.bin files with yours in cd folder. Be warned that the Dreamcast only has 16MB and that larger models have a significant performance penalty (Tinystories 15M model would run at 1 tokens/s, Tinystories 262K is like 30x faster).

About

Port of llama2.c to the Dreamcast (and potentially other consoles)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C 98.7%
  • C++ 1.3%