Beepo 22B llama.cpp performance comparison on Vulkan between thine 780M/MI50/TeslaM40
Subscribers:
42
Published on ● Video Link: https://www.youtube.com/watch?v=KH410LRaXr4
780M has 12 Navi 3 CUs and 128bits DDR5.
MI50 has 60 Vega CUs and 4096bits HBM2.
Tesla M40 has 384bit GDDR5 and Idk SMs (3072 cores)
Newish llama.cpp from upload date running on Vulkan (Slackware current/6.12 kernel + 570 nvidia) 570.