AI and You Against the Machine: Guide so you can own Big AI and Run Local - YouTube
LocalLLaMA
6
Posts
4
Posters
1
Views
-
wrote last edited by [email protected]
I've been following the work that went into this video for a couple of months and have grown to love Level1Techs.
Check out their forum and especially Ubergarm
-
I've been following the work that went into this video for a couple of months and have grown to love Level1Techs.
Check out their forum and especially Ubergarm
Ok, what machine is it? DL;dw
-
Ok, what machine is it? DL;dw
-
Oh, so an NVIDIA card with 24GB VRAM
-
Oh, so an NVIDIA card with 24GB VRAM
Yep, and 2x64gb RAM
-
I've been following the work that went into this video for a couple of months and have grown to love Level1Techs.
Check out their forum and especially Ubergarm
wrote last edited by [email protected]This is an excellent guide, way above most YT guides. ik_llama.cpp is a small miracle, and its a crime so few know of it.