VMware
A Journey with Llama3 LLM: Running Ollama on Dell R730
A Journey with Llama3 LLM: Running Ollama on Dell R730 Server with Nvidia P40 GPU & Web UI Interface
#Journey #Llama3 #LLM #Running #Ollama #Dell #R730
“Mukul Tripathi”
Join me on an exhilarating journey into the realm of AI! 🌟 In this video, I’ll personally guide you through the process of setting up Ollama, powered by the groundbreaking Llama3 model from Meta AI, all on my trusty Dell R730 server. With the computational acceleration of the Nvidia P40 GPU…
source
To see the full content, share this page by clicking one of the buttons below |
![[WatchParty] Aoo sath me dekhte hai VCSA || omen](https://server.vpnwp.com/wp-content/plugins/wp-fastest-cache-premium/pro/images/blank.gif "[WatchParty] Aoo sath me dekhte hai VCSA || omen")
Very nice vidéo !
What happens when you download the 70b llama LLM file and try to put this 40BG file into the 8GB VRAM on your GPU ? Does it work ?
I am asking because I tried to use the 70b LLM on my CPU, and despite having 32GB of RAM it was not enough 🙂
Informative video!!