Project NOMAD: Running LLMs Locally From a USB Drive
Yeah, you heard it right, man. We’re gonna use a flash drive — yes, a literal flash drive — to run a Local LLM , or simply an Offline AI. All you need is a flash drive and a decent laptop. No graphics card? I gotchu, man. And believe me, whether you have a graphics card or not, it will work even on a potato PC . :) Also, if you do have a graphics card, congratulations — you just unlocked the peak lvl. since your graphics card will take a lot of the load off the RAM itself. :D Also, please don’t judge me. This is my first post here. I’m just doing some stuff to gain attention and complete my college assignment. T-T Now, for the first step, open your laptop and grab a flash drive (btw, when was the last time you touched grass, brotha?? Just curious :D). Now, connect the flash drive to your laptop and format it. Before doing that, make sure you select exFAT as the file system. Refer to Fig. 1 and Fig. 2 for that. Make sure the flash drive is empty before formatting it, or u will lose al...