Even if you don’t know much about the inner workings of generative AI models, you probably know they need a lot of memory.