GPU prices are coming to earth just as RAM costs shoot into the stratosphere
arstechnica.com
Some RAM kits are over three times as expensive as they were three months ago.
  • krooklochurm@lemmy.caEnglish
    11·
    7 天前

    So… the models are all trained up and now they need to run them is what I’m reading.

    You need lots of vram to train a model.

    An llm once trained can be run in much less vram and a lot of ram