cm0002@ttrpg.network to Technology@lemmy.zipEnglish · 8 months agoMicrosoft just open-sourced bitnet.cpp, a 1-bit LLM inference framework. It let's you run 100B parameter models on your local CPU without GPUs. 6.17x faster inference and 82.2% less energy on CPUs.github.comexternal-linkmessage-square5linkfedilinkarrow-up128arrow-down16
arrow-up122arrow-down1external-linkMicrosoft just open-sourced bitnet.cpp, a 1-bit LLM inference framework. It let's you run 100B parameter models on your local CPU without GPUs. 6.17x faster inference and 82.2% less energy on CPUs.github.comcm0002@ttrpg.network to Technology@lemmy.zipEnglish · 8 months agomessage-square5linkfedilink
minus-squareEpicFailGuy@lemmy.worldlinkfedilinkEnglisharrow-up13arrow-down2·8 months agoLOLOLOL I registered the bitnet.dev domain for my home lab … should I sell it? Microsft … ring me up, let’s talk money
LOLOLOL I registered the bitnet.dev domain for my home lab … should I sell it?
Microsft … ring me up, let’s talk money