minus-squareiceberg314@slrpnk.nettoGames@lemmy.world•AI Driving Game Players Are Burning Through So Many Tokens Its Developer Had to Take Out a Bank Loan to Keep It RunninglinkfedilinkEnglisharrow-up2·1 hour ago12GB is a lot of ram. By small local models I am talking about fine tuning something like < 2GB LLM linkfedilink
minus-squareiceberg314@slrpnk.nettoGames@lemmy.world•AI Driving Game Players Are Burning Through So Many Tokens Its Developer Had to Take Out a Bank Loan to Keep It RunninglinkfedilinkEnglisharrow-up74·1 day agoWhy can’t they just fine tune a small locally hosted model? Are they dumb? Most gamers have a GPU anyways linkfedilink
12GB is a lot of ram. By small local models I am talking about fine tuning something like < 2GB LLM