Pavan Davuluri says the rising cost of memory is why Windows 11 will use less RAM, with work on the memory manager, WinUI 3 and WebView2.
Pavan Davuluri says the rising cost of memory is why Windows 11 will use less RAM, with work on the memory manager, WinUI 3 and WebView2.
Hang on, how many surface pro owners are trying to run a local model i.e. local LLM on 8GB ram? I’ve got 32gb ram and it struggles with most larger models
Smaller models, probably.
https://tokencalculator.com/tools/llm-ram-calculator
Sure, but how many people who actually know how to install a local LLM are using it on a laptop with 8GB ram? I guess if they have an NPU it might help