• 2 Posts
  • 7 Comments
Joined 2 years ago
cake
Cake day: April 27th, 2024

help-circle



  • Hah, you can watch my site: https://nowsci.com/ as I put everything there.

    I’m very nearly at daily usable by everyone, including my partner who has a very different accent to mine. A lot of it was tuning sentences/words to catch poor STT to skip going to an LLM to speed things up and make it reliable. Here’s the current hardware in action:

    @[email protected] yes, Ive tried a lot of LLMs and have settled on Gemma 4 2b with a very specific prompt and local MCP tools for unit conversions, weather, lookups, etc.

    For Q&A, my current build uses an MCP container I made to do a SearXNG search and top result retrieval for context (I use a trick to weight Wikipedia results). The final step I haven’t completed is for this to be a backup to Kiwix, for which I also haven’t found a great search tool/index/MCP, so if you want to collab on that I’d be interested. One less thing for me to build myself ;)