The Cost of Software
jeferson.me
Software is costly and mechanical parrots won't make it cheaper. Do you want to know why?

As we continue developing our software, we accumulate a growing amount of technical debt just to keep the system running. But I believe we are on the brink of an even larger issue. Cognitive debt.

Hope you enjoy this reading, all feedback is welcome.

  • fruitycoder@sh.itjust.worksEnglish
    1·
    1 day ago

    Not that I see either looking at opensource inference engines. vLLM supports setting the seed so if you have that you do, and maybe it’s just as simple as harness setting and recording that. At least for replay this request type of operation but that does not show where in model each random numbers would have been applied.