Ello Ello.
Can you recommend a program with which I can generate commit messages locally? I DO NOT want an LLM local or cloud API. What I want is a tiny or small language model. If I could easily swap or customize the model for each project, it would be better, too. So I could have smaller models for specific projects. I can do the training meself.
Thanks in advance!
You’re not wrong though, even 1GB is quite lot for writing commit messages, I gave it a quick go, and it takes around 15-30s to analyse a very small diff. Kinda silly for git messages.
Thanks for letting us know. Yeah sure. It’s not worth it. I personally take about 10s to write the commit message. So such a thing will just make it worse.
For shits and giggles, I had a go at writing a script that could rewrite all the commits in a branch with LLM generated commits. Couldn’t work out how to do the commit changing, tried cherry picking, but it doesnt work well for conflicts (had no idea that was possible). But, I can report timings at least.
On my M1 16GB macbook air, each commit was summarised in about 10s. So its a plausible approach if you just do all your commits, and then run a script to fix up the messages, go get a glass of water and you’ll come back to automatic messages.
If it’s of interest to you, I can share the script, its a starting point, but I am pretty ashamed of it :D