I’m guessing it’s going to be a system where a company like Spotify doesnt let you upload generated music unless it has the metadata from the “legal” music generators so they can automatically send most of the profits to the shareholders.

Universal already owns Udio, Suno will follow soon. I wish it was an actual tax.

I’m surprised they didn’t blame Biden.

Not really. We had collage and training any kind of AI was fine before all this. There’s blood in the water and copyright companies can smell it.

OpenAI is happy to give them a piece of the pie if that means they are the only ones allowed to sell it to consumers.

You are right about the penalty being pennys compared to their profits. It’s not meant to punish them but help them build a moat, the one that got destroyed by China a few months ago.

Best case scenario but that’s not the one we will be getting.

Copyright juggernauts and data brokers, the ones that actually own all the data like Reddit and universal records, will get paid.

Open weight models won’t be allowed in business contexts or to be served online, OpenAI and company get a fat monopoly which suits them.

People are cheering for their own doom. The handful of big AI company are going to end up owning a solid chunk of the economy. It’s basically going to be an AI tax.

You will be replaced by an agent, OpenAI will only sell them to your employer in bulk at a stupid price so you can’t turn around and compete. That bulk price per agent will still be cheaper than your monthly wage.

Find me one politician that even mentioned forcing these models public. It’s a fantasy.

Facebook in one ear and chatgpt in the other. We are doomed.

I think his point was that apple would abuse it, like they are already doing. Good thing if implemented properly, bad thing if implemented the apple way.

“Bring out the LLM torture machine”

That’s not what’s happening here though.

Recently, people have used AI to release sub mods of SFO: Grimhammer III that work with updated versions of the main

It’s people building mods that need his framework from what I understand, not contributing to his codebase with it. No harm done except to his ego.

Crazy to get downvoted just for pointing out the guy didn’t even read the article. Get a grip.

The inference cost doesn’t actually drop in reality.

My comment was about this which is just completely wrong.

OpenAI is the scummiest company on earth but everyone is ready to believe them when they say shit like "our 20$ plan lets you run up the equivalent of a billion dollars in API fees. Giggles. It’s a good plan for you but not for us ;) "

The main thing bringing up costs is stuff like Sam Altman spending all the “inference” money on raw wafers just to strangle consumer GPU sales.

It’s not a good business model because of how cheap inference actually is. Once you have open models and the moat is broken, the only thing left to do is regulatory capture, upping the demand for the hardware and little charades like these.

Because of the massive investments into datacenters. Why is everyone so quick to drink the kool-aid. They are spending stupid amounts of money to capture the market and force everyone into a subscription service, not because it cost money to actually run the models. They are all switching their models to fine tuned quants after the first two weeks as well.

The open source community has found dozens of ways to lower costs, do you really think these big companies aren’t using the same tricks and haven’t developed even more advanced techniques?

There are constantly new techniques being developed to speed up inference or reduce model size post training. There’s about a hundred different levers to pull that play on inference cost, and some of them don’t have much of an impact on quality.

In the end, it’s probably simply because of competition. I don’t understand why everybody assumes they are running these at cost API wise.

Edit: here’s a chart from ars technica. The cost of revenue is clearly lower than the actual revenue. They aren’t running inference at a lost or it would be higher. They aren’t profitable because they are spending all that money on capturing the market as quick as they can. For fucks sake, that includes all the free accounts as well running inference. How can anyone think a paying customer is getting it at less than cost?

And yes, there have been advancement made. The cost of inference isn’t some static number that can never go down. Stop believing them when they tell you there’s no profit to be made. It’s the same playbook as a dozen other companies, they literally get rewarded for it when it comes tax time.

Valve is developing support for Nvidia so it shouldn’t be long. That being said, you might get more than it’s original price for the rtx card. If you ever want to mess around with local AI, an rtx is better for it so there is that to think about but it might not be an issue.