this post was submitted on 06 Sep 2024
1726 points (90.1% liked)
Technology
61203 readers
4630 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Are the models that OpenAI creates open source? I don't know enough about LLMs but if ChatGPT wants exemptions from the law, it result in a public good (emphasis on public).
Nothing about OpenAI is open-source. The name is a misdirection.
If you use my IP without my permission and profit it from it, then that is IP theft, whether or not you republish a plagiarized version.
So I guess every reaction and review on the internet that is ad supported or behind a payroll is theft too?
No, we have rules on fair use and derivative works. Sometimes they fall on one side, sometimes another.
Fair use by humans.
There is no fair use by computers, otherwise we couldn't have piracy laws.
The STT (speech to text) model that they created is open source (Whisper) as well as a few others:
https://github.com/openai/whisper
https://github.com/orgs/openai/repositories?type=all
Those aren't open source, neither by the OSI's Open Source Definition nor by the OSI's Open Source AI Definition.
The important part for the latter being a published listing of all the training data. (Trainers don't have to provide the data, but they must provide at least a way to recreate the model given the same inputs).
They are model-available if anything.
I did a quick check on the license for Whisper:
So that definitely meets the Open Source Definition on your first link.
And it looks like it also meets the definition of open source as per your second link.
Model weights by themselves do not qualify as "open source", as the OSAID qualifies. Weights are not source.
This is not training data. These are testing metrics.
Edit: additionally, assuming you might have been talking about the link to the research paper. It's not published under an OSD license. If it were this would qualify the model.
I don't understand. What's missing from the code, model, and weights provided to make this "open source" by the definition of your first link? it seems to meet all of those requirements.
As for the OSAID, the exact training dataset is not required, per your quote, they just need to provide enough information that someone else could train the model using a "similar dataset".
Oh and for the OSAID part, the only issue stopping Whisper from being considered open source as per the OSAID is that the information on the training data is published through arxiv, so using the data as written could present licensing issues.
Ok, but the most important part of that research paper is published on the github repository, which explains how to provide audio data and text data to recreate any STT model in the same way that they have done.
See the "Approach" section of the github repository: https://github.com/openai/whisper?tab=readme-ov-file#approach
And the Traning Data section of their github: https://github.com/openai/whisper/blob/main/model-card.md#training-data
With this you don't really need to use the paper hosted on arxiv, you have enough information on how to train/modify the model.
There are guides on how to Finetune the model yourself: https://huggingface.co/blog/fine-tune-whisper
Which, from what I understand on the link to the OSAID, is exactly what they are asking for. The ability to retrain/finetune a model fits this definition very well:
All 3 of those have been provided.
From the approach section:
This is not sufficient data information to recreate the model.
From the training data section:
This is also insufficient data information and links to the paper itself for that data information.
Additionally, model cards =/= data cards. It's an important distinction in AI training.
Fine-tuning is not re-creating the model. This is an important distinction.
The OSAID has a pretty simple checklist for the OSAID definition: https://opensource.org/deepdive/drafts/the-open-source-ai-definition-checklist-draft-v-0-0-9
To go through the list of materials required to fit the OSAID:
Whisper does not provide the datasets.
The research paper is available, but does not fit an OSD-compliant license.
Whisper does not provide the technical report.
Whisper provides the model card, but not the data card.
The problem with just shipping AI model weights is that they run up against the issue of point 2 of the OSD:
AI models can't be distributed purely as source because they are pre-trained. It's the same as distributing pre-compiled binaries.
It's the entire reason the OSAID exists:
Edit: also the information about the training data has to be published in an OSD-equivalent license (such as creative Commons) so that using it doesn't cause licensing issues with research paper print companies (like arxiv)
OpenAI does not publish their models openly. Other companies like Microsoft and Meta do.