this post was submitted on 16 Feb 2024
250 points (83.6% liked)
Technology
59534 readers
3195 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I think the idea of using natural language to generate video is flawed for the vast majority of applications we want. Imagine you could give a script to one of these models and have it output a TV show episode. While we can make these models deterministic it seems like the vast majority of generative content with some amount of quality requires the addition of random noise through the process. Should we want TV episodes whose visual quality and little details shift from model to model? Why not store a plain text description infered by some model and store the video component in a medium less prone to misinterpretation? We may use deep learning compression for videos and audio in the future if there are significant advancements but I doubt the compression will be to English.