Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
AlphaEvolve verifies, runs and scores the proposed programs using automated evaluation metrics. These metrics provide an objective, quantifiable assessment of each solution’s accuracy and quality.
Yeah, that’s the way genetic algorithms have worked for decades. Have they figured out a way to turn those evaluation metrics directly into code improvements, or do they just keep doing a bunch of rounds of trial and error?
The general framework for evolutionary methods/genetic algorithms is indeed old but it's extremely broad. What matters is how you actually mutate the algorithm being run given feedback. In this case, they're using the same framework as genetic algorithms (iteratively building up solutions by repeatedly modifying an existing attempt after receiving feedback) but they use an LLM for two things:
-
Overall better sampling (the LLM has better heuristics for figuring out what to fix compared to handwritten techniques), meaning higher efficiency at finding a working solution.
-
"Open set" mutations: you don't need to pre-define what changes can be made to the solution. The LLM can generate arbitrary mutations instead. In particular, AlphaEvolve can modify entire codebases as mutations, whereas prior work only modified single functions.
The "Related Work" (section 5) section of their whitepaper is probably what you're looking for, see here.
We gotta use up as much fresh water for cooling as we can. 🤷♂️
Can't wait for my boss to come up with half a working solution with this and expect me to fix/finish it!
What is deep mind?
It’s just the name of Google’s AI division.
It used to be a separate company. They're the ones who did AlphaZero and AlphaFold too, kind of a big deal at the time.
Yeah, in typical Google fashion they used to have two deep learning teams: Google Brain and DeepMind. Google Brain was Google's in-house team, responsible for inventing the transformer. DeepMind focused more on RL agents than Google Brain, hence discoveries like AlphaZero and AlphaFold.
AlphaFold still a big deal, was big part of reason behind recent Nobel Prizes. Used (and misused) by a lot of scientists.