Technology

59534 readers

3223 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

Google DeepMind used a large language model to solve an unsolvable math problem (www.technologyreview.com)

submitted 11 months ago by yesman@lemmy.world to c/technology@lemmy.world

1 comments fedilink hide all child comments

The researchers started by sketching out the problem they wanted to solve in Python, a popular programming language. But they left out the lines in the program that would specify how to solve it. That is where FunSearch comes in. It gets Codey to fill in the blanks—in effect, to suggest code that will solve the problem.

A second algorithm then checks and scores what Codey comes up with. The best suggestions—even if not yet correct—are saved and given back to Codey, which tries to complete the program again. “Many will be nonsensical, some will be sensible, and a few will be truly inspired,” says Kohli. “You take those truly inspired ones and you say, ‘Okay, take these ones and repeat.’”

After a couple of million suggestions and a few dozen repetitions of the overall process—which took a few days—FunSearch was able to come up with code that produced a correct and previously unknown solution to the cap set problem, which involves finding the largest size of a certain type of set. Imagine plotting dots on graph paper. The cap set problem is like trying to figure out how many dots you can put down without three of them ever forming a straight line.

you are viewing a single comment's thread
view the rest of the comments

[–] yesman@lemmy.world -1 points 11 months ago

I thought this was interesting bc it's an instance where a LLM has done something undeniably novel and unique while expanding human understanding. It's a chink in the armor of the idea that a LLM is a "stochastic parrot" that can only regurgitate and never create.

I've been toying with this idea that LLM are showing us that what we thought of as creativity, learning, and problem solving aren't as rarefied as we thought. We know that AI isn't conscious, maybe consciousness isn't as prerequisite to behaviors and cognition as we thought.