Morgan Stanley thinks GPT-5 is already being trained in secret

[funkervogt]

A screenshot of an internal report is here:


Morgan Stanley thinks GPT-5 has 25,000 GPUs.

[Jakob]

Did I miss something? What happened to GPT-4?

[peekpok]

I am also confused, perhaps that was a typo in the article? I would expect them to be training GPT-4.

[Ozzie guy]

This makes a lot of sense. If they have made GPT-4 yet don't want to release it yet why not start working on GPT-5.
I remember being hyped when I heard DeepMind was working on Gato 2 but I really should have been thinking "No shit, its not like making AI is hobby where they can be burnt out, it's their job. They are basically forced to start working on the next model after the previous one is finished."

[peekpok]

Hmm.. well I'm sure there is work on a post-GPT-4 architecture that has improvements that can't be integrated into GPT-4 this late into its development. But I don't know what to make of the statement "we think GPT-5 is being run on $200m worth of GPUs." What is their source to even make that claim?

Presumably GPT-5 is still in the stage of doing small scale experiments and evaluating its strengths and weaknesses. I don't even think GPT-4 has maybe had its most expensive training runs yet because if it did then it would probably be "finished" by now.

[Jakob]

Maybe they're doing fibonacci numbers and the next one will be GPT-8, GPT-13, GPT-21...

[firestar464]

https://twitter.com/davidtayar5/status/ ... 7547595776

It's not a typo.

[peekpok]

With the surprise release of GPT-4 this week I have to take back what I said. It was also revealed that GPT-4 has existed for quite a while and various industry insiders were playing with it behind the scenes for the past several months. Additionally I've been seeing people say that bing Chat is powered by GPT-4 and not GPT-3.5 as previously thought. If that is all true, then it makes sense that GPT-5 is well into development already.

[wjfox]

OpenAI’s CEO confirms the company isn’t training GPT-5 and ‘won’t for some time’

Apr 14, 2023, 1:28 PM GMT+1

CEO Sam Altman quashed rumors that OpenAI is already developing GPT-5. However, the comments likely won’t be of much consolation to those worried about AI safety.

https://www.theverge.com/2023/4/14/2368 ... sam-altman

[Doozer]

We just got GPT 4o. I don't think GPT 5 will be out for a while yet.

[firestar464]

https://archive.is/k2SuH

It's supposed to come out mid-year, though who knows anymore

[Doozer]

We just got GPT-4o, so I won't bet on GPT-5 coming out any time soon .

[Cyber_Rebel]

Interesting theory... we can reasonably assume that GPT-5 (Next?) will be multimodal from the ground up just like GPT-4o is: