GPT-3 was an amazing accomplishment. However, the 175 billion parameters might be miniscule compared to GPT-4.

That could be 30 trillion.

If you want some insight into how rapidly AI research is advancing, here is a good article from Microsoft.

https://www.microsoft.com/en-us/research/blog/zero-infinity-and-deepspeed-unlocking-unprecedented-model-scale-for-deep-learning-training/

Posted Using LeoFinance ^Beta