GPT-5 will take AI forward in these two important ways
https://www.digitaltrends.com/computing/gpt-5-advance-ai-in-two-important-ways-memory-reasoning/
GPT-5 will take AI forward in these two important ways
https://www.digitaltrends.com/computing/gpt-5-advance-ai-in-two-important-ways-memory-reasoning/
1 Comment
1. The ability to recall context from past conversations
2. Improved reasoning to solve more complicated problems
“It’s sort of weird right now that you have these interactions with agents and the memory is entirely episodic,” he lamented. “You have a transaction, you do a thing. It’s useful or not for whatever task you were doing, and then it forgets all about it.” The AI system isn’t learning from or even remembering previous interactions with the user, he continued. “There’s no way for you to refer back to a thing you were trying to get [the AI] to solve in the past.”
———-
“Scott was also buoyant about improving the “fragility” found in the reasoning of many AI systems today. “It can’t solve very complicated math problems,” he explained. “It has to bail out to other systems to do very complicated things.”
“Reasoning, I think, gets a lot better,” he continued. He compares [GPT-4](https://www.digitaltrends.com/computing/study-shows-a-downturn-in-openais-gpt-4-response-quality/) and the current generation of models to high schoolers [passing their AP exams](https://www.businessinsider.com/list-here-are-the-exams-chatgpt-has-passed-so-far-2023-1). However, the next generation of AIs “could be the thing that could pass your qualified exam.””