How does DeepSeek R1 really fare against OpenAI’s best reasoning models?
It's only been a week since Chinese company DeepSeek launched its open-weights R1 reasoning model, which is reportedly competitive with OpenAI's state-of-the-art o1 models despite being trained for a fraction of the cost. Already, American AI companies are in a panic, and markets are freaking out over what could be a breakthrough in the status quo for large language models.
While DeepSeek can point to common benchmark results and Chatbot Arena leaderboard to prove the competitiveness of its model, there's nothing like direct use cases to get a feel for just how useful a new model is. To that end, we decided to put DeepSeek's R1 model up against OpenAI's ChatGPT models in the style of our previous showdowns between ChatGPT and Google Bard/Gemini.
This was not designed to be a test of the hardest problems possible; it's more of a sample of everyday questions these models might get asked by users.