(The Debrief is delivered monthly and included as part of your subscription to The Productivity Ping)
Hey friends - Google announced their latest Gemini AI model a few months back and since I (still) see a lot of confusion and misinformation online, here’s a quick overview of what Gemini is and what this announcement means for all of us.
Please share your feedback in the comments, especially if I get something wrong!
According to benchmarks released by Google, Gemini Ultra has better performance than OpenAI’s GPT-4:
According to benchmarks released by Microsoft, OpenAI’s GPT-4 has better performance than Gemini Ultra (if you use specific prompting techniques)
In my humble and technically un-informed opinion, benchmarks don’t mean shit compared to real-world usage.
These benchmarks are analogous to running a battery rundown test between the latest iPhone and the latest Samsung device under standardized conditions (charging them to full, closing down all apps, etc.)
We (consumers) would never actually use our phones that way, just like we’d never use Google Bard and ChatGPT under benchmark testing conditions.
Before the release of Gemini Ultra, I would still stick with ChatGPT for general purpose tasks and activities, because:
For tasks that require high factual accuracy, access to real-time data, access to Google applications, using Google Bard is a no-brainer:
Let me know if you have any questions in the comments!
Got feedback for this edition of The Debrief? Let me know!
Thanks for being a subscriber, and have a great one!