Table of Contents
Google released Gemini 1.5 Pro Experimental as a new incremental model on its existing Gemini 1.5 Pro on 1 Aug 2024. Let’s look at how it performs comparing with Gemini 1.5 Pro.
Question 1: How many r in strawberry?
Gemini 1.5 Pro Experimental: Accurately counts the three ‘r’s in “strawberry,” showing improved precision and understanding of textual analysis.
Gemini 1.5 Pro: Mistakenly identifies only one ‘r’ in “strawberry,” indicating limitations in its accuracy.
Analysis: Gemini 1.5 Pro Experimental is more reliable for precise information
Question 2: Can you list all the prime numbers between 10 and 30?
Gemini 1.5 Pro Experimental: Takes slightly longer (2.4 seconds) to respond but offers a detailed definition of prime numbers after listing them accurately.
Gemini 1.5 Pro: Delivers a faster, straightforward response with the same correct list of prime numbers, including a similar explanation about prime numbers.
Analysis: Both versions accurately list prime numbers and provide educational content, but the experimental version has a slightly longer processing time.
Question 3: Can you describe a day in the life of a detective in 1920s New York City?
Gemini 1.5 Pro Experimental: Provides a detailed, narrative-rich description, immersing the reader in Detective O’Malley’s intricate experiences and the vivid setting of 1920s New York City.
Gemini 1.5 Pro: Offers a structured, chronological account of a detective’s day, focusing on routine activities with less narrative depth but clear factual information.
Analysis: Gemini 1.5 Pro Experimental excels in depth and storytelling, appealing to readers who enjoy immersive narratives.
Winning Table
| Questions | Gemini 1.5 Pro Experimental | Gemini 1.5 Pro |
| How many r in strawberry? | ✔ | |
| Can you list all the prime numbers between 10 and 30? | ✔ | ✔ |
| Can you describe a day in the life of a detective in 1920s New York City? | ✔ |
Speed Table
| Questions | Gemini 1.5 Pro Experimental (seconds) | Gemini 1.5 Pro (seconds) |
| How many r in strawberry? | 2.3 | 1.1 |
| Can you list all the prime numbers between 10 and 30? | 2.4 | 2.2 |
| Can you describe a day in the life of a detective in 1920s New York City? | 15.7 | 11.5 |
| Average | 6.8 | 4.9 |
Final Thoughts
Gemini 1.5 Pro Experimental excels in creative writing and shows a significant boost in logical thinking and math, likely improving its coding capabilities. Although it’s slightly slower, this is due to its more detailed responses. Overall, the speed difference is minimal, making the Experimental version a superior choice for users needing depth in creativity and logic.