Get more done with Gemini: Try 1.5 Pro and more intelligent features (2024)

Gemini

May 14, 2024

[[read-time]] min read

We’re bringing Gemini 1.5 Pro to Gemini Advanced subscribers in over 35 languages, along with a 1 million token context window, a new conversational experience and tools that let Gemini take action on your behalf.

Sissie Hsiao Vice President and General Manager, Gemini experiences and Google Assistant

General summary

Gemini, your AI assistant, is getting even smarter with a longer context window, new data analysis capabilities, and connections to more Google apps. Gemini 1.5 Pro, available to Advanced subscribers, can now handle up to 1 million tokens, making it the longest context window of any widely available consumer chatbot. You can upload files via Google Drive or your device for in-depth analysis, and Gemini will soon act as a data analyst, creating visualizations and charts from uploaded data. New ways to interact with Gemini include chatting in Google Messages and a mobile conversational experience called Live, which uses state-of-the-art speech technology for more natural conversations.

Summaries were generated by Google AI. Generative AI is experimental.

Get more done with Gemini: Try 1.5 Pro and more intelligent features (2)

Gemini is designed to be your personal AI assistant — one that’s conversational, intuitive and helpful. Whether you use it in the app or through the web experience, Gemini can help you tackle complex tasks, and it can take action on your behalf.

Now, we’re making several updates — including a longer context window, new data analysis capabilities, connections to additional Google apps and more customizable options — so you can collaborate with the most intelligent and personalized Gemini yet.

Analyze documents with the world’s longest context window

Today we’re bringing Gemini 1.5 Pro, our cutting-edge model, to Gemini Advanced. Over 1 million people have signed up to try Gemini Advanced in just three months. And now Gemini 1.5 Pro brings you our latest technical advances, including a greatly expanded context window starting at 1 million tokens — the longest of any widely available consumer chatbot in the world. A context window this long means Gemini Advanced can make sense of multiple large documents, up to 1,500-pages total, or summarize 100 emails. Soon it will be able to handle an hour of video content or codebases with more than 30,000 lines.

To take advantage of this long context window, we’re adding the ability to upload files via Google Drive or directly from your device, right into Gemini Advanced. Now you can quickly get answers and insights about dense documents, like figuring out the details of the pet policy in your rental agreement or comparing key arguments of multiple long research papers. And soon, Gemini Advanced will act as a data analyst, uncovering insights and building custom visualizations and charts on the fly from uploaded data files like spreadsheets.

Gemini keeps your files private to you, and they’re not used to train our models.

Gemini is natively multimodal, and 1.5 Pro brings big improvements to image understanding. For example, you can snap a photo of a dish at your favorite restaurant and ask for a recipe, or take a picture of a math problem and get step-by-step instructions on how to solve it — all from a single image.

Gemini 1.5 Pro will be available to Gemini Advanced subscribers in more than 150 countries and over 35 languages.

Have more natural conversations with Gemini Live

We’re also adding new ways to interact with Gemini more naturally, whether you’re texting or talking. With Gemini in Google Messages, you can now chat with Gemini in the same app you message your friends.

And in the coming months, we’re rolling out Live for Gemini Advanced subscribers, a new mobile conversational experience that uses our state-of-the-art speech technology to make speaking with Gemini more intuitive. With Gemini Live, you can talk to Gemini and choose from a variety of natural-sounding voices it can respond with. You can even speak at your own pace or interrupt mid-response with clarifying questions, just like you would in any conversation.

Let’s say you’re getting ready for a job interview: Just go Live and ask Gemini to help you prepare. Gemini can rehearse with you, and even suggest skills to highlight when talking to your potential employer. Later this year you’ll be able to use your camera when you go Live, opening up conversations about what you see around you.

Take the hassle out of making complex plans, like trip itineraries

Sometimes you spend more time researching and organizing a trip than enjoying the trip itself. Gemini Advanced’s new planning experience will go beyond showing a list of suggested activities to create a custom itinerary just for you.

Imagine you ask Gemini: “My family and I are going to Miami for Labor Day. My son loves art and my husband really wants fresh seafood. Can you pull my flight and hotel info from Gmail and help me plan the weekend?”

This prompt requires Gemini to do so much more than present publicly available information like other chatbots. Gemini takes into account your flight timing, meal preferences and information about local museums, while also understanding where each stop is located and how long it will take to travel between each activity. It grabs your flight information from Gmail, taps Google Maps for restaurant and museum recommendations near your hotel, and uses Search to recommend other activities, like a walking tour of the Design District or beach time, to fill out the rest of your day. It synthesizes all that information for you and creates a personal, customized itinerary that satisfies all your requests. And if you make changes or add more details, the itinerary will update automatically.

This dynamic new planning experience is coming to Gemini Advanced in the coming months.

Personalize Gemini with Gems

For an even more personal experience, Gemini Advanced subscribers will soon be able to create Gems — customized versions of Gemini. You can create any Gem you dream up: a gym buddy, sous chef, coding partner or creative writing guide. They’re easy to set up, too. Simply describe what you want your Gem to do and how you want it to respond — like “you're my running coach, give me a daily running plan and be positive, upbeat and motivating.” Gemini will take those instructions and, with one click, enhance them to create a Gem that meets your specific needs.

Connect with more Google apps

Last year we brought Extensions directly into Gemini, allowing you to get more things done with the Google apps and services you already use. We’ve continued to bring Google apps to Gemini, like the YouTube Music Extension rolling out now. With Gemini, you can search for your favorite music even if you don't know the song title by mentioning a favorite verse or a featured artist.

Soon, we’ll connect even more Google tools with Gemini, including Google Calendar, Tasks and Keep. So you’ll be able to do things like snap a picture of your child’s school syllabus and ask Gemini to create a calendar entry for each assignment, or take a photo of a new recipe and add it to your Keep as a shopping list.

With these updates, many of which are coming to our business customers too, you’ll get the most personal and helpful experience with Gemini yet — all from a single prompt.

Look out for these new features soon, and start chatting with Gemini today.

Collection Collection I/O 2024 Here’s a look at everything we announced at Google I/O 2024. See more

Get more done with Gemini: Try 1.5 Pro and more intelligent features (4)

Get more done with Gemini: Try 1.5 Pro and more intelligent features (5)

Get more done with Gemini: Try 1.5 Pro and more intelligent features (6)

Get more done with Gemini: Try 1.5 Pro and more intelligent features (7)

Done. Just one step more.

Check your inbox to confirm your subscription.

You are already subscribed to our newsletter.

You can also subscribe with a .

POSTED IN:

Get more done with Gemini: Try 1.5 Pro and more intelligent features (2024)
Top Articles
Latest Posts
Article information

Author: Van Hayes

Last Updated:

Views: 6237

Rating: 4.6 / 5 (66 voted)

Reviews: 89% of readers found this page helpful

Author information

Name: Van Hayes

Birthday: 1994-06-07

Address: 2004 Kling Rapid, New Destiny, MT 64658-2367

Phone: +512425013758

Job: National Farming Director

Hobby: Reading, Polo, Genealogy, amateur radio, Scouting, Stand-up comedy, Cryptography

Introduction: My name is Van Hayes, I am a thankful, friendly, smiling, calm, powerful, fine, enthusiastic person who loves writing and wants to share my knowledge and understanding with you.