Google Circle to Search 101: getting started w/ it; how it works.
Here's how to get started w/ Google Circle to Search fast.
i. Google Circle Search is a feature that allows users to search anything on their Android phone with a simple gesture. It is powered by GPT-4, a large language model that can generate natural language based on the data it was trained on, and DALL-E, an image synthesis model that can create images based on text prompts.
Google Circle Search works by analyzing the user's gesture and the content on the screen, and then generating a search query that matches the user's intent. The search query can be a combination of words and images, depending on the user's selection and input. The search results are then displayed as an overlay on the screen, without interrupting the user's current app or activity.
Here are some of the steps involved in how Google Circle Search works:
- The user activates Google Circle Search by long-pressing the home button or navigation bar on their Android phone. A Google search bar appears at the bottom of the screen, and a message says, "Circle or tap anywhere to search."
- The user selects an item on the screen that they want to search for, by drawing a circle around it, drawing a line through it, scribbling over it, or tapping it. The gesture is recognized by GPT-4, which uses natural language understanding to interpret the user's intention and context.
- The selected item is processed by DALL-E, which uses computer vision and image synthesis to extract the features and attributes of the item, and generate a corresponding image representation. The image representation is then combined with the user's gesture and input to form a search query.
- The search query is sent to Google, which uses its search engine algorithms and databases to retrieve the most relevant and useful results for the user. The results can include web pages, images, videos, news, maps, and more.
- The results are displayed as an overlay on the screen, with the selected item highlighted and the search query shown at the top. The user can swipe left or right to see more results or related images, or swipe up to see the full Google search page. The user can also type more words or questions in the search bar to refine or expand the search query.
- The user can swipe the search overlay away and get back to what they were doing. The feature will not interrupt the user's current app or activity. The user can also access the recent searches and results from the Google app or widget.