BYTESLIP ← Back
Knowledge Base // Tutorial 112

Screen-Context Recipes: Menus, PDFs, YouTube, and Settings

Difficulty: Easy ~12 min Pixel · Samsung

Once Ask about screen is turned on, the useful part is knowing what to ask. These are practical prompts for a menu, a PDF, a YouTube video, and a Settings page — the surfaces Google and Samsung actually mention — plus what not to upload.

Four screen-context recipe cards Four labeled tiles: Menu, PDF, YouTube, and Settings. MENU PDF YOUTUBE SETTINGS
Checklist // Before You Start

What You Need

Heads Up

This is the overlay, not Live screen share

These recipes use the Gemini overlay chips (Ask about screen, Ask about page, Ask about video, and similar). That is different from sharing the whole screen inside Gemini Live, and it is different from attaching a photo inside the Gemini app. Google says chips appear when you open Gemini over some apps, videos, or files — not every screen. This guide does not use Gems; Google is removing Gems on personal accounts on December 17, 2026.

Walkthrough // Steps 01–06

Open the Screen, Then Ask Something Specific

Open the overlay over the menu, PDF, video, or Settings page — not the Home screen. On a Galaxy, use a swipe up from a bottom corner (if your navigation setting offers it) or “Hey Google.” Opening the full Gemini app replaces the screen you want to ask about, so use the overlay.

  1. Step 1: Turn on the overlay and Screen context

    If you have not already: set Google as the default digital assistant at Settings > Apps > Choose default apps > Digital assistant app (if your labels differ, search Settings for “digital assistant”), make sure the Gemini app is installed and signed in, and turn on both Screen context toggles. The full path is in Ask Gemini About What’s on Your Android Screen.

    Samsung documents a Side button press-and-hold for Gemini on some Galaxy devices, but it is not on every model — on a Galaxy Tab A9+ the Side button only offers a double press, with no long-press assistant option. Don’t rely on it. Use a swipe from a bottom corner (if available) or “Hey Google” so Gemini opens as an overlay over the app you want to ask about.

  2. Step 2: Menus: prices, substitutions, and allergens

    Open a menu — a photo in your gallery, a restaurant’s webpage, or a PDF specials sheet. Open the Gemini overlay over it, tap the Ask about chip, then try a prompt that has a job:

    What’s vegetarian on this menu, and what does each dish cost if a price is shown?
    Which items mention peanuts, shellfish, or gluten? Quote the menu; don’t invent ingredients.
    Translate the specials into English, and list any chili or spice words you can see.
    If this is a poke or plate-lunch menu, list the proteins and side choices that are actually printed.

    If the menu is a printed page in a dim room and the overlay cannot see it well, take a still photo and open that photo instead — or use Live camera, as in Use Gemini Live and Guided Vision Outdoors on Hawaiʻi Island. Still check allergens yourself if you have a serious allergy.

  3. Step 3: PDFs: summaries, phone numbers, and trail stats

    Open the PDF in your usual viewer (Drive, Files, or a browser), stay on the page you care about, then open the overlay. Google’s screen-actions article mentions files as well as apps and videos. Try:

    Summarize this page in plain language, in six short bullets.
    What phone number, address, and hours are actually printed here?
    List every trail name and mileage that appears on this page. If a number is unclear, say so.
    What’s the required gear or the closure date, if this PDF states one?

    Good uses on Hawaiʻi Island: a park flyer, a permit page, a tide or event PDF you already downloaded. Do not upload a PDF that has someone else’s ID, a medical form, or a password.

  4. Step 4: YouTube: tools, locations, and a short outline

    Start the video, then open Gemini over it. Samsung’s Gemini help, written for a Galaxy phone or tablet, shows Ask about this video or Ask about video, and gives examples such as making a list of locations and saving it as a note. Samsung also notes that if a video shows a Closed Caption symbol, you can transcribe it to Samsung Notes — that is a Samsung example, not a promise that every video will transcribe.

    List the tools or ingredients the presenter actually names.
    List the locations mentioned, in order, and say if a map is shown.
    Give me a 5-bullet outline of this segment, without inventing steps I haven’t reached yet.
    What warning or disclaimer appears on screen or in the captions?

    Play a short, ordinary public video first if the chip does not appear on a music video or a DRM-restricted stream. Google only promises chips over some videos.

  5. Step 5: Settings: explain a toggle, don’t expose secrets

    Open the Settings page you are stuck on — for example Apps > Choose default apps, or a battery screen — then open the overlay:

    What do the options on this screen actually change? Use only what’s visible.
    Where, on this screen, would I change the default digital assistant?
    This battery warning is on my screen. What is it telling me, in plain language?

    Never open the overlay over a lock screen, a password field, a 2FA code, a payment form, or an email full of personal details. If you are cleaning up assistant defaults, Switch Gemini Back to Google Assistant on Android and Manage Special App Access on Android are safer written walkthroughs than asking Gemini to tap things for you.

  6. Step 6: If a chip is missing, test a public webpage

    Work through the checklist in the earlier Ask about screen guide: Gemini is the assistant, both Screen context toggles are on, and you opened the overlay over the content (not only the full Gemini app). Then try a regular public webpage. Google does not publish a full list of apps that hide the chip.

    Try the chip over a few everyday surfaces: a restaurant webpage or menu photo, a PDF, a YouTube video, and a Settings page. Official chip names include Google’s “Ask about screen,” “Ask about page,” and “Ask about…,” and Samsung’s “Ask about this video” / “Ask about video”; the exact words may vary. Google says chips appear over “some” apps, videos, or files and does not publish an exception list. If Settings, a given PDF, or another surface never shows a chip, attach a screenshot in the Gemini app instead, or skip that surface.

Pro Tip

Ask for a quote, not a guess

Keep Reading
Sources // Verified

Official docs

Ask about screen / Ask about page, default assistant, and Screen context toggles: Gemini Apps Help 14554984. Screen-action chips, auto-submit, Intelligent Screen Context, and “some apps, videos, or files”: 15850607. Pixel Help chip names: Pixel Help 15283615. Samsung Ask about video and Side button (phone or tablet): ANS10013120.

← All Tutorials Byteslip Apps