DB LabsWhat Is Visual Intelligence on iPhone?
Visual Intelligence is an Apple Intelligence feature available on iPhone 16 and later that uses the Camera Control button to instantly identify objects, translate text, look up businesses, and get contextual information from what your camera sees. Press and hold the Camera Control button on the right side of your iPhone to activate it. Unlike taking a photo, Visual Intelligence processes the scene in real time using on-device AI through the A18 chip. It works with plants, animals, landmarks, products, restaurant menus, signs in foreign languages, and more.
Supported iPhone Models
Visual Intelligence requires the Camera Control button and A18 chip, which limits it to:
- iPhone 16 and iPhone 16 Plus
- iPhone 16 Pro and iPhone 16 Pro Max
- iPhone 17 (all models)
Older iPhones, including the iPhone 15 series, do not support Visual Intelligence. The standard Visual Lookup feature (long-press on a photo to identify objects) is still available on iPhone 12 and later, but it works only on photos you have already taken -- not in real time.
How to Activate Visual Intelligence
1 Locate the Camera Control Button
The Camera Control button is on the right side of your iPhone 16, below the power button. It is a capacitive button with a textured surface that responds to presses, light presses, and swipes.
2 Press and Hold
Press and hold the Camera Control button to open Visual Intelligence. A single click opens the Camera app, so make sure you hold the button long enough for the Visual Intelligence viewfinder to appear. The viewfinder has an animated border that indicates AI processing is active.
3 Point at What You Want to Identify
Aim your camera at the object, text, plant, animal, or landmark you want information about. Visual Intelligence overlays contextual cards on the screen with relevant details. Tap any card to expand it for more information.
What Visual Intelligence Can Do
Identify Plants and Animals
Point your camera at a flower, tree, insect, or animal. Visual Intelligence identifies the species and shows common name, scientific name, and key facts. This works offline using on-device models trained on millions of species.
Translate Text in Real Time
Point at a sign, menu, or document in a foreign language. Visual Intelligence overlays the translated text directly on the image, matching the original text's position and style. Download language packs in Settings > Translate > Downloaded Languages for offline use.
Look Up Businesses
Point at a restaurant, shop, or business sign. Visual Intelligence shows hours, ratings, phone number, and directions. This works by connecting to Apple Maps data and requires an internet connection.
Scan Products and Get Prices
Point at a product to see pricing information, reviews, and where to buy it. Visual Intelligence integrates with Apple's product recognition database and can compare prices across retailers.
Copy and Search Text
Point at any text to highlight and copy it instantly. You can also search the web for highlighted text, add a phone number to contacts, or open a URL -- all without taking a photo first.
Tips for Best Results
- Good lighting matters: Visual Intelligence works best in well-lit conditions. In low light, results may be less accurate, especially for plant and animal identification.
- Hold steady: Keep your iPhone still for a moment to let the AI process the scene. A brief pause produces more accurate results than sweeping the camera quickly.
- Get close for text: For text translation and copying, move close enough so the text fills most of the frame. Small or distant text may not be recognized accurately.
- Download language packs: If you travel frequently, pre-download the language packs you need. This ensures translation works even without an internet connection.
Organize Your Photo Library
Visual Intelligence helps you understand what is in your photos. Swype Photo Cleaner helps you decide which photos to keep. Together, they make managing thousands of photos fast and simple.
Free · iPhone · iOS 16+ · 100% on-device, zero uploads
Free · iPhone · iOS 16+