Apple Intelligence and new spatial experiences have arrived for Apple Vision Pro today with visionOS 2.4.
With the new Spatial Gallery app, users have access to a curated collection of spatial content spanning art, culture, nature, sports, and more. visionOS 2.4 also introduces the Apple Vision Pro app for iPhone to help users easily find new content and apps, and enhancements to Guest User make sharing Vision Pro experiences even easier.
With Writing Tools, users can refine their words by rewriting, proofreading, and summarizing text nearly everywhere they write, including Mail, Notes, and many third-party apps. With Rewrite, users can adjust the tone of their text to make it more friendly, professional, or concise, or specify the change they’d like to make using Describe Your Change. Proofread checks grammar, word choice, and sentence structure, and provides suggested edits. Users can also select text and have it recapped in several formats with Summarize. With Compose, users can ask ChatGPT to generate content for anything they are writing about from the systemwide Writing Tools.
Image Playground allows users to easily create fun and unique images from themes, costumes, accessories, and places. Users can add their own text descriptions, and can even create images in the likeness of a family member or friend using photos from their photo library. The experience is integrated directly into apps like Messages and Freeform, and is also available as a dedicated app for Apple Vision Pro.
Smart Reply in Messages and Mail provides suggestions for a quick response, and will identify questions to ensure everything is answered.
With natural language search in the Photos app, it’s even easier to find a specific photo or moment in a video just by describing it. Create a Memory Movie lets users create the movies they want to see by simply typing a description. Using language and image understanding, Apple Intelligence will pick out photos and videos based on a user’s description, craft a storyline with chapters based on themes identified from the photos, and arrange them into a movie with its own narrative arc.
Apple Intelligence uses on-device processing whenever possible to protect users’ privacy. For requests that require access to even larger models, Private Cloud Compute extends the privacy and security of Apple products into the cloud to unlock even more intelligence. When using Private Cloud Compute, users’ data is never stored or shared with Apple; it is used only to fulfill the request. Independent experts can inspect the code that runs on Apple silicon servers to continuously verify this privacy promise, and are already doing so.
Curated Spatial Content with Spatial Gallery
Spatial Gallery, a new app for Apple Vision Pro, features spatial photos, spatial videos, and panoramas curated by Apple, and gives users a window to captivating and powerful moments spanning art, culture, entertainment, lifestyle, nature, sports, and travel, with new content released regularly.
At launch, users can discover stories and experiences from iconic brands including Red Bull, Cirque du Soleil, and Porsche; go behind the scenes with Apple Originals like Severance, The Studio, and The Morning Show; and listen to conversations with top artists like Bad Bunny, Charli xcx, and Keith Urban.