Microsoft is set to revolutionize Windows by incorporating generative AI, as unveiled during its annual Build developer conference. Introducing a new lineup called Copilot+ PCs, Microsoft aims to integrate AI-powered features deeply into the Windows 11 experience. These PCs, equipped with dedicated NPUs (neural processing units), promise enhanced capabilities like Recall, which helps users easily locate previously accessed apps, files, and content.

Volumetric Apps and Meta Quest Integration

In partnership with Meta, Microsoft is bringing Windows Volumetric Apps to Meta Quest headsets, enabling spatially aware, interactive VR applications. These apps will allow developers to extend their creations into 3D space, making them more immersive. During the conference, a demonstration showcased an exploded 3D view of an Xbox controller from the perspective of a Meta Quest 3 headset, manipulable within the VR environment. Developers can sign up for a preview to access Microsoft’s new volumetric API, further enhancing the potential of these VR apps.

Copilot+ PCs: AI-First Hardware

The Copilot+ PCs are designed to be AI-centric, featuring Qualcomm’s Snapdragon X Elite and Plus chips, which offer impressive battery life—up to 15 hours of web browsing and 20 hours of video playback. These devices start at $999, with some models available for preorder. Major manufacturers like Acer, Asus, Dell, HP, Lenovo, and Samsung are also on board to produce these AI-enhanced machines, with Intel and AMD also committed to building processors for Copilot+ devices.

New Surface Devices: Performance and Battery Life

Microsoft’s latest Surface devices, including the Surface Laptop and Surface Pro, focus on performance and extended battery life. The redesigned Surface Laptop, available with 13.8-inch or 15-inch displays, offers up to 22 hours of battery life, supports Wi-Fi 7, and features a haptic feedback touchpad. The new Surface Pro, up to 90% faster than its predecessor, sports an OLED HDR display, Wi-Fi 7, optional 5G connectivity, and an upgraded ultrawide front-facing camera. The detachable keyboard now includes haptic feedback and reinforced carbon fiber for added durability.

Recall Feature in Windows 11

The forthcoming Recall feature in Windows 11 can remember apps and content accessed weeks or months ago, making it easier for users to find previously viewed content. Recall uses natural language processing to create associations between colors, images, and other contextual information, ensuring user data remains private and stored locally. Microsoft emphasizes that all data associated with Recall is kept on-device and not used to train AI models.

Enhanced Image Editing and Live Translations

New AI features include Super Resolution, which can upscale old photos, and Copilot’s ability to analyze images for creative suggestions. A feature called Cocreator allows users to generate images and modify them based on their drawings. Live Captions with live translations will support around 40 languages, translating any audio passing through a PC. Microsoft Edge will also offer real-time video translation on various platforms, including LinkedIn, YouTube, Coursera, and more.

Read also: The UAE Soars with Falcon 2: A Game-Changer in AI!

Team Copilot and Developer Extensions

Team Copilot integrates with Microsoft Teams to manage meeting agendas, take notes, and co-author documents. It also extends to Microsoft’s collaboration platforms, Loop and Planner, to create tasks, track deadlines, and notify team members when input is needed. Copilot Extensions, now in private preview, allow developers to extend GitHub Copilot with third-party apps and skills, enhancing productivity across Microsoft’s ecosystem.

Windows Copilot Runtime

The Windows Copilot Runtime, comprising approximately 40 generative AI models, powers features like Recall and Super Resolution. This runtime, along with the semantic index—a vector-based system local to each Copilot+ PC—allows AI-powered apps to function without needing an internet connection. This ensures a seamless and responsive user experience.

Upgraded Developer Tools and New AI Models

Microsoft’s Azure AI Studio now offers pay-as-you-go inference APIs, allowing developers to create apps using generative AI models. The Copilot Studio product suite introduces Copilot agents, AI bots that can independently orchestrate tasks and navigate business workflows. Qualcomm’s new Snapdragon Dev Kit for Arm-chip-packing Copilot+ PCs, priced at $899.99, provides developers with robust tools, including the Snapdragon X Elite chip, 32GB of RAM, and support for up to three 4K monitors.

Phi-3 AI Model and Khan Academy Partnership

Microsoft announced Phi-3-vision, a generative AI model capable of visual analysis and reasoning tasks. Phi-3-vision can read both text and images, making it versatile for various applications. In collaboration with Khan Academy, Microsoft will donate cloud compute infrastructure to enhance AI-powered educational tools for U.S. educators, aiming to improve math tutoring through generative AI.

These advancements highlight Microsoft’s commitment to making Windows an AI-first operating system, offering powerful tools and features that enhance user experience and developer capabilities.

Source: BlogTech