Windows 11 will feature an AI search function for audio and video recordings

Windows 11 build 27695, which recently became available to Windows Insiders on the Canary channel, includes references to the Smart Media Search feature. This tool uses a locally running AI algorithm to scan all the words that appear in audio and video recordings stored on the user’s device.

Image source: Microsoft

The Smart Media Search feature is described as a tool that transcribes all audio files and videos on a user’s computer. In the future, the user will be able to use Windows search to find audio or video on the device based on the words contained in the recording. According to the source, this tool is currently not available in any test build of Windows 11. However, the appearance of references to the new feature indicates that smart media search may soon become available to Insiders.

«Search by spoken words in indexed audio and video files. By clicking “I agree”, you agree to the scanning of media files stored on your device. If necessary, the desired model will be downloaded and installed in the background. Once the AI ​​model is set up, it needs to decipher your media files and index them before they are added to content search. We’ll notify you once the setup process is complete,” reads the description of the Smart Media Search feature.

The new feature appears to be closely related to the Recall feature that will be available to Insiders in October. Recall uses locally running AI algorithms to record all user actions in applications, when viewing web content, etc. The data collected in this way is displayed on a timeline, which allows the user to easily find information of interest from the past and continue interacting with it. To run Recall, you will need a computer with Windows 11 and a powerful processor with a built-in neural coprocessor (NPU) to speed up artificial intelligence tasks.