Ray-Ban Meta smart glasses received two new artificial intelligence (AI) features on Monday. The first is Live AI which adds real-time video processing capabilities to Meta AI and allows chatbots to continuously observe the user’s surroundings and answer questions about them. The second is Live Translate that lets AI translate speech in real-time in supported languages. The latter was also demonstrated by CEO Mark Zuckerberg during Connect 2024. These are being offered first to members of Meta’s Early Access program in Canada and the US.
The tech giant says that the two new AI features coming to the Ray-Ban Meta smart glasses are part of the v11 software update for the smart glasses that is now rolling out to eligible devices.
Live AI will let Meta AI access the cameras in the smart glasses and continuously process the video feed in real time. This is similar to ChatGPT’s Advanced Voice with Vision feature recently released by OpenAI. The company highlighted that during a session, the AI can continuously see what the user sees, and interact with it more naturally.
Users will be able to talk to Meta AI without saying the “Hey Meta” activation phrase. Additionally, users can ask follow-up questions as well as reference points discussed earlier in the session, according to the company.
They can also change topics and go back to previous topics easily. “Finally, live AI will provide useful suggestions, at the right time, even before you even ask,” the post continued.
Live Translate provides real-time speech translation between English and Spanish, French or Italian languages. So, if a user is talking to someone who speaks one of those three languages, Meta AI can translate them in real time and generate translated audio through the glasses’ open-ear speakers. Is. Users can also view the translation as a transcription on their smartphone.
The tech giant warns that these new features may not always be perfect and that it will continue to take user feedback and improve the AI features. At present, there is no information on when these features will be released to all users globally. Meta has not released any of these AI features in India yet.
