Social

Meta Connect 2024: Orion glasses, Quest 3S headset, Meta AI upgrades, Ray-Ban Meta real-time video, and more

Comment

Meta Connect 2024 is a developer-centric event featuring a keynote from CEO Mark Zuckerberg. He showcased new hardware and software to support two of Meta’s big ambitions: AI and the metaverse. This included everything from new Quest headsets, updates to Meta’s Llama AI model, and even a new fully AR glasses prototype.

Meta Connect 2024 kicked off live at 10 a.m. PT Wednesday, September 25. You can watch the archive via Meta Connect’s site, on Meta’s developer Facebook page, and you can still dive into Horizon Worlds from your Meta Quest headset if you really want to feel the full immersion.

We’ll be compiling all of the announcements and reveals out of Meta Connect 2024 below and will keep it updated throughout the event and after as more reactions and analysis arrive.

Meta reveals Orion, “the most advanced glasses the world has ever seen”

Meta's Orion Holographic Glasses, battery pack and wristband
Image Credits: Meta

In a surprise announcement, Zuckerberg dramatically revealed Orion, which Meta says will eventually become the company’s “first consumer full holographic AR glasses,” though they won’t be arriving on any consumers’ faces anytime soon. Touting Orion’s light weight, compatibility for hand-tracking and eye-tracking, and most ambitiously, a neural interface, Zuckerberg also touted some impressed, and famous, early testers (including Nvidia CEO Jensen Huang). The Orion glasses were presented as the future of Meta’s AR efforts, with our own ongoing coverage of Meta Connect’s final big reveal here.

Meta Orion Holographic Glasses
We see that TechCrunch logo, Meta 👀
Image Credits: Meta

Meta’s Quest 3S headset launches for $299

Image Credits: Meta

Meta’s reveal of the Quest 3S was indicated by several pre-event leaks and confirmed during Connect 2024. The Meta Quest 3S comes as a less expensive alternative to the Quest 3, starting at $299 for a 128GB version and 256GB for $399. The entirely wireless headset is compatible with the existing library of Quest apps and games, though Meta was particularly enthusiastic about its mixed-reality features. With the reveal of the Quest 3S, the Quest 3 will drop from $649 to $499. Get our early impressions of the new Quest 3S here ahead of its October 15 ship date.

Quest 2, Quest Pro discontinued

“With Quest 3S on the shelf, we’re officially winding down sales of Quest 2 and Pro. We’ll be selling our remaining headsets through the end of the year or until they’re gone, whichever comes first,” Meta told TechCrunch about the discontinuation of two of their headsets in the wake of the Quest 3S announcement.

Meta AI gets vocal

Image Credits: Meta

Meta AI is finding its voice. Users can ask a question or otherwise chat with Meta AI out loud through Messenger, Facebook, WhatsApp, and Instagram and get simulated vocal responses in return. The digital voice assistant will roll out with multiple voice options to choose from, including the AI voices of celebrities like Dame Judi Dench, John Cena, Awkwafina, Kristen Bell, and Keegan-Michael Key.

The reveal comes a day after OpenAI announced the long-awaited rollout of its Advanced Voice Mode feature, with a new look and five new voices. And speaking of vocal announcements, Zuckerberg touted that Meta AI now has 500 million users.

Meta’s Llama 3.2 AI model released

Meta Llama 3.2
Image Credits: Meta

Meta’s multilingual Llama family of models has reached version 3.2, signifying that several Llama models are now multimodal. Llama 3.2 11B and 90B can interpret charts and graphs, caption images, and pinpoint objects in pictures given a simple description.

Llama 3.2 11B and 90B might be able to look at a map of a park and tell you how long a certain path is, or when the terrain could become steeper. Or, provided a graph showing a company’s revenue over the course of a year, the models can quickly spotlight the best-performing months of the bunch.

Notably, Llama 3.2 11B and 90B can’t be accessed in Europe due to the EU’s Act restrictions. As a result, several Meta AI features available elsewhere, like image analysis, are disabled for European users.

Ray-Ban’s Meta sunglasses get real-time AI video and reminders

Image Credits: Meta

Ray-Ban’s Meta smart glasses are getting upgrades as the company continues to try and make the case that the smart glasses can become the next big consumer device. At the forefront of the pitch is the addition of real-time AI video processing, which lets you to ask the Ray-Ban Meta glasses questions about what it can see in front of you.

The sunglasses will also be getting a smartphone-like reminder feature; live language translation between English and French, Italian, or Spanish; and full integration with music streaming apps like Amazon Music, Audible, and iHeart Radio.

Yes, we know what Zuckerberg’s shirt says

Mark Zuckerberg, seen during Meta Connect 2024
Screenshot
Image Credits: Meta /

Zuckerberg’s evolution into a self-made fashionista was on full display during Meta Connect, with a shirt that spelled out: “Act Zuck aut nihil,” which for those not well versed in Latin, translates to “either Zuck or nothing.” The phrase is originally associated with Roman Emperor Julius Caesar, further cementing Zuckerberg as a Rome Guy.

Image Credits: Meta

In a feature that will be familiar to anyone following OpenAI, Google, and Apple’s application of image-based searches, Meta showcased its AI’s capacity to respond to prompts based on images, as well as edit photos provided to the AI based on feedback given by the user. It can also share them to Instagram Stories.

More AI in your Facebook feeds

Image Credits: Meta

If you’re on Facebook, you’ve probably seen a lot of AI recently, knowingly or unknowingly. There’s an entire nascent industry around using it to generate engagement bait. Earlier this month, the label noting whether content has been edited using Meta’s tools was shrunk down. And now Facebook will actually pitch you on AI content that it generates for you that it thinks you’ll want to share or engage with.

Tests for translated, dubbed content from creators

Image Credits: Meta

Going a step beyond just translating captions, Meta announced a test that would use its AI translation tools to take creator content, create a translated dub, and sync the creator’s lips accordingly. So far, the experiment is limited to creator videos made in the U.S. and Latin America, with translations between English and Spanish.

In what ended up being a surreal moment, Zuckerberg brought on creator Don Allen Stevenson III for a conversation on the stage, which then turned into a demo during which Zuckerberg interviewed an AI version of Stevenson while the real deal was right beside him.

Image Credits: Meta

Meta’s new VR pitch for mobile devs

Amid the big AI reveals and hardware and announcements, Meta did dive into the broader purpose of Connect — building ties with its community of developers. As it continues to pitch developers on helping build out the Quest app store’s offerings, Meta released new support for Android apps on the Quest, along with support for 3D and spatial apps.

Batman, Wordle, and the rest of the games announcements

A number of new experiences were revealed for the Quest ecosystem at Meta Connect 2024, led by Batman: Arkham Shadow, which launches October 22 and will also be bundled with new Quest 3 and 3S purchases until April of next year. Beyond games with familiar concepts like Alien: Rogue Incursion for Xenomorph-filled horror and a remake of the zombie game Arizona Sunshine, Wordle of all things was announced for the Quest. The VR version of the daily puzzle will be free to play without a New York Times subscription.

More TechCrunch

The company recently closed a $130 million round, according to an SEC filing, bringing the total to $327 million.

Zap Energy investors in recent $130M round included Soros Fund and Laurene Powell Jobs’ Emerson Collective

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! I’ve been…

Uber snags another robotaxi deal, aviation startups land VC bucks, and where Rivian Foundation money is going

That lack of user interaction — or request for consent — is what confused and concerned some former Kaspersky customers.

Kaspersky defends force-replacing its security software without users’ explicit consent

The world of WordPress, one of the most popular technologies for creating and hosting websites, is going through a very heated controversy. The core issue is the fight between WordPress…

The WordPress vs. WP Engine drama, explained

Featured Article

Tesla Superchargers: GM, Ford, Rivian, and other EV brands with access

EV owners of GM vehicles like the Chevrolet Silverado EV and Cadillac Lyriq will now officially have access to Tesla’s Superchargers.

Tesla Superchargers: GM, Ford, Rivian, and other EV brands with access

Despite hydrogen’s challenges, BMW thinks the only way to actually achieve a shift to zero-emissions transportation is through a mix of BEVs and hydrogen vehicles.

BMW says we need both battery and hydrogen EVs for a zero-emissions future

Google’s NotebookLM has been updated with YouTube and audio files as new source types and sharable links for Audio Overviews.

Google’s NotebookLM enhances AI note-taking with YouTube, audio file sources, sharable audio discussions

EVA, the platform that connects event bookers with local performers, has secured $2 million in funding as the popularity of in-person events comes back in full force. The round, which…

EVA, an entertainment booking platform for events, raises $2M as it expands to more cities 

The idea here is to bring a subscription-based app in-house to serve as a testing ground for RevenueCat’s new features.

Subscription management platform RevenueCat acquires a ‘spicy’ audiobooks app (??!!)

We’re thrilled to announce that the agenda for our dedicated AI Stage presented by Google Cloud to TechCrunch Disrupt 2024 is complete and ready to go! It joins fintech, SaaS,…

Announcing the final agenda for the AI Stage at TechCrunch Disrupt 2024

Meta Connect 2024 is a developer-centric event featuring a keynote from CEO Mark Zuckerberg. He showcased new hardware and software to support two of Meta’s big ambitions: AI and the…

The health insurance giant is investigating an incident that allegedly leaked sensitive customer medical data.

India’s Star Health says it’s investigating after hacker posts stolen medical data

We’re in the final stretch of Ticket Reboot Week with just 48 hours remaining! You can still save up to $600 on individual ticket types to TechCrunch Disrupt 2024. Don’t…

2 days left to save up to $600 on TechCrunch Disrupt 2024 tickets

A new female-founded dating app called After is launching in Austin, Texas, on Thursday with the mission of tackling ghosting and holding people accountable.  What sets the app apart from…

After is a new dating app that tries to tackle ghosting

The Tor Project is merging operations with Tails, a portable Linux-based operating system focused on preserving user privacy and anonymity.

The Tor Project merges with Tails, a Linux-based portable OS focused on privacy

A company that claims its tech can “revolutionize” emergency calls has raised $27 million in a Series B round led by Andreessen Horowitz. The company, Prepared, enables 911 dispatchers to…

Prepared, which wants to ‘revolutionize’ emergency 911 calls, raises $27M

A new Dealroom report shows that VC investment in defense-related tech is outpacing any other type of investment across NATO member states and allies. 

As war rages in Ukraine, investment in European defense and dual-use tech skyrockets

Peak XV Partners, the largest India-focused venture fund, has realized about $1.2 billion in exits since it separated from Sequoia last year.

Peak XV has reaped $1.2B in the year since it split from Sequoia

WordPress drama went up another notch on Wednesday after WordPress.org banned hosting provider WP Engine from accessing its resources.

WordPress.org bans WP Engine, blocks it from accessing its resources

Marvel Fusion is one of several companies pursuing what’s known as inertial confinement fusion.

Marvel Fusion lands $70M for laser-powered fusion bet

OpenAI’s chief research officer, Bob McGrew, and a research VP, Barret Zoph, left the company on Wednesday, hours after OpenAI CTO Mira Murati announced she would be departing. CEO Sam…

OpenAI’s chief research officer has left following CTO Mira Murati’s exit

Japan has always been a strong market for bringing technology into the experience of consuming food, and now one of the startups leading on this idea is attracting investors from…

Dinii, a cloud-based restaurant management platform, raises $45M Series B

When seed-focused Pear VC raised a $432 million fund last year, the firm co-founder Pejman Nozad said that it meant his firm had reached its “own product-market-fit.” That fourth fund…

Pear wants to empower up-and-coming VCs with its new emerging managers in residence program

Unsurprisingly, AI companies dominated the day, with startups looking to apply the technology to problems like estate planning and automating clinical trial data.

13 companies from YC Demo Day 1 that are worth paying attention to

Following the abrupt departure of OpenAI’s CTO, Mira Murati, CEO Sam Altman is reportedly poised to receive equity in the company for the first time as OpenAI moves away from…

Sam Altman reportedly poised to get equity in OpenAI for the first time

The demo showcased AI Studio, a platform for designing custom chatbots.

Zuckerberg chats with AI clone as human creator looks on in year’s weirdest demo

Three years ago, Mark Zuckerberg’s big day was a flop. At his company’s annual developer conference — then called Facebook Connect — he unveiled his grand plans to turn his…

What does Mark Zuckerberg’s shirt say?

Meta says it’s working to make it easier for mobile developers to make the shift to Meta’s Horizon OS.

Meta pitches VR to mobile developers with new support for Android apps on Quest

The decision comes just a few weeks before OpenAI’s Dev Day, its annual developer conference.

OpenAI CTO Mira Murati says she’s leaving the company

The Meta Quest 3S is up for preorder Wednesday. It starts shipping October 15.

Meta announces $300 Quest 3S, a cheaper take on mixed reality