How to Use ElevenLabs ElevenAI: The New AI Teammate from the November 2026 Summit

On 11 November 2026, ElevenLabs walked onto a stage in New York and announced it was no longer just a voice company. The summit brought 13 new products and upgrades, headlined by ElevenAI — a new app that listens to your meetings and turns them into notes, summaries and action items. CEO Mati Staniszewski framed the shift bluntly: conversational agents, he said, would become "critical infrastructure for every enterprise, as essential as cloud or payments" within a few years.

That is a big claim. But the announcements behind it are concrete, and they point in one direction: voice AI is moving out of the recording studio and into the workplace. This guide explains what ElevenAI is, what else was announced at the summit, and how you can actually use ElevenLabs' tools today.

What Is ElevenAI?

ElevenAI is ElevenLabs' new AI teammate app. Instead of generating a voice, it listens to one. You bring it to a meeting — including an in-person meeting, not just a video call — and it captures the conversation, then produces structured notes, a summary and a list of action items.

Think of it as the difference between a recorder and a colleague. A recorder gives you a transcript you still have to read. A teammate hands you the decisions, the open questions and who agreed to do what. That is the promise ElevenLabs is making: you leave the meeting with the work already organised.

The app opened in free early access alongside the announcement, so anyone can try it now. ElevenLabs has not announced a final price, and it would be a mistake to assume early access pricing will stay free forever — but there is no cost to getting started today.

ElevenAgents Gets Memory and Routines

ElevenAI does not stand alone. It sits on top of ElevenAgents, ElevenLabs' platform for building conversational AI agents, which gained two important upgrades at the summit: memory and routines.

Memory means an agent can remember context across conversations — a returning customer does not have to repeat their history, and a support agent can pick up where the last interaction ended. Routines let an agent follow repeatable workflows on its own: checking a status, sending a follow-up, or escalating a case when a condition is met.

Together, these move agents from answering questions to doing ongoing work. For a support team, that could mean an agent that resolves routine queries end to end. For a sales team, it could mean an agent that follows up on leads and books meetings without a human in the loop. The practical test is always the same, though: does the agent handle the edge cases gracefully, or does it create more work than it saves? Early adopters should measure that before rolling agents out widely.

Custom Models Tuned on Your Own Data

The most ambitious announcement — and the one to treat most carefully — is custom models. ElevenLabs will let businesses fine-tune models on their own data, so an agent speaks with the company's terminology, tone and knowledge instead of generic responses.

Here is the honest picture:

• Custom models are rolling out to selected enterprises first, with a wider release expected "in the coming months".
• Pricing has not been disclosed, and there is no general sign-up available today.
• If you run a small team or work solo, this announcement does not change what you can buy right now — it signals where the platform is heading.

That matters because fine-tuning is where generic AI becomes genuinely useful for a specific business. A support agent trained on your actual help-centre articles and past tickets will answer very differently from one working off a general model. Enterprises that get early access will have a head start; everyone else should plan around the standard platform until the wider rollout arrives.

The Interaction Engine and Scribe v3 Medical

Two more announcements round out the platform story. The Interaction Engine is ElevenLabs' system for orchestrating conversations — managing turn-taking, interruptions and multi-step exchanges so an agent feels less like a menu and more like a conversation. If you have ever talked over a voice bot and watched it fall apart, you know why this matters.

Scribe v3 Medical is a speech-to-text model built for healthcare, tuned to recognise medical terminology accurately. It targets clinics, hospitals and health-tech companies that need reliable transcripts of consultations and dictation. Accuracy in this setting is not a nice-to-have: a misheard drug name or dosage is a safety issue, so a domain-specific model is a meaningful step — though, as with any medical tool, it needs proper validation before it touches real patient workflows.

The NVIDIA Deal and the Partner Marketplace

The summit also expanded ElevenLabs' partnership with NVIDIA. NVIDIA's Nemotron 3.5 Super VL model is now available inside ElevenAgents, giving developers a powerful open model option within the platform rather than being locked to a single provider's models.

For most users, the NVIDIA news is background rather than a buying decision. It matters most to teams building agents, who now get more choice in the models powering their deployments. The broader signal is about scale: ElevenLabs reports more than 550 partners across 44 countries, and the partner Marketplace around its platform keeps growing. The company is clearly positioning itself as infrastructure — a platform other businesses build on — rather than a single-purpose tool.

How to Use ElevenAI and ElevenLabs Today: A Practical Workflow

Announcements are useful only if you can act on them. Here is a practical way to use what is available right now.

Step 1: Try ElevenAI in free early access

Sign up for ElevenAI's free early access and bring it to your next meeting. Start with an internal meeting rather than a client call — that way you can check the quality of the notes and action items before trusting it with anything important. Review the output the same day: are the action items accurate, and did it miss any decision?

Step 2: Hand the follow-up work to an AI agent

ElevenAI captures the meeting; the next question is who does the work the meeting creates. That is where a general-purpose AI agent earns its place. Manus AI is an AI agent that does work rather than just answering questions — research, analysis, content creation, data processing and planning. Take the action items from your ElevenAI notes and hand them to Manus: research a topic the meeting raised, draft the report you promised, analyse the numbers, or plan the next steps. One tool listens; the other gets things done.

Step 3: Give your agents live web data

An agent is only as useful as the information it can reach. If your research needs current web data — competitor pages, market prices, fresh articles — an agent working from memory alone falls short. Apify is the web scraping and automation platform that acts as the data layer for agentic workflows: it lets agents browse, scrape and automate the web at scale, so an agent's research is built on live data, not guesswork. Pair it with Manus AI when a task needs up-to-date information from real websites, or to automate repetitive research you would otherwise do by hand.

Task	Tool	What it does
Meeting notes and action items	ElevenAI (free early access)	Listens to meetings and produces notes, summaries and action items
Research, analysis and planning	Manus AI	General-purpose AI agent: research, analysis, content creation and planning
Live web data and automation	Apify	Web scraping and automation — the data layer AI agents run on

Step 4: Set a weekly review habit

AI meeting notes are only useful if someone reads them. Pick one fixed time each week to review the week's action items from ElevenAI, close the finished ones, and carry the rest forward. The tool does the capturing; the habit does the follow-through.

Who Should — and Shouldn't — Switch Yet

ElevenAI is worth trying now if you spend a lot of time in meetings, run a small team that needs shared notes, or create content from conversations — podcasters and interviewers will find the transcript-to-content path especially useful.

Hold off on big changes if your main interest is custom models. They are enterprise-first, the rollout is months away for most businesses, and pricing is undisclosed. There is no reason to restructure a workflow around a product you cannot buy yet.

Be cautious if your meetings involve sensitive information. Any tool that listens to conversations needs a clear policy: tell participants it is running, check your company's rules on recording, and confirm where the audio is processed and stored before using it with clients.

The realistic position for most people is in the middle: try ElevenAI for free, keep using the proven voice tools for content work, and revisit custom models when the wider rollout arrives.

Frequently Asked Questions

Is ElevenAI really free? It opened in free early access with the summit announcement. ElevenLabs has not announced final pricing, so treat early access as a free trial window rather than a permanent free tier.

When will ElevenLabs custom models be available to everyone? Selected enterprises get them first, with a wider rollout expected in the coming months. There is no public sign-up or price yet.

Does ElevenAI work for in-person meetings? Yes — ElevenLabs describes it as listening to spoken conversations including in-person meetings, not only video calls.

What does the NVIDIA partnership change for regular users? Very little directly. It mainly gives developers building on ElevenAgents a stronger open model option in Nemotron 3.5 Super VL. The bigger signal is ElevenLabs' push toward enterprise infrastructure.

Do I need an AI agent like Manus AI to use ElevenAI? No. ElevenAI is a separate app with its own free early access. Manus AI is a general-purpose AI agent for research, analysis and planning — a different job, and a useful next step once ElevenAI hands you action items to carry out.

Conclusion

The November 2026 summit marks a clear turn for ElevenLabs: from a voice-generation tool into a platform for AI teammates that listen, remember and act. ElevenAI is the headline, and it is genuinely available to try today in free early access. The custom models, the memory and routines in ElevenAgents, and the NVIDIA integration show where the platform is going, but most of that future is still rolling out.

The sensible next step is a small one: try ElevenAI at your next meeting, check the quality of its notes, and if you want to see what an AI agent can do with the work those notes create, take a look at Manus AI on ProAccess.me. The meeting notes will tell you quickly whether an AI teammate earns its place in your workflow.