Multimodal AI that understands videos like humans

Bring human-like video understanding to any application, whether you have terabytes or petabytes of video.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15

from twelvelabs import TwelveLabs
import os



client = TwelveLabs(<"YOUR_API_KEY">)




# Create new Index
index = client.index.create(
        
name="My First Index",
        
engines=[
            
{

{
“search_pool”: {”total_count”: 178,
“total_duration”: 35194,
“index_id”: “64373b0cc1cb7a672614563e”
}
“data”: [
{
“score”: 85.68,
“start”: 10.71875,
“end”: 15.28125,
“metadata”: [
}
TWELVE LABS’ PRODUCTS

APIs to power intelligent video applications

'Classify' will no longer be available on Playground as of 11/25. Accessible via API until 2/28/2025.

GENERATE

Generate any text about your video through prompting

Generate accurate and insightful text about your videos through prompting, be it a summary, long and detailed reports, title suggestions, highlights, or chapters.
TECHNOLOGY

State-of-the-art video foundation models

Our models create rich video embeddings from video to power downstream tasks such as Search, Generate, and Embed.  

Raw video
Visual
Audio
Models
Marengo
Pegasus
Video embeddings
Video, audio, text, image files
Embed API
Multimodal embeddings
Zidane headbutting another player
Search API
Searched results clips
Summarize what happened in this video
Generate API
Generated text
Zidane headbutting another player
Search API
Searched results clips
Zidane headbutting another player
Search API
Searched results clips
Zidane headbutting another player
Search API
Searched results clips
Zidane headbutting another player
Search API
Searched results clips
Zidane headbutting another player
Search API
Searched results clips
Zidane headbutting another player
Search API
Searched results clips
Zidane headbutting another player
Search API
Searched results clips
Summarize what happened in this video
Generate API
Generated text
Youtube video categories
Classify API
Categorised video list
Video, audio, text, image files
Embed API
Multimodal embeddings
Zidane headbutting another player
Search API
Searched results clips
Summarize what happened in this video
Generate API
Generated text
OUR STRENGTH

State-of-the-art video understanding, out of the box

Deploy on any cloud, fine-tune with your own data, and deploy your custom model. We give you the keys to state-of-the-art AI that adapts to your specific needs.
World Class Accuracy

Recognized by leading researchers as the most performant AI for video understanding; surpassing benchmarks from cloud majors and open-source models.

Scale

Our models and infrastructure are built to handle the largest video libraries, capable of handling exabytes of data.

Customizable

Fine-tune our model to make it an expert in your content and domain. Deploy on the cloud, self-hosted cloud, or on-prem.

Secure and Private

Enterprise grade security, your data is secure and entirely yours. SOC2 compliant and soon to be ISO 27001 compliant.

OUR STRENGTH

State-of-the-art video understanding, out of the box

Deploy on any cloud, fine-tune with your own data, and deploy your custom model. We give you the keys to state-of-the-art AI that adapts to your specific needs.
World Class Accuracy

Recognized by leading researchers as the most performant AI for video understanding; surpassing benchmarks from cloud majors and open-source models.

Scale

Our models and infrastructure are built to handle the largest video libraries, capable of handling exabytes of data.

Customizable

Fine-tune our model to make it an expert in your content and domain. Deploy on the cloud, self-hosted cloud, or on-prem.

Secure and Private

Enterprise grade security, your data is secure and entirely yours. Soon to be SOC2 and ISO 27001 compliant.

PROBLEM SPACE

Move on from the old ways of tagging video

Manually logging videos is time-consuming and unscalable
Transcripts miss critical elements of your video, such as visuals and sounds
Object-level tags miss the context needed to add real value to your video
CUSTOMERS

What our customers saying

“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
CUSTOMERS

What our customers saying

“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober
“There’s nothing in the world like Twelve Labs”
Pedro Almeida
CEO, Mindprober

“It's essential for our business to access exact moments in games to package the best content to our fans. Multimodal AI is a game-changer in surfacing the best content you have available.”

Brad Boim
Senior Director, Media Management & Post Production, NFL Media

“Twelve Labs has developed a powerful and user-friendly technology that allows users to ask questions about videos and receive answers as if by magic!”

Jorge Torres
Co-Founder and CEO, MindsDB

“Building with Twelve Labs was an easy and powerful way to enhance our video datasets. Integration with FiftyOne was made simple with their excellent documentation and tutorials.”

Daniel Gural
Machine Learning Evangelist, Voxel51

“Twelve Labs offers a cutting-edge AI tool for deep analysis of content. We're excited about its potential to transform how we glean insights from large video libraries.”

“There is nothing in the world like Twelve Labs. It’s easy to integrate, finds what’s valuable, and the accuracy is astounding. Our video data opens new doors to business areas we’d only imagined.”

Pedro Almeida
CEO, Mindprober

“The Twelve Labs API continually amazes me in searching ALL parts of a video. With each search, I discover new results and possibilities of the technology for our customers.”

Michael Philips
Chief Product Officer, Source Digital
CUSTOMERS

What our customers are saying

“It's essential for our business to access exact moments in games to package the best content to our fans. Multimodal AI is a game-changer in surfacing the best content you have available.”

Brad Boim
Senior Director, Media Management & Post Production, NFL Media

“Twelve Labs has developed a powerful and user-friendly technology that allows users to ask questions about videos and receive answers as if by magic!”

Jorge Torres
Co-Founder and CEO, MindsDB

“Building with Twelve Labs was an easy and powerful way to enhance our video datasets. Integration with FiftyOne was made simple with their excellent documentation and tutorials.”

Daniel Gural
Machine Learning Evangelist, Voxel51

“Twelve Labs offers a cutting-edge AI tool for deep analysis of content. We're excited about its potential to transform how we glean insights from large video libraries.”

“There is nothing in the world like Twelve Labs. It’s easy to integrate, finds what’s valuable, and the accuracy is astounding. Our video data opens new doors to business areas we’d only imagined.”

Pedro Almeida
CEO, Mindprober

“The Twelve Labs API continually amazes me in searching ALL parts of a video. With each search, I discover new results and possibilities of the technology for our customers.”

Michael Philips
Chief Product Officer, Source Digital