Skip to main content

Content Intelligence

Alpha Stage Service

The Content Intelligence service is a powerful component of our Smart Content framework, currently in an Alpha stage. Its API and capabilities are subject to change as we continue to develop and refine it.

Overview​

The Content Intelligence service is the analytical brain of the Feature Platform. It is a scalable microservice designed to analyze media assets—both images and videos—to extract rich, semantic metadata.

This "intelligence" is the foundation that enables the creation of highly contextual and timely rewards. By understanding the content of a video, the platform can trigger asset issuance based on specific on-screen moments, themes, or events, creating a deeply immersive and interactive experience for the viewer.

Key Capabilities​

  • Semantic Tagging: Automatically generates descriptive tags and labels for media assets based on their content.
  • Moment Detection: Analyze video files to identify key moments and events, generating a structured timeline.
  • Multi-Modal Analysis: Leverages state-of-the-art Generative AI models (including Google's Gemini) that understand both visual data and text-based context.
  • Direct URL Analysis: Supports direct analysis of public media assets via URL, including YouTube videos.

API Usage​

The service is exposed via a secure, RESTful API endpoint. To use it, you make a POST request with the media you want to analyze and the context for the analysis.

Analyze an Image via URL​

This example shows how to request tags for an image, providing context to guide the AI model for more relevant results.

POST /intelligence/analyze

Example Request:

curl -X POST https://api.feature.io/intelligence/analyze \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer <YOUR_API_TOKEN>' \
  -d '{
    "media_path": "https://storage.googleapis.com/feature-platform-public/m1-race-car.jpg",
    "tag_context": "Marketing materials for a luxury car brand",
    "campaign_id": "your-campaign-id"
  }'

Example Response:

{
  "analysis_id": "analysis_12345",
  "media_source": "https://storage.googleapis.com/feature-platform-public/m1-race-car.jpg",
  "analysis_type": "tags",
  "results": {
    "tags": [
      {"tag": "race car", "score": 0.98},
      {"tag": "motorsport", "score": 0.95},
      {"tag": "speed", "score": 0.92},
      {"tag": "performance vehicle", "score": 0.89},
      {"tag": "asphalt", "score": 0.85}
    ]
  }
}

Analyze a YouTube Video​

You can also submit a public YouTube video URL directly to generate a timeline of key moments and descriptive tags.

POST /intelligence/analyze

Example Request:

curl -X POST https://api.feature.io/intelligence/analyze \
  -H 'Content-Type: application/json' \
  -H 'Authorization: Bearer <YOUR_API_TOKEN>' \
  -d '{
    "media_path": "https://www.youtube.com/watch?v=VIDEO_ID",
    "tag_context": "Highlights for a sports recap",
    "analysis_type": "timeline"
  }'

Example Response:

{
  "analysis_id": "analysis_67890",
  "media_source": "https://www.youtube.com/watch?v=VIDEO_ID",
  "analysis_type": "timeline",
  "results": {
    "timeline": [
      {
        "timestamp_sec": 15,
        "description": "The driver overtakes another car on the first corner.",
        "tags": ["overtake", "racing", "cornering"]
      },
      {
        "timestamp_sec": 45,
        "description": "Close-up shot of the pit crew during a tire change.",
        "tags": ["pit stop", "teamwork", "efficiency"]
      },
      {
        "timestamp_sec": 122,
        "description": "The car crosses the finish line to win the race.",
        "tags": ["victory", "checkered flag", "finish line"]
      }
    ]
  }
}

Availability​

The Content Intelligence service is a core part of our long-term vision for creating hyper-personalized, generative content experiences. As an Alpha service, access is currently limited. Please contact your account representative to learn more about how you can leverage its capabilities for your campaigns.