Skip to content

Assessment: Support video attachments #1212

Description

@vprashrex

Is your feature request related to a problem?
The current assessment batch only supports image and pdf attachments. With Google Gemini supporting video inputs, we need functionality for video attachments, including proper validation and handling to avoid errors with unsupported formats.

Describe the solution you'd like

  • Add video to InputColumn.type and AssessmentAttachment.type/type_value_map (url-format only).
  • Implement type detection for common video extensions (.mp4, .mov, .webm, etc.).
  • Build fileData video part for Gemini (support for YouTube URLs and direct video URL mime types).
  • Configure video_part_config (default videoMetadata.fps) and media_resolution through Google params mapper.
  • Ensure OpenAI/Anthropic builders skip unsupported video cells instead of throwing errors.
Original issue

Summary

Assessment BATCH input columns only supported image/pdf attachment types. Google Gemini supports video (including YouTube URLs), so we need a video input-column type end-to-end: schema validation, attachment routing/mime resolution, and Gemini request building — while OpenAI/Anthropic (which don't support video input) safely skip such cells instead of erroring.

Scope

  • Add video to InputColumn.type and AssessmentAttachment.type/type_value_map (url-format only, base64 rejected).
  • Extension→type detection for common video extensions (.mp4, .mov, .webm, etc.).
  • Gemini fileData video part builder (YouTube URLs carry no mimeType; direct GCS/HTTPS URLs get a resolved video mime).
  • video_part_config (default videoMetadata.fps) and media_resolution (generationConfig.mediaResolution) defaults wired through the Google params mapper.
  • OpenAI/Anthropic attachment builders skip video cells (unsupported) rather than throwing.

Out of scope

  • OpenAI/Anthropic native video support (not available upstream).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

  • Status
    Closed

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions