Cosmos 3

Reason about physical scenes with NVIDIA Cosmos 3.

This workflow block runs the NVIDIA Cosmos 3 reasoner - a world model tuned for physical scene understanding - on an image with an optional text prompt, and returns a text answer. The model is well suited to questions about spatial relations, safety, and what will happen next in a scene.

Type identifier

Use the following identifier in step "type" field: roboflow_core/cosmos3_edge@v1 to add the block as a step in your workflow.

Properties

NameTypeDescriptionRefs
namestrEnter a unique identifier for this step..
promptstrOptional text prompt to pass to Cosmos 3 Edge. Otherwise a default scene-description prompt is used, which may affect the desired model behavior..
model_versionstrThe Cosmos 3 Edge model to be used for inference..
system_promptstrOptional system prompt to provide additional context to Cosmos 3 Edge..

The Refs column marks possibility to parametrise the property with dynamic values available in workflow runtime. See Bindings for more info.

Runtime compatibility

hard - runtime self_hosted_cpu; execution local : Requires a GPU; run_locally() loads a model that needs CUDA.

Input and Output Bindings

The available connections depend on its binding kinds. Check what binding kinds Cosmos 3 in version v1 has.

Input and output bindings
  • input

    • images (image): The image to infer on..
    • prompt (string): Optional text prompt to pass to Cosmos 3 Edge. Otherwise a default scene-description prompt is used, which may affect the desired model behavior..
    • model_version (roboflow_model_id): The Cosmos 3 Edge model to be used for inference..
    • system_prompt (string): Optional system prompt to provide additional context to Cosmos 3 Edge..
  • output

Example JSON definition
{
	    "name": "<your_step_name_here>",
	    "type": "roboflow_core/cosmos3_edge@v1",
	    "images": "$inputs.image",
	    "prompt": "Is the walkway free of obstacles?",
	    "model_version": "nvidia/cosmos-3-edge",
	    "system_prompt": "You are a safety inspector."
	}