Google Cloud Vision

Integrate Google Cloud Vision
with your AI workspace

Google Cloud Vision API enables developers to integrate vision detection features into applications, including image labeling, face and landmark detection, optical character recognition (OCR), and explicit content tagging.

Automate your first task Sign up with Google

Explore Triggers and Actions

Add Product to ProductSet

Add a Product to a ProductSet in Google Cloud Vision Product Search. This action associates a Product with a ProductSet, enabling the product to be included in product search queries against that set. Both resources must exist in the same Google Cloud project and location before calling this action. Key characteristics: - Idempotent: If the Product is already in the ProductSet, no change is made and no error occurs - Constraint: One Product can be added to at most 100 ProductSets - The Product and ProductSet must be in the same project and location - Valid locations: us-west1, us-east1, europe-west1, asia-east1 Use this after creating both a Product and a ProductSet to establish their association. Returns an empty response on success.

ActionTry it

Annotate Files with Vision API

Tool to perform image detection and annotation for batch files in Google Cloud Vision. Supports PDF, TIFF, and GIF files. Extracts up to 5 frames (GIF) or pages (PDF/TIFF) from each file and performs detection for each image. Use when you need to analyze documents or multi-page images with features like text detection, label detection, face detection, or other Vision API capabilities.

ActionTry it

Annotate Images

Run image detection and annotation for a batch of images using Google Cloud Vision API. Performs various types of image analysis including face detection, landmark detection, logo detection, label detection, text detection (OCR), safe search detection, image properties, crop hints, web detection, product search, and object localization. Supports up to 16 images in a single batch request. Each image can have multiple feature types analyzed simultaneously.

ActionTry it

Annotate Images Async Batch

Tool to run asynchronous image detection and annotation for a batch of images. Use when processing multiple images or large images that require longer processing time. Results are written to Google Cloud Storage as JSON files.

ActionTry it

Annotate Location Images

Tool to run image detection and annotation for a batch of images scoped to a specific project and location. Performs various types of image analysis including label detection, face detection, landmark detection, logo detection, OCR text detection, safe search detection, image properties, crop hints, web detection, product search, and object localization. Supports processing up to 16 images per request with regional endpoint routing (us, asia, eu). Use this when you need to analyze images with location-specific processing for content extraction, text recognition, object detection, face identification, or landmark/logo recognition.

ActionTry it

Async Batch Annotate Files

Tool to run asynchronous image detection and annotation for a list of generic files (PDF, TIFF, GIF). Use when processing multi-page documents that may contain multiple images per page. Results are written to Google Cloud Storage and progress can be tracked via the returned operation name using VisionGetOperation.

ActionTry it

Cancel Vision Operation

Starts asynchronous cancellation of a long-running Vision API operation. Returns an empty response on successful cancellation request. Note that the server makes a best effort to cancel the operation, but success is not guaranteed. Use the Get Operation action to check if cancellation succeeded or if the operation completed despite the cancellation attempt. The server may return UNIMPLEMENTED if the operation does not support cancellation.

ActionTry it

Create Product Set

Creates a new ProductSet resource in Google Cloud Vision Product Search. A ProductSet is a container for grouping related products together for visual search. After creating a product set, you can add products to it using the AddProductToProductSet action. Prerequisites: - Vision API must be enabled in your Google Cloud project - Product Search must be enabled - Valid project ID and location (us-west1, us-east1, europe-west1, or asia-east1) Use this action to: - Create a new product set container - Organize products into logical groups - Obtain a product set resource name for adding products

ActionTry it

Create ReferenceImage

Tool to create a ReferenceImage under a product. Use when adding a new image to a product for detection.

ActionTry it

Create Vision Product

Creates a new Product resource in Google Cloud Vision Product Search. A Product represents a physical item that can be visually searched using reference images. After creating a product, you can add reference images to it and include it in product sets for visual search capabilities. Prerequisites: - Vision API must be enabled in your Google Cloud project - Product Search must be enabled - Valid project ID and location (us-west1, us-east1, europe-west1, or asia-east1) Use this action to: - Register a new product for visual search - Set up product metadata (display name, description, category, labels) - Obtain a product resource name for adding reference images

ActionTry it

Delete Product

Permanently deletes a Product and its associated reference images from Google Cloud Vision API. This is a destructive operation that cannot be undone. The product metadata and all images are deleted immediately, though search queries against ProductSets may temporarily return cached results until caches refresh. Use this tool when you need to remove a product that is no longer needed. Ensure you have the correct product resource name before deletion.

ActionTry it

Delete Product Set

Tool to permanently delete a ProductSet. Use after confirming the ProductSet's resource name.

ActionTry it

Delete Reference Image

Permanently removes a reference image from a product in Google Cloud Vision Product Search. This action deletes the reference image association from the specified product. The image will be marked for deletion and removed during the next indexing operation. Note that the actual image file in Google Cloud Storage is not deleted. Use this when you need to: - Remove outdated or incorrect product reference images - Clean up test images from products - Update product imagery by removing old references Prerequisites: - The product must exist - The reference image must have been previously created under the product - You need the full resource path of the reference image (use List Reference Images if unknown)

ActionTry it

Delete Vision API Operation

Tool to delete a long-running Vision API operation. Use after confirming the operation name.

ActionTry it

Get Product

Tool to get information associated with a Product. Use when you have the product resource name and need its details.

ActionTry it

Get Product Set

Tool to get a ProductSet. Use when you need metadata details of an existing ProductSet by its full resource name. Use after obtaining the resource name.

ActionTry it

Get Reference Image

Tool to get information associated with a ReferenceImage. Use when you have the full resource name and need its metadata.

ActionTry it

Get Vision API Operation

Retrieves the latest state of a long-running Vision API operation. Use this to poll the status of asynchronous operations like importProductSets or purgeProducts. The operation name is returned when you start an async operation.

ActionTry it

Import Product Sets

Asynchronously imports product sets and reference images from a CSV file stored in Google Cloud Storage. This bulk import operation creates ProductSets, Products, and ReferenceImages from a properly formatted CSV file. Returns a long-running Operation that can be polled for completion status. The import automatically creates new ProductSets and Products if they don't exist based on the IDs in the CSV. Use this when you need to: - Bulk import multiple products and images at once - Create product catalogs from existing CSV data - Set up initial product search datasets Note: Requires OAuth authentication with cloud-platform or cloud-vision scope, and read access to the GCS bucket.

ActionTry it

List Locations

Tool to list available Vision AI service locations for a project. Use when you need to discover supported regions before making region-specific API calls.

ActionTry it

List Products in ProductSet

Tool to list Products in a specified ProductSet. Use when you need to retrieve Products associated with a ProductSet after confirming it exists, with optional pagination.

ActionTry it

List Projects

List Google Cloud projects accessible to the authenticated user via Cloud Resource Manager API. This action queries the Cloud Resource Manager API (not Vision API directly) to enumerate projects. It requires OAuth 2.0 authentication - API key auth is insufficient. Use this when you need to discover available project IDs before making Vision API calls that require project identifiers. Note: Returns projects you have 'resourcemanager.projects.get' permission on.

ActionTry it

List Reference Images

Tool to list reference images for a product. Use when you need to retrieve stored reference images under a specified product resource name, with optional pagination.

ActionTry it

List Vision AI IndexEndpoints

Lists IndexEndpoints in Vertex AI Vision for a given project and location. IndexEndpoints are deployed instances of image indexes used for visual search and retrieval in Vision AI's media warehouse. Use this tool to discover existing endpoints before querying them or to manage deployed indexes. IMPORTANT: Requires OAuth2 authentication (API keys are NOT supported). Needs 'visionai.indexEndpoints.list' IAM permission.

ActionTry it

List Vision API Operations

Tool to list operations that match the specified filter. Use when you need to retrieve all operations under a specific project and location.

ActionTry it

Purge Products

Tool to asynchronously delete products in a ProductSet or orphan products. Use when you need to clean up products at scale; ensure `force` is true to execute.

ActionTry it

Remove Product from ProductSet

Removes a Product from a specified ProductSet in Google Cloud Vision API. This operation unlinks a product from a product set but does not delete either resource. Both the product and product set must exist in the same Google Cloud project and location. The product must have been previously added to the product set for this operation to succeed. Use this when you need to reorganize products across product sets or remove a product from a set without deleting the product itself.

ActionTry it

Update Product

Tool to update a Product's mutable fields: displayName, description, and productLabels. Use after confirming the product resource name.

ActionTry it

Update Product Set

Tool to update a ProductSet resource. Use when you need to modify the displayName of an existing ProductSet.

ActionTry it