The SDK calls the Tensor9 adapter, which sends requests to the configured model service.
#### How a conversation maps A Bedrock chat request is a list of turns, an optional system instruction, and inference settings. The adapter preserves every turn, the system instruction, and the token limit, temperature, top-p, and stop settings. One Bedrock setting, top-k, has no equivalent in the OpenAI-style interface, so it is dropped rather than treated as an error. The model your application names is not necessarily the model that runs. The customer chooses which model the in-cluster server hosts when the Cloud Adapter deployment is deployed, and the adapter routes every request to it.
The adapter sends the conversation to the model selected at deployment. Supported inference settings are listed in the text.
#### Tool use and streaming If your application uses Bedrock tool use (letting the model call functions you declare), the service adapter handles the full round trip where the served model supports it: the model can request a tool call, your application runs it, and the result feeds back into the next turn. The adapter translates between the Bedrock and OpenAI-style representations of tool calls so your application does not have to. Streaming behaves the same as on Bedrock. As the model produces output, the adapter delivers the same incremental events your SDK already expects.
The application executes tool calls and returns their results. During streaming, the adapter sends these as Bedrock events.
#### Limitations △ Where Bedrock and a self-hosted model differ * **The top-k setting is dropped.** The OpenAI-style interface has no equivalent, so a request that sets it still succeeds, without that control applied. * **Capabilities depend on the model you run.** Tool use, context length, and quality are set by the open model the customer hosts, not by Bedrock. Choose a model that supports what your application needs. * **Capacity is the customer's to provide.** Throughput is bounded by the GPUs the customer allocates to the server; there is no elastic managed backend behind it. * **Text inputs only.** Image and document content are not served on this path. * **Managed Bedrock features are not served.** Agents, Knowledge Bases, and guardrails configured as a service return a clear error rather than a silent or partial result. #### Other considerations **Migration.** Bedrock inference stores no conversation state in the service. Changing the model service requires configuration changes, with no stored inference data to transfer. **Operations.** The customer runs the model server: choosing the model, provisioning the GPUs, and keeping it available. Tensor9 injects the adapter and points it at that server. **Capacity and cost.** Throughput and cost are the customer's own hardware, sized for the workload. ## On Azure ### Azure RAI Content Filter Policy #### Inference through an Azure model deployment The Max inference path uses the Tensor9 OpenAI-compatible backend to serve supported Bedrock text-chat requests from an Azure model deployment. Configure the deployment endpoint, API version and API-key or Entra bearer authentication. The backend translates messages, tool calls, stop reasons and streaming fragments between Bedrock and Chat Completions. The application's Bedrock SDK keeps its supported request and response formats. Model behavior still differs: test prompts, tool schemas, refusals and partial-stream failures against the selected model. The OpenAI path has no `top_k` field; that setting is omitted. Native model-body support remains limited to the body formats listed in the inference profile. #### Content filtering and retrieval A declared guardrail maps to an Azure responsible-AI content policy on the cognitive account. Attach the policy to the deployment that serves requests. Azure categories and thresholds differ from Bedrock's, so compare allow/block outcomes using representative content. A knowledge base maps to Azure AI Search infrastructure. Load the corpus, configure ingestion, chunking and embeddings, and connect retrieval results to model requests. Creating the search service does not populate an index or provide the Bedrock Retrieve API. #### Deployment and validation Configure the model endpoint and its credentials separately from the content policy and search service. Check network access, model deployment availability and permissions for inference and retrieval. Test the complete application path, including a denied request, a tool call and cancellation of a stream. Managed Bedrock agents are outside this mapping. An application that depends on an agent runtime needs an explicit target implementation; neither a content policy nor a search index supplies that runtime. ## On Google Cloud ### Vertex AI - Gemini | Capability | Area | Support | Operations | Notes | | ----------------- | ---------------------- | ------------ | ---------- | ------------------------------------------------------------------------------------------------------------------------- | | InvokeInlineAgent | Inline agent | Partial | - | One chat turn per call with return-control. A bedrock-agent-runtime operation, distinct from the bedrock-runtime surface. | | Bedrock agents | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Knowledge Bases | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Operation | Area | Support | Depth | Notes | | ----------------------------- | ----------------------------- | --------- | ---------- | ------------------------------------------------------ | | InvokeModel | Native model body | Partial | Most usage | Claude-native request bodies only. | | InvokeModelWithResponseStream | Native model body (streaming) | Partial | Most usage | Claude-native request bodies only. | | CountTokens | Tokenization | Partial | Most usage | Uses Vertex countTokens for the selected Gemini model. | | Converse | Unified chat | Supported | Common | Chat, streaming, and tool use. | | ConverseStream | Unified chat (streaming) | Supported | Common | Chat, streaming, and tool use. | #### How it works Tensor9 runs an **adapter** alongside your application and points the AWS SDK's Bedrock endpoint to it. The adapter translates Bedrock requests for **Google Vertex AI Gemini**. Your application keeps its code and SDK, including Bedrock request formats, streaming events, and error codes. Gemini runs in the customer's Google Cloud project. The adapter authenticates with the Cloud Adapter deployment's Google Cloud identity; it needs no API key.
The SDK calls the Tensor9 adapter, which sends requests to the configured model service.
#### How a conversation maps A Bedrock chat request is a list of turns, an optional system instruction, and inference settings. The adapter maps all of it across: every turn, the system instruction, and the token limit, temperature, top-p, top-k, and stop settings are preserved. Gemini's request and response shape differs from Bedrock's more than most targets do. The service adapter absorbs those differences so your application still sees a normal Bedrock conversation. The model your application names is not necessarily the model that runs; the customer chooses which Gemini model serves the traffic when the Cloud Adapter deployment is deployed. Because a Gemini model produces every response, the generated content (its wording, its reasoning, and its model-specific strengths) is Gemini's, and will differ from the Bedrock model your application named. The Bedrock interface around it stays identical: the request shapes, the streaming events, and the error codes are unchanged.
The adapter sends the conversation to the model selected at deployment. Supported inference settings are listed in the text.
#### Tool use and streaming If your application uses Bedrock tool use (letting the model call functions you declare), the service adapter supports the full round trip: the model can request a tool call, your application runs it, and the result feeds back into the next turn. Gemini identifies a tool call by the function's name rather than by a call id, so the adapter keeps the calls straight when the model calls the same tool more than once in a turn. Streaming behaves the same as on Bedrock. As the model produces output, the adapter delivers the same incremental events your SDK already expects, including tool calls.
The application executes tool calls and returns their results. During streaming, the adapter sends these as Bedrock events.
#### Limitations △ Where Bedrock and Vertex Gemini differ * **Reasoning uses part of the token budget.** Gemini 2.5 spends part of the token limit on internal reasoning before it produces visible text, so allow enough tokens for both reasoning and visible output. * **The organization must allow access to generative models.** Some Google Cloud organizations allow generative models only through a dedicated service identity, not an interactive user login. a Cloud Adapter deployment uses its own service identity, which must have the required access before deployment. * **Text inputs only.** Image and document content are not served on this path. * **Managed Bedrock features are not served.** Agents, Knowledge Bases, and guardrails configured as a service return a clear error rather than a silent or partial result. #### Other considerations **Migration.** Bedrock inference stores no conversation state in the service. Changing the model service requires configuration changes, with no stored inference data to transfer. **Operations.** The customer owns the Vertex AI service in their Google Cloud: which models are enabled, the quotas, and the regions. **Capacity and cost.** Token pricing and throughput are Vertex AI's, not Bedrock's. ### Vertex AI - Claude | Capability | Area | Support | Operations | Notes | | ----------------- | ---------------------- | ------------ | ---------- | ------------------------------------------------------------------------------------------------------------------------- | | InvokeInlineAgent | Inline agent | Partial | - | One chat turn per call with return-control. A bedrock-agent-runtime operation, distinct from the bedrock-runtime surface. | | Bedrock agents | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Knowledge Bases | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Operation | Area | Support | Depth | Notes | | ----------------------------- | ----------------------------- | --------- | ---------- | --------------------------------------------------------------------------------------------------- | | InvokeModel | Native model body | Partial | Most usage | Claude-native request bodies only. | | InvokeModelWithResponseStream | Native model body (streaming) | Partial | Most usage | Claude-native request bodies only. | | CountTokens | Tokenization | Partial | Most usage | Uses the selected Anthropic endpoint's token-count operation; model and hosting restrictions apply. | | Converse | Unified chat | Supported | Common | Chat, streaming, and tool use. | | ConverseStream | Unified chat (streaming) | Supported | Common | Chat, streaming, and tool use. | #### How it works Tensor9 runs an **adapter** alongside your application and points the AWS SDK's Bedrock endpoint to it. The adapter translates Bedrock requests for **Anthropic's Claude on Google Vertex AI**. Your application keeps its code and SDK, including Bedrock request formats, streaming events, and error codes. This runs Claude inside Google Cloud, with no API key: the Cloud Adapter deployment authenticates with its Google Cloud identity. Bedrock and Claude use similar chat APIs, so the adapter preserves the conversation and settings described below. Prompts stay in Google Cloud.
The SDK calls the Tensor9 adapter, which sends requests to the configured model service.
#### How a conversation maps A Bedrock chat request is a list of turns, an optional system instruction, and inference settings. Because the two chat APIs share a shape, the adapter forwards all of it almost unchanged: every turn, the system instruction, and the token limit, temperature, top-p, stop, and top-k settings are preserved. The model your application names is not necessarily the model that runs. The customer chooses which Claude model on Vertex serves the traffic when the Cloud Adapter deployment is deployed, and the adapter routes every request to it.
The adapter sends the conversation to the model selected at deployment. Supported inference settings are listed in the text.
#### Tool use and streaming If your application uses Bedrock tool use (letting the model call functions you declare), the service adapter handles the full round trip: the model can request a tool call, your application runs it, and the result feeds back into the next turn. Because the two chat APIs represent tool calls the same way, this maps directly. Streaming behaves the same as on Bedrock. As the model produces output, the adapter delivers the same incremental events your SDK already expects, including partial tool calls.
The application executes tool calls and returns their results. During streaming, the adapter sends these as Bedrock events.
#### Limitations △ Where Bedrock and Claude on Vertex differ * **Claude must be enabled in the project.** Claude on Vertex AI is offered in specific Google Cloud regions and must be turned on for the project before it can serve traffic. This is a one-time setup when the Cloud Adapter deployment is deployed. * **Text inputs only.** Image and document content are not served on this path. * **Managed Bedrock features are not served.** Agents, Knowledge Bases, and guardrails configured as a service return a clear error rather than a silent or partial result. #### Other considerations **Migration.** Bedrock inference stores no conversation state in the service. Changing the model service requires configuration changes, with no stored inference data to transfer. **Operations.** The customer owns the Vertex AI service in their Google Cloud, including enabling Claude, the regions, and the quotas. **Capacity and cost.** Token pricing and throughput are Vertex AI's, not Bedrock's. ### Vertex AI - Llama | Capability | Area | Support | Operations | Notes | | ----------------- | ---------------------- | ------------ | ---------- | ------------------------------------------------------------------------------------------------------------------------- | | InvokeInlineAgent | Inline agent | Partial | - | One chat turn per call with return-control. A bedrock-agent-runtime operation, distinct from the bedrock-runtime surface. | | Bedrock agents | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Knowledge Bases | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Operation | Area | Support | Depth | Notes | | ----------------------------- | ----------------------------- | --------- | ---------- | -------------------------------------------------------------------------------------------------- | | InvokeModel | Native model body | Partial | Most usage | Claude-native request bodies only. | | InvokeModelWithResponseStream | Native model body (streaming) | Partial | Most usage | Claude-native request bodies only. | | CountTokens | Tokenization | Partial | Most usage | Counts locally with tiktoken; the estimate may differ from the selected model's billing tokenizer. | | Converse | Unified chat | Supported | Common | Chat, streaming, and tool use. | | ConverseStream | Unified chat (streaming) | Supported | Common | Chat, streaming, and tool use. | #### How it works Tensor9 runs an **adapter** alongside your application and points the AWS SDK's Bedrock endpoint to it. The adapter translates Bedrock requests for **open models on Google Vertex AI**, including Llama. Your application keeps its code and SDK, including Bedrock request formats, streaming events, and error codes. This runs in Google Cloud, with no API key: the Cloud Adapter deployment authenticates with its Google Cloud identity. Vertex offers these open models through an OpenAI-style interface, so the adapter maps the conversation the same way it does for any OpenAI-compatible service.
The SDK calls the Tensor9 adapter, which sends requests to the configured model service.
#### How a conversation maps A Bedrock chat request is a list of turns, an optional system instruction, and inference settings. The adapter preserves every turn, the system instruction, and the token limit, temperature, top-p, and stop settings. One Bedrock setting, top-k, has no equivalent in the OpenAI-style interface these models use, so it is dropped rather than treated as an error. The model your application names is not necessarily the model that runs. The customer chooses which Vertex open model serves the traffic when the Cloud Adapter deployment is deployed.
The adapter sends the conversation to the model selected at deployment. Supported inference settings are listed in the text.
#### Tool use and streaming If your application uses Bedrock tool use (letting the model call functions you declare), the service adapter handles the full round trip where the served model supports it: the model can request a tool call, your application runs it, and the result feeds back into the next turn. The adapter translates between the Bedrock and OpenAI-style representations of tool calls so your application does not have to. Streaming behaves the same as on Bedrock. As the model produces output, the adapter delivers the same incremental events your SDK already expects.
The application executes tool calls and returns their results. During streaming, the adapter sends these as Bedrock events.
#### Limitations △ Where Bedrock and Vertex open models differ * **The top-k setting is dropped.** The OpenAI-style interface has no equivalent, so a request that sets it still succeeds, without that control applied. * **Capabilities vary by model.** Tool use is available only for models that support it; a plain chat model serves text conversations without it. * **Model availability is set by Vertex.** Which open models are offered, and in which regions, is decided by Google Vertex AI. The customer picks one that is available where the Cloud Adapter deployment runs. * **Text inputs only.** Image and document content are not served on this path. * **Managed Bedrock features are not served.** Agents, Knowledge Bases, and guardrails configured as a service return a clear error rather than a silent or partial result. #### Other considerations **Migration.** Bedrock inference stores no conversation state in the service. Changing the model service requires configuration changes, with no stored inference data to transfer. **Operations.** The customer owns the Vertex AI service in their Google Cloud, including which models are enabled and the quotas. **Capacity and cost.** Token pricing and throughput are Vertex AI's, not Bedrock's. ## On OCI ### OCI Generative AI | Capability | Area | Support | Operations | Notes | | ----------------- | ---------------------- | ------------ | ---------- | ------------------------------------------------------------------------------------------------------------------------- | | InvokeInlineAgent | Inline agent | Partial | - | One chat turn per call with return-control. A bedrock-agent-runtime operation, distinct from the bedrock-runtime surface. | | Bedrock agents | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Knowledge Bases | Managed (out of scope) | Out of scope | - | Managed Bedrock feature; the adapter returns a real Bedrock error rather than partially serving it. | | Operation | Area | Support | Depth | Notes | | ----------------------------- | ----------------------------- | --------- | ---------- | --------------------------------------------------------------------------------------------------------------- | | InvokeModel | Native model body | Partial | Most usage | Claude-native request bodies only. | | InvokeModelWithResponseStream | Native model body (streaming) | Partial | Most usage | Claude-native request bodies only. | | CountTokens | Tokenization | Partial | Most usage | Token-count fidelity depends on the selected model and tokenizer; compare estimates with target-reported usage. | | Converse | Unified chat | Supported | Common | Chat, streaming, and tool use. | | ConverseStream | Unified chat (streaming) | Supported | Common | Chat, streaming, and tool use. | #### How it works Tensor9 runs an **adapter** alongside your application and points the AWS SDK's Bedrock endpoint to it. The adapter translates Bedrock requests for **OCI Generative AI**. Your application keeps its code and SDK, including Bedrock request formats, streaming events, and error codes. OCI Generative AI hosts two families of chat models: an OpenAI-style family (Llama, Grok, Gemini, and the gpt-oss models) and the Cohere Command family. Each family expects a slightly different request shape. The adapter picks the right shape for whichever model the customer has configured, passes the conversation through, and translates the reply back into a normal Bedrock response.
The SDK calls the Tensor9 adapter, which sends requests to the configured model service.
#### How a conversation maps A Bedrock chat request is a list of turns, an optional system instruction, and inference settings. The adapter forwards all of it: every turn, the system instruction, and the token limit, temperature, top-p, top-k, and stop settings are preserved, so the model sees the same conversation it would on AWS. The model your application names in the request is not necessarily the model that runs. The customer chooses which OCI model serves the traffic when the Cloud Adapter deployment is deployed, and the adapter routes every request to it. Authentication is keyless. The adapter signs each request with the Cloud Adapter deployment's own OCI identity, so there is no API key or static secret to manage. The account that is billed is fixed when the Cloud Adapter deployment is deployed and cannot be changed by a request.
The adapter sends the conversation to the model selected at deployment. Supported inference settings are listed in the text.
#### Tool use and streaming If your application uses Bedrock tool use (letting the model call functions you declare), the service adapter handles the full round trip for the OpenAI-style model family: the model can request a tool call, your application runs it, and the result feeds back into the next turn. Streaming behaves the same as on Bedrock. As the model produces output, the adapter delivers the same incremental events your SDK already expects, including partial tool calls. If the OCI model service reports an error partway through a stream, the adapter surfaces it as a normal error rather than a truncated response.
The application executes tool calls and returns their results. During streaming, the adapter sends these as Bedrock events.
#### Limitations △ Where Bedrock and OCI Generative AI differ * **Tool use is limited to the OpenAI-style family.** Tool use with the Cohere Command family is not supported. * **Text inputs only.** Image and document inputs are not supported; the adapter serves text conversations and tool use. * **Model availability is region-specific.** The Cohere Command family is offered on demand in a different OCI region than the OpenAI-style family, and a given model must be currently offered on demand in the Cloud Adapter deployment's region. Choose a model that is available where the Cloud Adapter deployment runs. * **Managed Bedrock features are not served.** Agents, Knowledge Bases, and guardrails configured as a service return a clear error rather than a silent or partial result. #### Other considerations **Migration.** Bedrock inference stores no conversation state in the service. Changing the model service requires configuration changes, with no stored inference data to transfer. **Operations.** The customer owns the OCI Generative AI service: which models are enabled, the quotas, and the availability in each region. **Capacity and cost.** Token pricing and throughput are the OCI model's, not Bedrock's. Size the model choice for the workload the same way you would size any inference deployment. ## On Scaleway ### Scaleway Managed Inference ## Existing data and credentials Selecting a backend does not copy existing data, credentials or access policies. Plan and verify migration separately before changing an application's endpoint. Do not assume an identifier, credential or encrypted value from the origin service works unchanged on the target. ## Configure, tune and debug Start with [setup](/cloud-adapter/getting-started/overview) and [configuration](/cloud-adapter/configuration/overview). Use [tuning](/cloud-adapter/tuning/overview) to understand supported request tags, [debugging](/cloud-adapter/debugging/overview) to investigate a request, and [High Fidelity Cloud Emulators](/cloud-adapter/local-testing/overview) to validate a bounded reproduction.