Audio

Mesh API supports audio through POST /v1/chat/completions. Use this page for:

audio input with input_audio
audio output with modalities and audio

Audio input

Send audio as a content part inside a chat message.

curl
Node.js SDK
Python SDK
Go SDK
Java SDK

curl https://api.meshapi.ai/v1/chat/completions \
  -H "Authorization: Bearer <YOUR_RSK_KEY>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "google/gemini-3-flash-preview",
    "messages": [
      {
        "role": "user",
        "content": [
          { "type": "text", "text": "Transcribe this clip." },
          {
            "type": "input_audio",
            "input_audio": {
              "data": "<BASE64_AUDIO>",
              "format": "wav"
            }
          }
        ]
      }
    ]
  }'

const response = await client.chat.completions.create({
  model: "google/gemini-3-flash-preview",
  messages: [
    {
      role: "user",
      content: [
        { type: "text", text: "Transcribe this clip." },
        {
          type: "input_audio",
          input_audio: {
            data: "<BASE64_AUDIO>",
            format: "wav",
          },
        },
      ],
    },
  ],
});

from meshapi import ChatCompletionParams, ChatMessage, ContentPartAudio, ContentPartText, InputAudio, MeshAPI

client = MeshAPI(base_url="https://api.meshapi.ai", token="rsk_...")

response = client.chat.completions.create(
    ChatCompletionParams(
        model="google/gemini-3-flash-preview",
        messages=[
            ChatMessage(
                role="user",
                content=[
                    ContentPartText(type="text", text="Transcribe this clip."),
                    ContentPartAudio(
                        type="input_audio",
                        input_audio=InputAudio(data="<BASE64_AUDIO>", format="wav"),
                    ),
                ],
            )
        ],
    )
)

model := "google/gemini-3-flash-preview"
prompt := "Transcribe this clip."
audioData := "<BASE64_AUDIO>"

params := meshapi.ChatCompletionParams{
    Model: &model,
    Messages: []meshapi.ChatMessage{
        {
            Role: "user",
            Content: []meshapi.ContentPart{
                {Type: "text", Text: &prompt},
                {
                    Type: "input_audio",
                    InputAudio: &meshapi.InputAudio{
                        Data:   &audioData,
                        Format: "wav",
                    },
                },
            },
        },
    },
}

_, err := client.Chat.Completions.Create(ctx, params)

MeshAPI client = MeshAPI.builder()
    .baseUrl("https://api.meshapi.ai")
    .token("rsk_...")
    .build();

ChatCompletionRequest request = ChatCompletionRequest.builder()
    .model("google/gemini-3-flash-preview")
    .addMessage(
        ChatMessage.builder()
            .role("user")
            .content(java.util.List.of(
                java.util.Map.of("type", "text", "text", "Transcribe this clip."),
                java.util.Map.of(
                    "type", "input_audio",
                    "input_audio", java.util.Map.of("data", "<BASE64_AUDIO>", "format", "wav")
                )
            ))
            .build()
    )
    .build();

client.chat().completions().create(request);

input_audio takes base64-encoded bytes in data, or a remote url on BytePlus models, plus a format (wav, mp3, aiff, aac, ogg, flac, m4a, pcm16 or pcm24). Keep inline audio to about 7 MB.

Audio output

Request text and audio together when the model supports audio output.

curl https://api.meshapi.ai/v1/chat/completions \
  -H "Authorization: Bearer <YOUR_RSK_KEY>" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-audio",
    "messages": [
      { "role": "user", "content": "Read this back to me in a calm voice." }
    ],
    "modalities": ["text", "audio"],
    "audio": {
      "voice": "alloy",
      "format": "wav"
    }
  }'

The same request shape is available through all four SDKs by setting chat-completions fields for modalities and audio.

Translate audio to English

POST /v1/audio/translations accepts audio in any language and returns the speech translated to English. It returns the same TranscriptionResponse (with a .text field) as transcription.

POST /v1/audio/transcriptions/translate is a legacy alias of this endpoint with the same behaviour. It takes model, file, prompt, tags and safety_identifier, but not response_format or temperature. Use /v1/audio/translations and always pass model. Check GET /v1/models for models that support translation.

Python SDK
Node.js SDK
Go SDK

from meshapi import MeshAPI, AudioTranslationsParams

client = MeshAPI(base_url="https://api.meshapi.ai", token="rsk_...")

with open("french_audio.mp3", "rb") as f:
    audio_bytes = f.read()

result = client.audio.audio_translate(
    audio_bytes,
    AudioTranslationsParams(model="openai/whisper-large-v3"),
    filename="french_audio.mp3",
)

print(result.text)  # English translation

import { readFileSync } from "fs";

const audio = readFileSync("french_audio.mp3");

const result = await client.audio.translations(
  audio,
  { model: "openai/whisper-large-v3" },
  { filename: "french_audio.mp3" },
);

console.log(result.text); // English translation

audioBytes, _ := os.ReadFile("french_audio.mp3")

result, err := client.Audio.Translations(ctx, audioBytes, "french_audio.mp3", meshapi.AudioTranslationParams{
    Model: "openai/whisper-large-v3",
})
if err != nil {
    log.Fatal(err)
}
fmt.Println(result.Text) // English translation

Optional parameters: prompt (context hint for the model), response_format (json, text, or verbose_json), and temperature (0–2).

SDK coverage

Node: client.chat.completions.create(...)
Python: client.chat.completions.create(...)
Go: client.Chat.Completions.Create(...)
Java: client.chat().completions().create(...)

Notes

Inline audio payloads are base64 encoded in the request body. BytePlus models also take a remote url.
Check GET /v1/models to find models that accept or produce audio.
Keep payload sizes reasonable, especially for browser-based clients.

Introduction

Accounts & Access

Core Inference

Retrieval & Search

Multimodal

Operations

Mesh Code

Mesh CLI

Platform

Reference

Audio input

Audio output

Translate audio to English

SDK coverage

Notes

​Audio input

​Audio output

​Translate audio to English

​SDK coverage

​Notes

Audio input

Audio output

Translate audio to English

SDK coverage

Notes