Audio Generation

Mesh API provides a full suite of audio endpoints — convert text to speech, transcribe audio files, stream TTS/STT in real time, and browse available voices — all through a single API key.

All endpoints share the same base URL: https://api.meshapi.ai/v1/audio

Auth: Authorization: Bearer rsk_<your-key> on all REST requests. WebSocket endpoints accept the key via Sec-WebSocket-Protocol: Bearer <rsk_...> or ?api_key=<rsk_...>.

Speech-to-Text

POST /v1/audio/transcriptions

Transcribe an audio file. The provider is resolved automatically from the model name. You can supply audio as a file upload, a public URL, or a cloud storage URL.

This endpoint uses multipart/form-data — not JSON.

Form fields

Response

1
{ "text": "The transcribed text goes here." }

Examples

$
curl -X POST https://api.meshapi.ai/v1/audio/transcriptions \
>
  -H "Authorization: Bearer rsk_..." \
>
  -F "model=elevenlabs/scribe_v2" \
>
  -F "file=@recording.mp3" \
>
  -F "language_code=en-US" \
>
  -F "diarize=true"

Transcribe and Translate

POST /v1/audio/transcriptions/translate

Transcribe audio and translate the result directly to English in a single step. Uses Sarvam models by default.

This endpoint uses multipart/form-data.

Form fields

Response

1
{ "text": "The English translation of the transcribed audio." }

Example

$
curl -X POST https://api.meshapi.ai/v1/audio/transcriptions/translate \
>
  -H "Authorization: Bearer rsk_..." \
>
  -F "model=sarvam/saaras:v2" \
>
  -F "file=@hindi_recording.wav"

WebSocket Real-Time STT

WS /v1/audio/transcriptions/realtime

Transcribe audio in real time. Send raw audio chunks as they are captured (e.g. from a microphone) and receive partial and final transcripts as they are produced.

This proxies ElevenLabs’ Scribe v2 Realtime endpoint.

Authentication

Pass your Mesh API key in one of these ways:

• Sec-WebSocket-Protocol: Bearer rsk_... header
• ?api_key=rsk_... query parameter
• ?token=rsk_... query parameter

Query parameters

Supported audio formats: pcm_8000, pcm_16000, pcm_22050, pcm_24000, pcm_44100, pcm_48000, ulaw_8000

Message protocol

Client → server (JSON frames)

Send input_audio_chunk frames with base64-encoded audio. This is the only message type the server forwards upstream — any other message type is silently dropped.

1
{
2
  "message_type": "input_audio_chunk",
3
  "audio_base_64": "<base64-encoded PCM audio>",
4
  "sample_rate": 16000,
5
  "commit": false
6
}

Set "commit": true to trigger a VAD commit when using commit_strategy: manual.

Server → client (JSON frames)

Example

1
const ws = new WebSocket(
2
  "wss://api.meshapi.ai/v1/audio/transcriptions/realtime" +
3
    "?model=scribe_v1&audio_format=pcm_16000&commit_strategy=manual&api_key=rsk_..."
4
);
5
6
ws.onopen = () => {
7
  console.log("Connected. Start sending audio chunks.");
8
};
9
10
ws.onmessage = ({ data }) => {
11
  const frame = JSON.parse(data);
12
  if (frame.message_type === "partial_transcript") {
13
    process.stdout.write("\r" + frame.text);
14
  } else if (frame.message_type === "committed_transcript") {
15
    console.log("\nFinal:", frame.text);
16
  }
17
};
18
19
// Send a PCM audio chunk (from a microphone, for example)
20
function sendAudioChunk(pcmBuffer) {
21
  const b64 = Buffer.from(pcmBuffer).toString("base64");
22
  ws.send(
23
    JSON.stringify({
24
      message_type: "input_audio_chunk",
25
      audio_base_64: b64,
26
      sample_rate: 16000,
27
    })
28
  );
29
}
30
31
// Commit the buffered audio to get a final transcript
32
function commit() {
33
  ws.send(
34
    JSON.stringify({
35
      message_type: "input_audio_chunk",
36
      audio_base_64: "",
37
      sample_rate: 16000,
38
      commit: true,
39
    })
40
  );
41
}

Voice Management

List voices

GET /v1/audio/voices

Browse voices available on your ElevenLabs account. Supports pagination, full-text search, and filtering.

$
curl "https://api.meshapi.ai/v1/audio/voices?search=rachel&voice_type=premade&page_size=10" \
>
  -H "Authorization: Bearer rsk_..."

Get a single voice

GET /v1/audio/voices/{voice_id}

Fetch metadata for a specific voice by its ElevenLabs voice ID.

$
curl https://api.meshapi.ai/v1/audio/voices/JBFqnCBsd6RMkjVDRZzb \
>
  -H "Authorization: Bearer rsk_..."

Error handling

All endpoints use standard HTTP status codes. Common cases:

WebSocket sessions send a JSON error frame and then close with code 1000 before disconnecting.