## Basic model info - Model name: kling/kling kling-lip-sync - Model description: API for Kling Lip Sync generation model - Add lip-sync to any video with an audio file or text. - Endpoint name: text-to-video ## Model schema The model schema is defined in the OpenAPI schema: [OpenAPI Schema](https://oapi.sunra.ai/main/kling/kling-lip-sync/latest.json) ### Model input schema The model input schema is: ```json { "properties": { "text": { "description": "Text for lip syncing (maximum 120 characters)", "maxLength": 120, "minLength": 1, "title": "Text", "type": "string", "x-sr-order": 201 }, "video": { "description": "URL of a video for lip syncing. MP4/MOV, ≤100MB, 2-60s, 720p-1080p", "title": "Video", "type": "string", "x-sr-order": 301 }, "voice_id": { "default": "en_AOT", "description": "Voice ID for speech synthesis", "enum": [ "en_AOT", "en_oversea_male1", "en_girlfriend_4_speech02", "en_chat_0407_5-1", "en_uk_boy1", "en_PeppaPig_platform", "en_ai_huangzhong_712", "en_calm_story1", "en_uk_man2", "en_reader_en_m-v1", "en_commercial_lady_en_f-v1", "zh_genshin_vindi2", "zh_zhinen_xuesheng", "zh_tiyuxi_xuedi", "zh_ai_shatang", "zh_genshin_klee2", "zh_genshin_kirara", "zh_ai_kaiya", "zh_tiexin_nanyou", "zh_ai_chenjiahao_712", "zh_girlfriend_1_speech02", "zh_chat1_female_new-3", "zh_girlfriend_2_speech02", "zh_cartoon-boy-07", "zh_cartoon-girl-01", "zh_ai_huangyaoshi_712", "zh_you_pingjing", "zh_ai_laoguowang_712", "zh_chengshu_jiejie", "zh_zhuxi_speech02", "zh_uk_oldman3", "zh_laopopo_speech02", "zh_heainainai_speech02", "zh_dongbeilaotie_speech02", "zh_chongqingxiaohuo_speech02", "zh_chuanmeizi_speech02", "zh_chaoshandashu_speech02", "zh_ai_taiwan_man2_speech02", "zh_xianzhanggui_speech02", "zh_tianjinjiejie_speech02", "zh_diyinnansang_DB_CN_M_04-v2", "zh_yizhipiannan-v1", "zh_guanxiaofang-v2", "zh_tianmeixuemei-v1", "zh_daopianyansang-v1", "zh_mengwa-v1" ], "title": "Voice Id", "type": "string", "x-sr-order": 402 }, "voice_language": { "anyOf": [ { "enum": [ "zh", "en" ], "type": "string" }, { "type": "null" } ], "default": "en", "description": "The voice language corresponding to the Voice ID", "title": "Voice Language", "x-sr-order": 403 }, "voice_speed": { "default": 1, "description": "Speech rate for text to video generation", "maximum": 2, "minimum": 0.8, "title": "Voice Speed", "type": "number", "x-sr-order": 401 } }, "required": [ "video", "text" ], "title": "TextLipSyncInput", "type": "object" } ``` ### Model output schema The model output schema is: ```json { "description": "Output model with input video duration for post_calculated pricing.", "properties": { "input_video_dur": { "description": "Duration of the input video in seconds (rounded)", "title": "Input Video Dur", "type": "integer" }, "video": { "properties": { "content_type": { "description": "The mime type of the file.", "title": "Content Type", "type": "string" }, "file_name": { "description": "The name of the file. It will be auto-generated if not provided.", "title": "File Name", "type": "string" }, "file_size": { "description": "The size of the file in bytes.", "title": "File Size", "type": "integer" }, "url": { "description": "The URL where the file can be downloaded from.", "title": "Url", "type": "string" } }, "required": [ "content_type", "file_name", "file_size", "url" ], "title": "SunraFile", "type": "object" } }, "required": [ "video", "input_video_dur" ], "title": "KlingLipSyncOutput", "type": "object" } ``` ## Example inputs and outputs Use the following example inputs and outputs to understand the model. ### Input example ```json { "text": "", "video": "", "voice_id": "en_AOT", "voice_language": "en", "voice_speed": 1 } ``` ### Output example ```json { } ``` ## Model code examples ### JavaScript ```javascript import { sunra } from "@sunra/client"; const result = await sunra.subscribe("kling/kling-lip-sync/text-to-video", { input: { video: '', text: '', voice_id: 'en_AOT', voice_language: 'en', voice_speed: 1 }, logs: true, onQueueUpdate: (update) => { console.log(`Status Update: ${update.status}, Request ID: ${update.request_id}`); }, }); console.log(result.data); console.log(result.requestId); ``` ### Python ```python import sunra_client result = sunra_client.subscribe( "kling/kling-lip-sync/text-to-video", arguments={ "video": "", "text": "", "voice_id": "en_AOT", "voice_language": "en", "voice_speed": 1 }, with_logs=True, on_enqueue=print, on_queue_update=print, ) print(result) ``` ### Java ```java import ai.sunra.client.*; import java.util.Map; import com.google.gson.JsonObject; var client = SunraClient.withEnvCredentials(); var response = client.subscribe( "kling/kling-lip-sync/text-to-video", SubscribeOptions.builder() .input(Map.of( "video", "", "text", "", "voice_id", "en_AOT", "voice_language", "en", "voice_speed", 1)) .resultType(JsonObject.class) .onQueueUpdate(update -> System.out.printf( "\nStatus Update: %s, Request ID: %s%n", update.getStatus(), update.getRequestId() )) .logs(true) .build() ); System.out.println("Completed!"); System.out.println(response.getData()); ``` ### Kotlin ```kotlin import ai.sunra.client.kt.* import com.google.gson.JsonObject val client = createSunraClient() val response = client.subscribe( endpointId = "kling/kling-lip-sync/text-to-video", input = mapOf( "video" to "", "text" to "", "voice_id" to "en_AOT", "voice_language" to "en", "voice_speed" to 1), options = ai.sunra.client.kt.SubscribeOptions(logs = true), onUpdate = { update -> println("\nStatus Update: ${update.status}, Request ID: ${update.requestId}") } ) println("Completed!") println(response.data) ``` ### Curl ```bash curl --request POST \ --url https://api.sunra.ai/v1/queue/kling/kling-lip-sync/text-to-video \ --header "Authorization: Key $SUNRA_KEY" \ --header "Content-Type: application/json" \ --data '{"video":"","text":"","voice_id":"en_AOT","voice_language":"en","voice_speed":1}' ``` ## Model readme undefined