dsh-web-speech-input
leozou320-ai
Voice-to-text for the DeepSeek Harness Web UI — live, editable, never auto-sends. | DeepSeek Harness 网页语音输入
PROJECT TOPICS
PROJECT README
A DeepSeek Harness native plugin for AI video and motion-comic (漫剧) production: six-stage director pipeline × multi-provider free-quota scheduling × four-layer prompt engineering with self-optimization. Quality first, cost second.
中文 · Siblings: dsh-lab · awesome-dsh-skills · awesome-dsh-presets
The DSH ecosystem has 1000+ plugins — none does generative video. Whale brings the industry-validated motion-comic pipeline (waoowaoo / LumenX / MangaV / ArcReel pattern) into DSH as a hot-pluggable, per-step-controllable plugin.
story (LLM, e.g. Doubao writes the novel) → script (LLM breaks it down)
→ storyboard (LLM shot list) → master asset (MJ-style hero image)
→ shot assets (image-model variations for consistency) → video (Seedance/Jimeng/Kling)
→ final cut (JianYing draft export / local ffmpeg render)
Mapping to the industry-standard toolchain:
| Industry flow | Whale |
|---|---|
| Doubao writes novel / script / shots | = DSH session model doing story/script/storyboard (pick a Doubao model and it IS "Doubao writes") |
| MJ hero asset | = master-asset stage (MJ official API adapter to come; wanx/Seedream can substitute) |
| image variations | = shot-assets stage (wanx ✅ verified · Doubao Seedream ✅ wired) |
| Seedance video | = video stage (Doubao Seedance ✅ / jimeng / kling / ComfyUI) |
| JianYing final cut | = final-cut stage (JianYing draft export ✅ / ffmpeg ✅) |
Every stage has a gate: auto / ask / manual.
Parallel shots, quota scheduler, style genome, distribution pack as before.
Consistency asset library: character/scene master assets + per-shot variations with automatic reference-image injection into prompts (the motion-comic standard technique)
Parallel shots: batch submit → concurrent polling (configurable concurrency)
Quota scheduler: multi-account free-quota rotation, quality-aware fallback, per-day caps, full audit
Style genome (memory): style DNA, shot-template scoring evolution, retry feedback — persists across sessions
Prompt engineering: parameterized professional template library (character sheet / scene master / single shot) + composable quality boosters (8K / clean bg / neutral face / no text …) + optimizer; whale_optimize_prompt upgrades drafts to pro-grade prompts locally
Prompt self-optimization: A/B → frame scoring → promote (≥4) / retry (≤2) templates
| Provider | Channel | Status |
|---|---|---|
| jimeng (即梦) | sessionid, free daily quota | ✅ protocol verified end-to-end; text-to-video queue stays SystemBusy even off-peak (0 credits consumed) — free route is now: wanx images → image-to-video |
| tongyi-wanx (通义万相) | cookie+xsrf, free credits | ✅ live-verified: real whale image generated & downloaded (free tier = text-to-image; video needs membership) |
| kling official (可灵) | accessKey:secretKey JWT, api-beijing.klingai.com | ✅ adapter written — not yet tested against a real key |
| kling via DashScope | sk- key |
✅ adapter written — not yet tested against a real key |
| wan video via DashScope (通义万相视频) | sk- key, official free quota |
✅ adapter written (same async protocol as kling) — model id to confirm on first real key |
| doubao (火山方舟) | ARK API key | ✅ Seedance video + Seedream image (assets) — not yet tested against a real key |
| doubao-web (豆包网页版) | cookie, free web quota | ✅ live-replayed & parsed: SSE chat for the LLM stages (story/script/shots) + image bot for assets. Pro-tier free quota runs on a 7-day window (image bot pauses when spent; text keeps working) |
| ComfyUI local | workflow JSON builder + /prompt protocol | ✅ protocol-tested (mock server), real GPU pending |
| kling web (sessionid) | anti-bot one-time falcon token | 📄 anatomy documented; automation needs a capture bridge (deferred) |
whale_storyboard (offline shot planning), whale_generate_video (provider routing with honest error surfacing), whale_quality_review (rule-level QC; LLM frame review planned)/dsh-video-studio/health route; installs via dsh plugin add, boot-verified clean43 unit tests green (quota routing, prompt merging, jianying draft structure, ffmpeg end-to-end render, provider protocols via mock servers, live jimeng model probe, live wanx image generation). Test logs and proof artifacts live in demos/.
dsh plugin --profile web add github:hackerFish/dsh-video-studio --ignore-workspace-root-check
# or npm once published
Model output quality is bounded by the vendor model; the pipeline maximizes it (consistency tokens, QC retry loop planned). sessionid/cookie usage is per-platform ToS — respect each platform's terms. Not affiliated with DeepSeek.
CLASSIFICATION EVIDENCE
系统优先读取 GitHub Topics,再与站内分类词典和词根规则比对。