feat(examples): add MOSS diarization to offline vLLM sample - #3678
Merged
Conversation
Signed-off-by: zhifu gao <zhifu.gzf@alibaba-inc.com>
Closed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Related to #3419; keep the issue open for reporter validation.
--engine mossto the requestedtranscribe_vllm_offline.pysample. Default Qwen3 native-vLLM behavior and its JSON filename/schema remain unchanged.AutoModelHTTP adapter, upload the whole recording once, requestdiarized_json, and preservetext/raw_text/timestamp/sentence_info. Print anonymous speaker labels with millisecond times.MOSS_VLLM_API_KEY; reject malformed configuration and input/output aliases, including hard links.Verification
e8681d68e7042738ffca8ac8212bc8fcb1131ab8, cached model files revalidated against Hub blob/LFS digests; vLLM 0.27.1 with eager mode, max model length 32768, one sequence and GPU utilization 0.2. The fresh CPU client processed a 5.5466875-second public README sample, returned a nonempty transcript, one S01 segment ending at 5210 ms, and exited 0. The owned service exited normally and was stopped afterward.Boundaries
This is an offline third-party MOSS path, not MOSS labels attached to Qwen3 text. Labels are anonymous within one recording, not known identity, cross-file identity, or realtime/WebSocket diarization. The 8192 completion limit is configurable, not a guarantee for the reporter's 480-second recording. The short single-speaker smoke is not a CER, multi-speaker accuracy, tail-completeness, throughput or production-capacity benchmark.
Qwen3 vLLM 0.14.0 and the pinned MOSS service vLLM 0.27.1 recipes remain separate environments. Source changes are not yet in PyPI 1.4.14. Backups, exact source hashes and original failure logs are retained before publication.