Skip to content

Add speech annotation tool using SAM-Audio #204

Open

Description

@AnkushMalaker
No description provided.

Activity

  1. linear commented on Dec 18, 2025

    @linear
  2. DebjyotiRay commented on Dec 20, 2025

    @DebjyotiRay
    1. Is this for automatic audio segmentation (using Meta's SAM-Audio to isolate speakers/remove noise), OR a manual annotation UI tool for labeling audio segments?
    2. Should it be a new backend service, part of the existing advanced backend, or a web UI feature in the dashboard?
  3. AnkushMalaker commented on Dec 22, 2025

    @AnkushMalaker
    CollaboratorAuthor

    Hey @DebjyotiRay
    Sorry, forgot to update here- we've actually been discussing this a lot on discord.
    To me, this changes the paradigm a bit of whats possible. Needs tweaking, but sure. I first want to know what this model is capable of, and for that, @01PrathamS tried to make a google colab notebook but wasn't able to load the model

    I was able to load it on a 4090 and run some inference and the demo looked good. But its so big that its hard to run any experiments. I think its only a couple days though.
    You should come ideate with us

    Anyway-

    1. Ideally one tool that does both seamlessly, that'd be the point.
    2. This should be in extras/ as a separate micro service with its own UI. The service can be exposed to the backend via some API. The speaker recognition service is arranged that way.

    But still, try running the model on something and let me know if you're able to

  4. DebjyotiRay commented on Dec 22, 2025

    @DebjyotiRay

    Would love to ideate, where's the discord? Let's see if we can come to someplace in between towards the implementation

  5. 01PrathamS commented on Dec 23, 2025

    @01PrathamS
    Contributor
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions