Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.Net: [Draft] main -> feature-connectors-assemblyai #8530

Draft
wants to merge 18 commits into
base: main
Choose a base branch
from

Commits on Mar 20, 2024

  1. .Net: Add AssemblyAI connector for Audio-to-text (#5094)

    ### Motivation and Context
    
    AssemblyAI is a speech AI company and SK provides a new
    `IAudioToTextService` for different connectors to implement.
    
    ### Description
    
    I added a connector for AssemblyAI that implements
    `IAudioToTextService`.
    The `AssemblyAIAudioToTextService` accepts `AudioContent` as mandated by
    the interface, but also a `Stream` as discussed
    [here](#4932), a
    `FileInfo`, and a `Uri`.
    
    Remarks:
    - I couldn't run tests in Connectors.UnitTests because of compilation
    issues in referenced projects, but I could verify the functionality in
    the integration tests.
    - We're working on our C# SDK, so the code will be updated once our C#
    SDK lands.
    
    Questions:
    - How should I set up the icon and README.md file in this connector
    project?
    - Should the `IAudioToTextService` interface accept
    `PromptExecutionSettings`? It seems a little odd to me since this isn't
    prompting an LLM.
    - Which of these overloads makes sense to pull into
    `IAudioToTextService`? I added `Stream`, `FileInfo`, and `Uri` to our
    implementation.
    
    Upcoming changes.
    
    - Change AudioAbstractions to accept an IAsyncEnumerable<StreamingAudioContent> instead of AudioStreamContent class.
    
    ### Contribution Checklist
    
    - [ ] The code builds clean without any errors or warnings
    - [x] The PR follows the [SK Contribution
    Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
    and the [pre-submission formatting
    script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
    raises no violations
    - [ ] All unit tests pass, and I have added new tests where possible
    - [x] I didn't break anyone 😄
    
    ---------
    
    Co-authored-by: Roger Barreto <[email protected]>
    Swimburger and RogerBarreto authored Mar 20, 2024
    Configuration menu
    Copy the full SHA
    c5f66e5 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2024

  1. .Net: Add AssemblyAI connector for Audio-to-text (#5094)

    AssemblyAI is a speech AI company and SK provides a new
    `IAudioToTextService` for different connectors to implement.
    
    I added a connector for AssemblyAI that implements
    `IAudioToTextService`.
    The `AssemblyAIAudioToTextService` accepts `AudioContent` as mandated by
    the interface, but also a `Stream` as discussed
    [here](#4932), a
    `FileInfo`, and a `Uri`.
    
    Remarks:
    - I couldn't run tests in Connectors.UnitTests because of compilation
    issues in referenced projects, but I could verify the functionality in
    the integration tests.
    - We're working on our C# SDK, so the code will be updated once our C#
    SDK lands.
    
    Questions:
    - How should I set up the icon and README.md file in this connector
    project?
    - Should the `IAudioToTextService` interface accept
    `PromptExecutionSettings`? It seems a little odd to me since this isn't
    prompting an LLM.
    - Which of these overloads makes sense to pull into
    `IAudioToTextService`? I added `Stream`, `FileInfo`, and `Uri` to our
    implementation.
    
    Upcoming changes.
    
    - Change AudioAbstractions to accept an IAsyncEnumerable<StreamingAudioContent> instead of AudioStreamContent class.
    
    - [ ] The code builds clean without any errors or warnings
    - [x] The PR follows the [SK Contribution
    Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
    and the [pre-submission formatting
    script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
    raises no violations
    - [ ] All unit tests pass, and I have added new tests where possible
    - [x] I didn't break anyone 😄
    
    ---------
    
    Co-authored-by: Roger Barreto <[email protected]>
    Swimburger and RogerBarreto committed May 27, 2024
    Configuration menu
    Copy the full SHA
    b38262e View commit details
    Browse the repository at this point in the history
  2. Fix errors

    RogerBarreto committed May 27, 2024
    Configuration menu
    Copy the full SHA
    cc99fc0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a7c40c6 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2024

  1. .Net: Add AssemblyAI file service Remake from #5964 (#6406)

    ### Motivation and Context
    
    <!-- Thank you for your contribution to the semantic-kernel repo!
    Please help reviewers and future users, providing the following
    information:
      1. Why is this change required?
      2. What problem does it solve?
      3. What scenario does it contribute to?
      4. If it fixes an open issue, please link to the issue here.
    -->
    
    ### Description
    
    <!-- Describe your changes, the overall approach, the underlying design.
    These notes will help understanding how your code works. Thanks! -->
    
    ### Contribution Checklist
    
    <!-- Before submitting this PR, please make sure: -->
    
    - [ ] The code builds clean without any errors or warnings
    - [ ] The PR follows the [SK Contribution
    Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
    and the [pre-submission formatting
    script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
    raises no violations
    - [ ] All unit tests pass, and I have added new tests where possible
    - [ ] I didn't break anyone 😄
    
    ---------
    
    Co-authored-by: Niels Swimberghe <[email protected]>
    RogerBarreto and Swimburger authored Jun 6, 2024
    Configuration menu
    Copy the full SHA
    886053d View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Merge branch 'main' of https://github.com/microsoft/semantic-kernel i…

    …nto upstream/feature-connectors-assemblyai
    RogerBarreto committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    0857342 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    de08324 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. Configuration menu
    Copy the full SHA
    93dea36 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Configuration menu
    Copy the full SHA
    497f14b View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Configuration menu
    Copy the full SHA
    b82d551 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    64a8438 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Configuration menu
    Copy the full SHA
    56a7be1 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Configuration menu
    Copy the full SHA
    09fc338 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. Configuration menu
    Copy the full SHA
    1fc884a View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Configuration menu
    Copy the full SHA
    e1525da View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2024

  1. Configuration menu
    Copy the full SHA
    288dae8 View commit details
    Browse the repository at this point in the history

Commits on Nov 8, 2024

  1. Configuration menu
    Copy the full SHA
    9ff8b69 View commit details
    Browse the repository at this point in the history
  2. .Net: Refactor AssemblyAI connector to use AssemblyAI SDK (#8556)

    ### Motivation and Context
    
    ### Description
    
    By using the SDK, users can use the `TranscriptOptionalParams` class
    from the SDK to pass parameters to the AssemblyAI transcription
    endpoint.
    
    ### Contribution Checklist
    
    - [x] The code builds clean without any errors or warnings
    - [x] The PR follows the [SK Contribution
    Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
    and the [pre-submission formatting
    script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
    raises no violations
    - [x] All unit tests pass, and I have added new tests where possible
    - [x] I didn't break anyone 😄
    
    ---------
    
    Co-authored-by: Roger Barreto <[email protected]>
    Swimburger and RogerBarreto authored Nov 8, 2024
    Configuration menu
    Copy the full SHA
    26c7f7b View commit details
    Browse the repository at this point in the history