Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Lazy loading #220

Draft
wants to merge 70 commits into
base: main
Choose a base branch
from
Draft

Lazy loading #220

wants to merge 70 commits into from

Commits on Jun 19, 2023

  1. Removing load balancing config

    @TosinSeg
    TosinSeg committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    4eac006 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. Reformatting tests

    @TosinSeg
    TosinSeg committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    c68e999 View commit details
    Browse the repository at this point in the history

  2. Fixed the formatting

    @TosinSeg
    TosinSeg committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    5ce1a92 View commit details
    Browse the repository at this point in the history

  3. Removed print statement

    @TosinSeg
    TosinSeg committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    fa10e19 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Merging main

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    f9cbd74 View commit details
    Browse the repository at this point in the history

  2. Removing unused import

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    8970f4e View commit details
    Browse the repository at this point in the history

  3. Fixing tests

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    517bea8 View commit details
    Browse the repository at this point in the history

  4. Fixing merge issue

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    58dd2b2 View commit details
    Browse the repository at this point in the history

  5. Creating hostfile when one is not provided

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    bb0d551 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into Always_enable_load_balancing

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    e2bb9d5 View commit details
    Browse the repository at this point in the history

  7. Fixing import statements removed by merge

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    3823534 View commit details
    Browse the repository at this point in the history

  8. Removing load_balancing check

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    6f9b4ad View commit details
    Browse the repository at this point in the history

  9. Removing redudant definitions

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    499b9ad View commit details
    Browse the repository at this point in the history

  10. Removing hostfile from test

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    5419ef6 View commit details
    Browse the repository at this point in the history

  11. Removing hostfile from non-persistent test

    @TosinSeg
    TosinSeg committed Jun 26, 2023
    Configuration menu
    Copy the full SHA
    a70b6de View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. initial changes

    @TosinSeg
    TosinSeg committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    eea658b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into multi-model-deployment

    @TosinSeg
    TosinSeg committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    20f0878 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Maintaining current behavior

    @TosinSeg
    TosinSeg committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    c21c31b View commit details
    Browse the repository at this point in the history

  2. Reading from score file

    @TosinSeg
    TosinSeg committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    f525329 View commit details
    Browse the repository at this point in the history

  3. fixing syntax errors

    @TosinSeg
    TosinSeg committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    3c0937f View commit details
    Browse the repository at this point in the history

  4. Fixing more syntax errors

    @TosinSeg
    TosinSeg committed Jun 28, 2023
    Configuration menu
    Copy the full SHA
    156ac83 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. Fixing more syntax issues

    @TosinSeg
    TosinSeg committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    38e270e View commit details
    Browse the repository at this point in the history

  2. initial lb changes

    @TosinSeg
    TosinSeg committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    4d4e0d8 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into multi-model-deployment

    @TosinSeg
    TosinSeg committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    01c8e59 View commit details
    Browse the repository at this point in the history

  4. More load balancing changes

    @TosinSeg
    TosinSeg committed Jun 29, 2023
    Configuration menu
    Copy the full SHA
    f801b36 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2023

  1. LB changes and syntax

    @TosinSeg
    TosinSeg committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    fd4e2ed View commit details
    Browse the repository at this point in the history

  2. Refactor client, and unpack request in load balancer

    @TosinSeg
    TosinSeg committed Jun 30, 2023
    Configuration menu
    Copy the full SHA
    0a3b7e5 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. First working queries

    @TosinSeg
    TosinSeg committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    6523c04 View commit details
    Browse the repository at this point in the history

  2. Fixing conversational and q&a args

    @TosinSeg
    TosinSeg committed Jul 3, 2023
    Configuration menu
    Copy the full SHA
    06b40f5 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Updates to _allocate_processes and fixing example

    @TosinSeg
    TosinSeg committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    96d0dcb View commit details
    Browse the repository at this point in the history

  2. Adding host map for allocating processes and formatting

    @TosinSeg
    TosinSeg committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    ab41d24 View commit details
    Browse the repository at this point in the history

  3. Fixing terminate functionality

    @TosinSeg
    TosinSeg committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    8673a9a View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2023

  1. Refactored client

    @TosinSeg
    TosinSeg committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    8d09b37 View commit details
    Browse the repository at this point in the history

  2. More Refactoring and q/a example

    @TosinSeg
    TosinSeg committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    7a136d6 View commit details
    Browse the repository at this point in the history

  3. Reformatting to maintain previous syntax

    @TosinSeg
    TosinSeg committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    2c6ec08 View commit details
    Browse the repository at this point in the history

  4. Removing print/debug statements

    @TosinSeg
    TosinSeg committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    0cb88a9 View commit details
    Browse the repository at this point in the history

  5. Fixing non-persistent deloyments

    @TosinSeg
    TosinSeg committed Jul 6, 2023
    Configuration menu
    Copy the full SHA
    7c0ee12 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. Refactoring Load balancer launch

    @TosinSeg
    TosinSeg committed Jul 7, 2023
    Configuration menu
    Copy the full SHA
    7a956d5 View commit details
    Browse the repository at this point in the history

Commits on Jul 10, 2023

  1. Fixing restful gateway client

    @TosinSeg
    TosinSeg committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    f8cfe28 View commit details
    Browse the repository at this point in the history

  2. Fixing replica issue

    @TosinSeg
    TosinSeg committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    079807d View commit details
    Browse the repository at this point in the history

  3. Fixing non persistent client

    @TosinSeg
    TosinSeg committed Jul 10, 2023
    Configuration menu
    Copy the full SHA
    ea1e47e View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. Refactoring

    @TosinSeg
    TosinSeg committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    daab5e6 View commit details
    Browse the repository at this point in the history

  2. Update mii/models/score/generate.py 

    Co-authored-by: Michael Wyatt <[email protected]>
    @TosinSeg @mrwyattii
    TosinSeg and mrwyattii authored Jul 12, 2023
    Configuration menu
    Copy the full SHA
    84073f9 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. Merge branch 'multi-model-deployment' of github.com:TosinSeg/DeepSpee… 

    …d-MII into multi-model-deployment
    Tosin Segun committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    3ee3410 View commit details
    Browse the repository at this point in the history

  2. Refactoring Load Balancer and request_proto

    Tosin Segun committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    b4edc2b View commit details
    Browse the repository at this point in the history

  3. Formatting

    Tosin Segun committed Jul 13, 2023
    Configuration menu
    Copy the full SHA
    6346194 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2023

  1. Fixing the client

    Tosin Segun committed Jul 14, 2023
    Configuration menu
    Copy the full SHA
    94b6699 View commit details
    Browse the repository at this point in the history

Commits on Jul 21, 2023

  1. Initial partial deployment commit

    Tosin Segun committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    710c20b View commit details
    Browse the repository at this point in the history

  2. More partial deploy updates

    Tosin Segun committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    c2636b7 View commit details
    Browse the repository at this point in the history

  3. Partial deploy started

    Tosin Segun committed Jul 21, 2023
    Configuration menu
    Copy the full SHA
    189e75c View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. fixing add deploy api queries

    Tosin Segun committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    adee843 View commit details
    Browse the repository at this point in the history

  2. Support for empty deployment 'group'

    Tosin Segun committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    a145be5 View commit details
    Browse the repository at this point in the history

  3. Support for empty deployment 'group'

    Tosin Segun committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    082c05e View commit details
    Browse the repository at this point in the history

Commits on Jul 25, 2023

  1. Partial Termination

    Tosin Segun committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    3ce77d2 View commit details
    Browse the repository at this point in the history

  2. Refactoring

    Tosin Segun committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    b40ecbd View commit details
    Browse the repository at this point in the history

  3. formatting

    Tosin Segun committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    72dd95c View commit details
    Browse the repository at this point in the history

  4. fixing bug for partial termination

    Tosin Segun committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    a4e3d56 View commit details
    Browse the repository at this point in the history

  5. Removing comments

    Tosin Segun committed Jul 25, 2023
    Configuration menu
    Copy the full SHA
    4b5bb47 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2023

  1. Including GPU index map in score file

    Tosin Segun committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    30d2b03 View commit details
    Browse the repository at this point in the history

  2. Refactoring deployment

    Tosin Segun committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    c5d5996 View commit details
    Browse the repository at this point in the history

  3. Refactoring and formatting

    Tosin Segun committed Jul 26, 2023
    Configuration menu
    Copy the full SHA
    3ae1781 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Refactoring

    Tosin Segun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    4b8f02f View commit details
    Browse the repository at this point in the history

  2. Fixing Readme

    Tosin Segun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    c51ce37 View commit details
    Browse the repository at this point in the history

  3. Refactoring GRPC

    Tosin Segun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    43479db View commit details
    Browse the repository at this point in the history

  4. Fixing LB process not terminating

    Tosin Segun committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    e1b6d23 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2023

  1. Adding multi_deployment and partial deploy/terminate unit tests

    Tosin Segun committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    1675bd8 View commit details
    Browse the repository at this point in the history

  2. Removing comments

    Tosin Segun committed Jul 31, 2023
    Configuration menu
    Copy the full SHA
    8684a61 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2023

  1. Fixing spelling issues

    Tosin Segun committed Aug 1, 2023
    Configuration menu
    Copy the full SHA
    56a7fce View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2023

  1. Initial lazy loading changes

    Tosin Segun committed Aug 4, 2023
    Configuration menu
    Copy the full SHA
    71dd350 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2023

  1. Adding print statements

    Tosin Segun committed Aug 10, 2023
    Configuration menu
    Copy the full SHA
    66fd055 View commit details
    Browse the repository at this point in the history