Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replay DB and Global Stats #364

Draft
wants to merge 39 commits into
base: main
Choose a base branch
from

Commits on May 31, 2021

  1. Persist replay stats data to sqlite for faster access (project-slippi…

    …#126)
    
    * chore(vscode): use LF for new lines by default
    
    * Persist replay stats data to NeDB for faster access
    
    * Upgrade electron to 11.3.0
    
    The NeDB library required optional chaining which is not supported in
    the current version
    
    * Set DB location in userData
    
    * Support for folders and file changes in the db
    
    * Compute stats in the main process
    
    * Downgrade Electron
    
    Apparently Electron sucks a lot and the new version breaks the
    sourcegraph.
    Had to switch nedb-promises-typescript to @types/nedb due to lack of
    optional chaining support in the current version.
    
    * Delete from DB files from deleted folders
    
    * Add player tags to top level for easy querying
    
    * optimize file detection
    
    * Lazy load stats from the db
    
    * Switch from NeDB to sqlite3
    
    * Improve querying
    
    * Use worker_threads to parallelize stats computing
    
    * Restructure replay code
    
    * Separate server, db, and stats parser
    
    * Style fixes
    
    * Move replay code back to replayBrowser
    
    * Fix wiring
    
    * Restructure folder loading
    
    * Change db name to 'sqlippi.db'
    
    Co-authored-by: Vince Au <[email protected]>
    
    * Move @types/sqlite3 to dev dependency
    
    * Rename dao.ts to db.ts
    
    * Style fixes
    
    * Add worker pool for bulk stats loading
    
    * Consolidate ipc logic
    
    * Separate db into two tables
    
    * Move startTime to replay_data
    
    * Initial db schema draft
    
    * Remove schemaa file
    
    * Swap node-sqlite with better-sqlite3
    
    * Move db to worker thread
    
    * Add better-sqlite3 to thread-plugins bundled modules
    
    * Pass userdata path to the db from main thread
    
    * Typo in log
    
    * Remove old stats worker
    
    * Discard better-sqlite3
    
    * Revert "Discard better-sqlite3"
    
    This reverts commit 1aaa051.
    
    * fix: type issues
    
    * fix: better-sqlite3 rebuilding
    
    Co-authored-by: Vince Au <[email protected]>
    alvarosevilla95 and vinceau authored May 31, 2021
    Configuration menu
    Copy the full SHA
    84c566a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a50f8d3 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    87d62c6 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    fe83520 View commit details
    Browse the repository at this point in the history
  5. refactor: remove old code

    vinceau committed May 31, 2021
    Configuration menu
    Copy the full SHA
    58d620a View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    759810c View commit details
    Browse the repository at this point in the history
  7. fix: merge conflicts

    vinceau committed May 31, 2021
    Configuration menu
    Copy the full SHA
    dc1acc3 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2022

  1. Configuration menu
    Copy the full SHA
    74646d5 View commit details
    Browse the repository at this point in the history
  2. feat: rename db worker

    vinceau committed May 29, 2022
    Configuration menu
    Copy the full SHA
    d176cc6 View commit details
    Browse the repository at this point in the history
  3. fix: build issues

    vinceau committed May 29, 2022
    Configuration menu
    Copy the full SHA
    a122cd1 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    cc8006f View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    bc6314c View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2022

  1. Configuration menu
    Copy the full SHA
    fa1f95b View commit details
    Browse the repository at this point in the history
  2. wip

    vinceau committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    d0179b7 View commit details
    Browse the repository at this point in the history
  3. fix database stuff

    vinceau committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    ac2e48c View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    5256648 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    080e0ea View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    84ac953 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    6fc10e2 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    1cf28f6 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    e36136c View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    e4920d2 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2022

  1. Configuration menu
    Copy the full SHA
    02401e5 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2022

  1. Global stats caching

    alvarosevilla95 committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    b1972d8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    8f3a984 View commit details
    Browse the repository at this point in the history
  3. Add recharts lib

    alvarosevilla95 committed Dec 14, 2022
    Configuration menu
    Copy the full SHA
    8ef8f65 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e64714d View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2022

  1. Configuration menu
    Copy the full SHA
    d6bb31f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6771ed9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    896cbb3 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. Configuration menu
    Copy the full SHA
    894254d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    eb2e388 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    6bde45e View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a61faaa View commit details
    Browse the repository at this point in the history
  5. Refactoring

    alvarosevilla95 committed Dec 16, 2022
    Configuration menu
    Copy the full SHA
    deb0237 View commit details
    Browse the repository at this point in the history

Commits on Dec 20, 2022

  1. Configuration menu
    Copy the full SHA
    24bdacb View commit details
    Browse the repository at this point in the history

Commits on Dec 25, 2022

  1. Configuration menu
    Copy the full SHA
    5eec869 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    7f7f1c7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    315b3b4 View commit details
    Browse the repository at this point in the history