Skip to content

Commit

Permalink
Merge pull request #3 from deep-insights-ai/master
Browse files Browse the repository at this point in the history
get latest version from upstream
  • Loading branch information
MillivoltLightningbolt authored Apr 24, 2020
2 parents 76e9386 + 83d18ce commit e9991e0
Show file tree
Hide file tree
Showing 2 changed files with 44 additions and 6 deletions.
37 changes: 37 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,37 @@


(please add newer changelog messages to the top of this file)

(Note that you can always get the latest model at https://labs.deep-insights.ai/models/latest.pkl).

# version 0.8 (2020/4/24)

This is the final model for the paper.

* model is a resnet50, pixelsize 448x448
* model now achieves the following accuracy, sensitivity and specificity on the **validation set**:

| | precision | recall | f1-score |
|----------------|---------------|---------|------------|
| COVID | 0.96 | 0.92 | 0.94 |
| Non-COVID | 0.93 | 0.97 | 0.95 |


* and on the independent **test set**:
```
sensitivity: 84.44%
specificity: 93.33%
precision: 92.68%
negative predictive value: 85.71%
accuracy: 88.88%
```

In absolute numbers this results in:

```
true positive: 38, true negative: 42
false positive: 3, false negative: 7
```


The model can be downloaded at https://labs.deep-insights.ai/models/rn50-448px-v0.8-export.pkl.
13 changes: 7 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ A [fastai2](https://www.fast.ai/) based Covid-19 classifier.
# Summary

This Covid-19-classifier is a Deep Learning based image classifier which is able to categorize lung CT Scans as either COVID-19, PATHOLOGICAL (which groups together MERS, viral pneumonia and other diseases), or as NORMAL (non-pathological) lungs scans.
Our **accuracy is ~ 90%**. In previous runs we achieved up to 98% accuracy, but we decided to tune down the accuracy in favor of gaining stability and sensitivity of the model. Please stay tuned for further improved versions of the model.
Our **accuracy is 94.5%**.

Our very latest model can always be downloaded [here](https://labs.deep-insights.ai/models/latest.pkl).

Expand Down Expand Up @@ -49,17 +49,18 @@ At the moment of writing (April 2020) the easiest installation method for fastai
```bash
pip install fastai2
```
Later in 2020, with the release of the new [course](https://course.fast.ai/) on [fast.ai](https://www.fast.ai/) the original fastai library will be updated to version 2.
Later in 2020, with the release of the new [course](https://course.fast.ai/) on [fast.ai](https://www.fast.ai/) the original fastai library will be updated to version 2. We are already using this newer version 2.
For more information and additional installation instructions (e.g. via conda) please see the github repos for:

[fastai](https://github.com/fastai/fastai)

[fastai version 2](https://github.com/fastai/fastai2)


### Jupyter notebooks

If you only want to use our model for inference you don't need Jupyter notebooks,
but if you want to play around with our training notebook and train the model yourself, perhaps on your own data
If you only want to use our model for inference you don't need Jupyter notebooks.
But if you want to play around with our training notebook and train the model yourself, perhaps on your own data,
then we recommend to install jupyter notebook for quick experimentations.

To install jupyter notebooks please follow the [installation guides](https://jupyter.org/install) and make sure you are able to run jupyter notebooks.
Expand All @@ -70,7 +71,7 @@ To install jupyter notebooks please follow the [installation guides](https://jup

Run the training notebook:
```bash
cd v0.4/
cd v0.8/
jupyter-notebook cov-19-training.ipynb
```

Expand All @@ -79,4 +80,4 @@ If you do not have access to a nVidia GPU we recommend a free service like [Kagg

## Inference (classifying images)

See the [inference](https://github.com/deep-insights-ai/covid-19-classifier/blob/master/v0.4/inference.py) example.
See the [inference](https://github.com/deep-insights-ai/covid-19-classifier/blob/master/v0.8/inference.py) example.

0 comments on commit e9991e0

Please sign in to comment.