Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds simulation-based tests of performance as package data to provide users context on how well inference works in some parameter regimes of interest (and one or two of perhaps less interest, with larger$R$ and $k$ ). Inference summaries are stored in the form of point (posterior median, maximum likelihood) and (95% credible and confidence) interval estimates.
An in-development vignette uses this data to provides a sense of coverage and bias in practice when using the model. (It doesn't cover cases where the model is misspecified, but that universe is far larger and out of scope.)
To do all this, this PR adds a$R$ , $k$ , and dataset size, as well as analyze with both Bayesian inference and maximum likelihood (both under default settings). The use of
make
-based workflow todata-raw
which can be run to simulate across a grid ofmake
and bash scripts which exist only to call R may not be strictly necessary. However, previous attempts at a purely R-based workflow resulted in a variety of failures, while this appears to be working.