Skip to content

Commit

Permalink
Release 2.3.4
Browse files Browse the repository at this point in the history
  • Loading branch information
rodrigopivi committed Jul 22, 2019
1 parent 71e7ba1 commit 5877011
Show file tree
Hide file tree
Showing 5 changed files with 25 additions and 42 deletions.
57 changes: 20 additions & 37 deletions package-lock.json

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion package.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"name": "chatito",
"version": "2.3.3",
"version": "2.3.4",
"description": "Generate training datasets for NLU chatbots using a simple DSL",
"bin": {
"chatito": "./dist/bin.js"
Expand Down
2 changes: 2 additions & 0 deletions readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,8 @@ npx chatito <pathToFileOrDirectory> --format=<format> --formatOptions=<formatOpt
- `<testingFileName>` Optional. The name of the generated testing dataset file. Do not forget to add a .json extension at the end. Uses `<format>`_dataset_testing.json as default file name.
- `<defaultDistribution>` Optional. The default frequency distribution if not defined at the entity level. Defaults to `regular` and can be set to `even`.

- `<autoAliases>` Optional. The generaor behavior when finding an undefined alias. Valid opions are `allow`, `warn`, `restrict`. Defauls to 'allow'.

### Notes to prevent overfitting

[Overfitting](https://en.wikipedia.org/wiki/Overfitting) is a problem that can be prevented if we use Chatito correctly. The idea behind this tool, is to have an intersection between data augmentation and a probabilistic description of possible sentences combinations. It is not intended to generate deterministic datasets, you should avoid generating all possible combinations.
Expand Down
2 changes: 1 addition & 1 deletion spec.md
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ Nesting entities: Sentences defined inside a slot can only reference alias entit

#### 2.1.3 - Alias
The alias entity is defined by the `~[` symbols at the start of a line, following by the name of the alias and `]`.
Alias are just variations of a word and does not generate any tag. By default if an alias is referenced but not defined (like in the next example for `how are you`, it just uses the alias key name, this is useful for making a word optional but not having to add the extra lines of code defining a new alias. e.g.:
Alias are just variations of a word and does not generate any tag. By default if an alias is referenced but not defined (like in the next example for `how are you`, it just uses the alias key name, this is useful for making a word optional but not having to add the extra lines of code defining a new alias. (This 'auto alias' behavior can be configurable) e.g.:

```
%[greet]
Expand Down
4 changes: 1 addition & 3 deletions web/components/Editor/Editor.tsx
Original file line number Diff line number Diff line change
Expand Up @@ -484,9 +484,7 @@ export default class Editor extends React.Component<{}, IEditorState> {
const intentsWithoutLimit = ast.filter(entity => entity.type === 'IntentDefinition' && entity.args === null);
if (intentsWithoutLimit.length) {
return {
warning: `Warning: Limit the number of generated examples for intents. E.g.: %[${
intentsWithoutLimit[0].key
}]('training': '100')`
warning: `Warning: Limit the number of generated examples for intents. E.g.: %[${intentsWithoutLimit[0].key}]('training': '100')`
};
}
return null;
Expand Down

0 comments on commit 5877011

Please sign in to comment.