-
Notifications
You must be signed in to change notification settings - Fork 1.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
out_blob: consider auto_create_container #9457
out_blob: consider auto_create_container #9457
Conversation
3c540f3
to
2e6f8ef
Compare
I am also wondering, isn't the logic in https://github.com/fluent/fluent-bit/pull/9457/files#diff-f844d79a27a0ee277d33bbdd76e0244cf5c89af81e86a1ecdf2577f11f3cef1fL994-L1006 redundant considering we are checking if this inside |
I'll add some more context here - we are using SAS token authentication and want to make sure all fluent-bit clients have permissions to write but not to read (so clients from different clusters could not read each other's data). When creating a SAS token with write only permissions we are seeing the following errors:
This is because the SAS token doesn't have permissions call GetContainerProperties to ensure the container exists. There no error printed (even in debug). We can see we have a retry before failing but this happens across all chunks effectively dropping everything. |
194cad8
to
33d6d46
Compare
1. Today we are not considering this setting 2. Changing the behaviour that setting auto_create_container to false should return FLB_TRUE. If auto_create_container=false return FLB_FALSE, fluent-bit will never flush data to storage account, it will retry and eventually fail. Signed-off-by: Uri Sternik <[email protected]>
33d6d46
to
88f44c6
Compare
@leonardo-albertovich any chance to get some 👀 here? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Once that single issue is addressed this can be approved.
Please correct me if I missed something and my comment is wrong.
Signed-off-by: Uri Sternik <[email protected]>
f51340b
to
e2aaa87
Compare
Hey @leonardo-albertovich 👋 |
Consider auto_create_container when ensuring container exist
Fixes #9459
Enter
[N/A]
in the box, if an item is not applicable to your change.Testing
Before we can approve your change; please submit the following in a comment:
No need for debug log output, attaching info log output
With
auto_create_container
on:With
auto_create_container
off:If this is a change to packaging of containers or native binaries then please confirm it works for all targets.
ok-package-test
label to test for all targets (requires maintainer to do).Documentation
Backporting
Will do after this one is merged
Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.