fallback
Attempts to send each message to a child output, starting from the first output on the list. If an output attempt fails then the next output in the list is attempted, and so on.
Introduced in version 1.0.0.
# Config fields, showing default values
output:
label: ""
fallback: []
This pattern is useful for triggering events in the case where certain output targets have broken. For example, if you had an output type http_client
but wished to reroute messages whenever the endpoint becomes unreachable you could use this pattern:
output:
fallback:
- http_client:
url: http://foo:4195/post/might/become/unreachable
retries: 3
retry_period: 1s
- http_client:
url: http://bar:4196/somewhere/else
retries: 3
retry_period: 1s
processors:
- mapping: 'root = "failed to send this message to foo: " + content()'
- file:
path: /usr/local/bento/everything_failed.jsonl
Metadata
When a given output fails the message routed to the following output will have a metadata value named fallback_error
containing a string error message outlining the cause of the failure. The content of this string will depend on the particular output and can be used to enrich the message or provide information used to broker the data to an appropriate output using something like a switch
output.
Batching
When an output within a fallback sequence uses batching, like so:
output:
fallback:
- aws_dynamodb:
table: foo
string_columns:
id: ${!json("id")}
content: ${!content()}
batching:
count: 10
period: 1s
- file:
path: /usr/local/bento/failed_stuff.jsonl
Bento makes a best attempt at inferring which specific messages of the batch failed, and only propagates those individual messages to the next fallback tier.
However, depending on the output and the error returned it is sometimes not possible to determine the individual messages that failed, in which case the whole batch is passed to the next tier in order to preserve at-least-once delivery guarantees.