dcaegen2-services-data-router retry timeout

Description

This is the explanation of the failure case:
"If the most recent delivery result was a failure, then no more attempts will be made for a period of time.  Initially, and on the first failure following a success, this delay will be DeliveryQueueHelper.getInitFailureTimer() (milliseconds).
If, after this delay, additional failures occur, each failure will multiply the delay by DeliveryQueueHelper.getFailureBackoff() up to a maximum delay specified by DeliveryQueueHelper.getMaxFailureTimer().
Note that this behavior applies to the delivery queue as a whole and not to individual files in the queue."

In case of subscriber not available multible times the retry-timeout seems to be to high. We had sometimes to wait for more than 15min that the delivery to a subscriber worked again.
This retry timeout should be put to lower value.

 

To update the values we can use the "internal" api

curl --location --request PUT 'http://{dr-prov-url}/internal/api/DELIVERY_FILE_PROCESS_INTERVAL?val=60'

curl --location --request PUT 'http://{dr-prov-url}/internal/api/DELIVERY_MAX_RETRY_INTERVAL?val=600'

dr-node will pick up its config automatically but to trigger manually

curl --location --request GET 'http://{dr-node-url}/internal/fetchProv

Attachments

6

Activity

Show:

Viresh Navalli May 26, 2023 at 5:52 AM

Hi  

Can we close this ticket. Seems this needs to be done with custom script post pod deployment ( correct me if I am wrong). Also we are not receiving any comment from  

 

Thanks 

Viresh N

Viresh Navalli April 19, 2023 at 3:09 AM

Hi  

Thanks for your comments. I have just a question, bash script should be part of post-install helm chart hook right.

 

//cc  

Former user April 18, 2023 at 3:30 PM

Hi  

The above vars would need to be set via the internal api. They will not be picked up from ENV var.
These are local config for dmaap-dr-prov stored in it's DB. We removed the sql script from the helm charts due to concerns about invalid config.

A simple bash script to run post deploy would prob be the easiest approach.

Viresh Navalli April 18, 2023 at 2:19 PM

Hi  

I have tried adding a temporary variable as below in oom chart and it is available in the POD containers under ENVIRONMENT variable. If you are ok with this approach, I will add both variables ( DELIVERY_FILE_PROCESS_INTERVAL , DELIVERY_MAX_RETRY_INTERVAL ) and submit the code.

 

Viresh Navalli March 16, 2023 at 1:28 PM

Hi  

Can you please suggest if above requirement from already available as part of helm charts as this is common/general requirement to access environment variables from helm chart to application containers during startup. 

Does this require code levels changes too? I am also looking into it.

Details

Assignee

Reporter

Fix versions

Priority

Created November 16, 2022 at 11:27 AM
Updated May 26, 2023 at 5:52 AM
Resolved November 16, 2022 at 11:27 AM
Loading...