[RESOLVED] NA11 | Intermittent Latency PROD & UAT

 POSTED: Jun 15, 2021 3:03:08 PM        NA11, Latency, Intermittent

[ROOT CAUSE ANALYSIS]

Description:

Intermittent Failures Accessing CLM NA11 Services

Timeframe:

18:24 UTC 6/15/21 to 14:57 UTC 6/17/21

Impact:

Customers in CLM NA11 experienced intermittent failures accessing the system.

Cause:

Upstream ISP provider experienced multiple DDoS events, impacting network operation.

Resolution:

ISP provider implemented additional defenses to mitigate current and future DDoS events. ISP will continue to monitor for future DDoS events and mitigate them.

Next Steps:

CLM will re-evaluate their upstream provider’s services. Additionally, CLM will implement new services and systems that will improve reliability, stability, and security.


[RESOLVED June 23, 2021, 09:45 CDT] The DocuSign CLM Technology team has declared this incident resolved.  The last detected latency related to this incident occurred on 6/17/2021.  The DocuSign Technology team will provide an official Root Cause Analysis of this incident within 48 hours.  Thank you for your patience and we apologize for the inconvenience.

[UPDATED June 22, 2021, 09:45 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the day until resolution is declared.

[UPDATED June 21, 2021, 10:00 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the day until resolution is declared.

[UPDATED June 18, 2021, 17:20 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the weekend until resolution is declared.

[UPDATED June 18, 2021, 08:10 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the day until resolution is declared.

[UPDATED June 17, 2021, 17:00 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the evening until resolution is declared.

[UPDATED June 17, 2021, 08:30 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the day until resolution is declared.

[UPDATED June 16, 2021, 16:30 CDT ] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the evening until resolution is declared.

[UPDATED June 16, 2021 13:20 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the day until resolution is declared.

[UPDATED June 16, 2021 06:40 CDT] The DocuSign CLM Technology team has seen some improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the morning until resolution is declared.

Please check the status of trust.springcm.com for updates regarding this issue.

[UPDATED June 15, 2021 20:15 CDT] The DocuSign CLM Technology team has seen an improvement in the performance issue but cannot declare resolved until our 3rd party vendor has given clearance.  The team will continue to monitor the incident through the night until resolution is declared.

Please check the status of trust.springcm.com for updates regarding this issue.

[UPDATED June 15, 2021 16:30 CDT] The DocuSign CLM Technology team has isolated the performance issue and is working with our 3rd party vendor on which the incident it occurring.  During this time customers with accounts on our NA11 Production and UAT instances may experience intermittent latency issues as well as the potential for encountering page errors while navigating the site.  

Please check the status of trust.springcm.com frequently for updates regarding this issue.

[POSTED Jun 15, 2021 15:03 CDT] The DocuSign CLM Technology team is working to isolate a performance degradation issue, on the application tier of the NA11 instance.

Continue reading...

[RESOLVED] NA21 | Intermittent REST API Initiated Workflow Error

 POSTED: Feb 27, 2020 10:18:33 AM        Workflow, NA21, API, Intermittent

[ROOT CAUSE ANALYSIS]  

Description:

NA21 environment: Intermittent Errors when attempting to start workflow via API

Timeframe:

11:47am PT 22nd Feb 2020 to 9:30pm PT 27th Feb 2020

Impact:

Customers experienced intermittent errors when initiating a workflow via the REST API

Cause:

A planned network configuration change caused frames to be intermittently lost.

Resolution:

Networking configuration was corrected.

 

[RESOLVED February 27th 23:24 CST] The DocuSign CLM/SpringCM Technology team resolved the intermittent issue on the NA21 instance and will be providing further details and a root cause analysis in the near future.  We apologize for any inconvenience. This incident began at 11:47am Feb 22 and ended 21:30pm Feb 27th.

Continue reading...

Subscribe to Email Updates

Subscribe by email to get notified as soon as we post a status update.