Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Aug 26, 2021 - 00:00 GMT+08:00
Scheduled
Beginning tonight we will be performing a large-scale data migration activity on Leads and Lead logs data affecting all tenants. This activity will take several hours as we will be processing millions of objects.
The objective of the data migration is to synchronise the existing data with a new data lake database. As part of the migration, we will also correct some inconsistent data caused by previous incidents or bugs we had encountered over the previous year or earlier.
The new data lake will allow us to perform analytical activities more securely and with minimal impact to our users' experiences, as previously some computationally intensive operations done in the same database would cause noticeable performance impacts on the user applications.
This activity will not cause any downtime or data loss, as in general we will only be duplicating data from the existing primary database to the new data lake database. However, it will cause a noticeable performance slowdown i.e .slow updates for leads and leadlogs data, because our database performance and message queues will be saturated during the migration. In light of this, we will only be performing this activity during midnight hours so as to not disrupt the daily operations i.e. from 12AM to 8AM MYT.
We advise customers to avoid using the Manager Portal and Mobile Application during the data migration.
Side effects which may happen during and after the migration:
- New Leads and Lead logs data received during the migration may only appear several minutes or hours later
- The routing system may be switched off during the migration if the tenant has many leads pending routing
- Analytical functions such as the Dashboard, Salespersons Action Reports, Lead Performance Reports and Project CPX reports may show inaccurate data as their data source will be switched to the new data lake and may not have complete data while the migration is still ongoing
- Customers utilising the CandySync Webhook subscribing to Lead changes may receive an abnormally large number of lead modification events with no noticeable changes in the data
- Numbers of lead counts and in reports may be different before and after the migration, due to changes in the data structures. Moving forward, we will not consider any inconsistencies as bugs or defects, the new updated data will considered the current and correct version
There is a possibility that the data migration may not be completed within the stipulated 8 hour time frame, where we will continue the next day also at midnight. The progress will be reported here on https://status.salescandy.com
Posted Aug 25, 2021 - 16:21 GMT+08:00
This scheduled maintenance affected: Manager Portal (Application), Mobile Application (Management API), and CandySync Webhook, Lead Routing.