Turnio - Turn SaaS cluster services restarting – Incident details

All systems operational

Turn SaaS cluster services restarting

Resolved
Major outage
Started about 2 years agoLasted about 21 hours
Updates
  • Resolved
    Resolved
    This issue has been resolved.
  • Update
    Update
    All services are working normally, we're continuing to observe it.
  • Monitoring
    Monitoring
    All services are back online. Automated responses may still be delayed at times as message queues are being cleared. We continue to monitor the situation.
  • Update
    Update
    The faulty servers have been taken out of rotation and have been replaced with new and health ones. Services are coming back online one by one. Our apologies for this unplanned interruption of service on the Turn SaaS platform.
  • Identified
    Identified
    We have noticed that our cloud hosting provider has marked a number of machines in our production cluster as unhealthy and has proceeded to restart and replace them. While services are restarting and migrating to new servers, there will be disconnects and WhatsApp services will be unavailable at times. We are working on making sure this process completes as fast as possible. Any messages received from users during this period will be processed as soon as services come back online.
  • Investigating
    Investigating