Details regarding Deni AI downtime

TL;DR

• Cause: The service was suspended by the administrator because it was running on a free server that prohibits commercial use.
• Action: Migrated to Cloud VPS 4 from Contabo, and the service has now been successfully restored.
• Apology: As an apology for this issue, we plan to reset the rate limits for all users.

---

Incident Overview

The server hosting Deni AI was suspended by the administrator, causing a temporary service outage. We apologize for any inconvenience caused.

Timeline from Outage to Recovery

• 13:11 - The server hosting Deni AI was suspended by the administrator.
• 13:12 ~ 13:20 - Detected the server down and performed a manual restart as no notice had been received.
• 13:25 - The server was suspended again. Subsequently, received a notice regarding the terms of service from the server administrator.
• 21:42 - Subscribed to a new server as the migration destination and confirmed the SSH connection.
• 21:43 ~ 23:25 - Performed server setup (Dokploy, zsh, adding users, etc.).
• 23:26 - All Deni AI services were temporarily restored.
• 23:29 - Started the process to change the database region from ap-southeast-1 (Singapore) to eu-central-1 (Germany).
• 23:40 - Confirmed the completion of the database migration, achieving full recovery.

Cause

The free server in use had terms of service prohibiting commercial use, and the server was suspended by the administrator for violating this policy.

---

Preventive Measures and Future Actions

• Strict Compliance with Terms of Service: We will thoroughly check and comply with the terms of services we use in advance.
• Strengthening Monitoring and Notification Systems: We will implement a system to automatically send alerts upon anomaly detection so that we can immediately notice even if a server is suspended.
• Apology to Users: As an apology for the inconvenience caused, we will reset the rate limits for the affected users.