tag:status.starrezcloud.io,2005:/historyStarRez Cloud Status - Incident History2024-03-28T18:40:08ZStarRez Cloudtag:status.starrezcloud.io,2005:Incident/203671942024-04-02T03:00:00Z2024-03-26T22:58:22ZScheduled Backend Platform Maintenance - StarRez Cloud Payment Service<p><strong>THIS IS A SCHEDULED EVENT Apr <var data-var='date'>2</var>, <var data-var='time'>03:00</var> - <var data-var='time'>05:00</var> UTC</strong></p><p><small>Mar <var data-var='date'>26</var>, <var data-var='time'>22:58</var> UTC</small><br><strong>Scheduled</strong> - StarRez will be performing maintenance to the StarRez Cloud Payments Service, which is scheduled to run on Tuesday, April 2nd at 2pm AEDT<br /><br />Regional Maintenance Windows:<br /> - APAC: AEDT 2-4pm<br /> - AMERICA`s: April 1st EDT 11pm-1am / PDT 8pm-10pm<br /> - EMEA: GMT 3-5am<br /><br />During this 2-hour maintenance window, works will be occurring on backend infrastructure with no downtime expected.<br /><br />However, if you do face any issues after the maintenance window, please refer to our <a href="https://support.starrez.com/hc/en-us/articles/115002170343-StarRez-Cloud-Support">StarRez Cloud Support article.</a><br /><br />StarRez will continue to complete these upgrades to ensure optimal performance of your StarRez Cloud environments.</p>tag:status.starrezcloud.io,2005:Incident/201887212024-03-08T02:09:40Z2024-03-08T02:09:40ZService Disruption - Housing Director - Platform Wide<p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>02:09</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>23:41</var> UTC</small><br><strong>Monitoring</strong> - Our upstream has confirmed the issues have been identified and all customers sites are now coming back online.<br />StarRez will continue to monitor the situation and will close this incident once stability has been confirmed.<br />- Next update expected as warranted by a change of events.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>22:48</var> UTC</small><br><strong>Update</strong> - Our upstream vendor has confirmed that there is a major outage and are actively investigating.<br />- StarRez Engineers are actively reviewing this issue and will continue working with the vendor.<br />- Next update expected within the next hour, or as warranted by a change of events.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>22:35</var> UTC</small><br><strong>Investigating</strong> - Housing Director Customer's are currently experiencing an unexpected service disruption accessing Housing Director and related services.<br />- Engineers are actively reviewing this issue.<br />- Next update expected within the next hour, or as warranted by a change of events.</p>tag:status.starrezcloud.io,2005:Incident/199731942024-02-19T10:00:58Z2024-02-19T10:00:58ZScheduled Backend Platform Maintenance - StarRez Cloud Payment Service<p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>10:00</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>01:53</var> UTC</small><br><strong>Update</strong> - Scheduled Maintenance for the EMEA region has been completed successfully.<br /><br />Regional Maintenance Windows will be completed today as per the schedule below:<br /> - APAC: AEDT 7pm-9pm<br /> - AMERICA`s: EST 3am-5am / PST 12am-2am</p><p><small>Feb <var data-var='date'>19</var>, <var data-var='time'>00:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Feb <var data-var='date'>13</var>, <var data-var='time'>08:27</var> UTC</small><br><strong>Scheduled</strong> - StarRez will be performing maintenance to its StarRez Cloud Payments Service which is scheduled to run on Monday February 19th:<br /><br />Regional Maintenance Windows:<br /> - APAC: AEDT 7pm-9pm<br /> - AMERICA`s: EST 3am-5am / PST 12am-2am<br /> - EMEA: GMT 12am-2am<br /><br />During this time there will be a 2-hour maintenance window, with an anticipated downtime of 30 minutes, where the StarRez Cloud Payments Service will be unavailable/inaccessible.<br /><br />However, if you face any issues after the maintenance window, please refer to our <a href="https://support.starrez.com/hc/en-us/articles/115002170343-StarRez-Cloud-Support">StarRez Cloud Support article.</a><br /><br />StarRez will continue to complete these upgrades to ensure optimal performance of your StarRez Cloud environments.</p>tag:status.starrezcloud.io,2005:Incident/200246012024-02-08T20:07:19Z2024-02-20T00:03:20ZService Disruption - Housing Director<p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>20:07</var> UTC</small><br><strong>Resolved</strong> - Customers experienced a loss of access to all Housing Director Services.THD Cloud Services Outage - February 6th 3:07 PM - February 8th 1:15 PM EST</p>tag:status.starrezcloud.io,2005:Incident/197578412024-01-19T00:57:21Z2024-01-23T19:30:50ZService Distruption - Core Applications - US-Central<p><small>Jan <var data-var='date'>19</var>, <var data-var='time'>00:57</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>22:11</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>22:11</var> UTC</small><br><strong>Monitoring</strong> - Engineer's have identified an issue with the underlying hosts. We have migrated services to new hosts and all sites have recovered.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>21:52</var> UTC</small><br><strong>Investigating</strong> - Customers within the US-Central region are experiencing a service disruptions with core StarRez applications .<br />-Engineers are actively reviewing this issue with our upstream provider. <br />-Next update expected within the next 3 hours, or as warranted by a change of events.</p>tag:status.starrezcloud.io,2005:Incident/195940142024-01-17T23:05:44Z2024-01-17T23:05:44ZProduct Event Log Maintenance<p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>23:05</var> UTC</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>17:00</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'> 2</var>, <var data-var='time'>16:24</var> UTC</small><br><strong>Scheduled</strong> - Product Event Log will under go a maintenance migration from<br /><br /> Start: January 17th, 2024 at 5pm UTC<br /><br /> End: January 18th at 1am UTC<br /><br />Impact:<br /><br /> Product Event logs on the Log Event Query page may be slow or intermittently unavailable for 24 hours.<br /><br />Not Affected:<br /><br /> Log Activity Audit Logs remain unaffected.<br /><br />Why:<br /><br /> Improving overall performance and security.<br /><br />Action:<br /><br /> No action required. Our team will handle the migration.</p>tag:status.starrezcloud.io,2005:Incident/185180462023-09-16T23:30:35Z2023-09-27T00:04:07ZOutage affecting some customers in the US East<p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>23:30</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.<br /><br />StarRez Engineers will be reviewing failback of customer databases over the coming days and will fail back when it is safe to do so.<br /><br />A postmortem will be posted in due course once more information is known from our vendor.<br /><br />Please reach out to the StarCare team if any further information is required.</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>16:58</var> UTC</small><br><strong>Monitoring</strong> - Our upstream vendor has confirmed again that the outage is still ongoing within this region.<br /><br />All customers impacted by this event have now been failed over into the DR region and are back online.<br /><br />We will now move into a monitoring state until the underlying outage has been closed out.<br /><br />- Updates within the as warranted by change of events</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>15:58</var> UTC</small><br><strong>Update</strong> - The service wide outage is still ongoing within this region.<br /><br />StarRez Engineers are actively in the process of executing our Disaster Recovery plan for all impacted customers.<br /><br />Over 50% of impacted customers are now back online.<br /><br />- Updates within the as warranted by change of events<br /><br />Apologies for the inconvenience<br />StarRez</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>14:35</var> UTC</small><br><strong>Update</strong> - The service wide outage is still ongoing within this region.<br /><br />StarRez Engineers are actively in the process of executing our Disaster Recovery plan for all impacted customers.<br /><br />Customers are starting to come online as this process completes.<br /><br />- Updates within the next hour or as warranted.<br /><br />Apologies for the inconvenience<br />StarRez</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>13:40</var> UTC</small><br><strong>Identified</strong> - The issue has been identified to be a service wide outage in this region.<br /><br />StarRez Engineers are actively in the process of initiating our Disaster Recovery plan for all impacted customers.<br /><br />- Updates within the next hour or as warranted.<br /><br />Apologies for the inconvenience<br />StarRez</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>13:25</var> UTC</small><br><strong>Update</strong> - StarRez engineers are still working on our upstream vendor to identify the source of the outage. <br /><br />StarRez Engineers are actively in the process of initiating our Disaster Recovery plan for all impacted customers.<br /><br />- Updates within the next hour or as warranted.<br /><br />Apologies for the inconvenience<br />StarRez</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>12:27</var> UTC</small><br><strong>Update</strong> - StarRez engineers are still waiting on our upstream vendor to identify the source of the outage. <br /><br />StarRez Engineers are also now in the process of initiating our Disaster Recovery plan for all impacted customers.<br /><br />- Updates within the next hour or as warranted.<br /><br />Apologies for the inconvenience<br />StarRez</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>11:42</var> UTC</small><br><strong>Update</strong> - StarRez engineers continue to work with our upstream vendor to identify the source of the outage. Confirming only a subset of customers within this region are currently impacted.<br /><br />- Updates within the next hour or as warranted.<br /><br />Apologies for the inconvenience<br />StarRez</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>09:45</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate the issue with our hosting provider where some customer databases in the US East region have gone offline.</p><p><small>Sep <var data-var='date'>16</var>, <var data-var='time'>08:30</var> UTC</small><br><strong>Investigating</strong> - We are currently investigating an issue with our hosting provider where some customer databases in the US East region have gone offline.<br />More details to follow...</p>tag:status.starrezcloud.io,2005:Incident/183192922023-09-01T04:02:30Z2023-09-10T22:53:19ZService Disruption - Core Services - Australia East<p><small>Sep <var data-var='date'> 1</var>, <var data-var='time'>04:02</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>23:39</var> UTC</small><br><strong>Monitoring</strong> - All customers are now back online.<br /><br />Engineers continue to monitor the situation closely for stability before closing the incident.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>20:41</var> UTC</small><br><strong>Update</strong> - 99% of customers have been restored and are operational. Engineers are working with our upstream provider on the remaining affected customers.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>08:08</var> UTC</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>06:34</var> UTC</small><br><strong>Update</strong> - There continues to be a subset of customers that are impacted by this outage.<br />Engineers are closely monitoring updates from our vendor on when these final customers will be restored.<br /><br />-Next update as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>00:00</var> UTC</small><br><strong>Update</strong> - There continues to be a subset of customers that are impacted by this outage.<br />Engineers are working closely with our vendor to resolve the issue.<br /><br />-Next update as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>22:02</var> UTC</small><br><strong>Update</strong> - Most customers have recovered, we have a subset of customers that are still experiencing issues and engineers are reviewing further options to restore them.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>19:10</var> UTC</small><br><strong>Update</strong> - We are continuing to review customers that are still affected and reviewing all mitigation options available</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>17:52</var> UTC</small><br><strong>Update</strong> - We are starting to see services slowly recover and will continue to monitor the situation</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>16:25</var> UTC</small><br><strong>Update</strong> - Customers in the Australia East region are still experiencing a service disruption with core services. <br />-Engineers have are currently preparing to migrate these customer's to the Australia South East region.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>14:33</var> UTC</small><br><strong>Update</strong> - A subset of customers in the Australia East region are still experiencing a service disruption with core services. <br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>12:57</var> UTC</small><br><strong>Update</strong> - Another batch of customers have come back online as connectivity is slowly restored. <br />Engineers continue to monitor the situation closely for the remaining sites that are impacted.<br /><br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>11:57</var> UTC</small><br><strong>Update</strong> - Our vendor has confirmed a network related outage and are working on resolution.<br /><br />A very small subset of customers are back online however we are still experiencing and outage for the remainder.<br /><br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>11:33</var> UTC</small><br><strong>Identified</strong> - We have identified a major network outage occurring within the region.<br /><br />This case is being investigated and escalated to our backend provider for further review.<br /><br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Aug <var data-var='date'>30</var>, <var data-var='time'>11:07</var> UTC</small><br><strong>Investigating</strong> - A subset of customers in the Australia East region are experiencing a service disruption with core services.<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/166704622023-03-28T03:47:17Z2023-03-28T03:47:17ZEmergency Maintenance - East US 2<p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>03:47</var> UTC</small><br><strong>Completed</strong> - This maintenance event has been completed. All scheduled services and taskrunners in this region should be running again.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>02:29</var> UTC</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>02:29</var> UTC</small><br><strong>Scheduled</strong> - We are performing emergency maintenance to one of our US East Clusters. This will result in a short outage of scheduled services and taskrunner for some customers in this region. We expect the outage to last a maximum of 40 minutes however it will be much faster for most customers.</p>tag:status.starrezcloud.io,2005:Incident/166191722023-03-23T20:57:48Z2023-03-23T20:57:48ZService Disruption - Core Applications - US-EAST<p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>20:57</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>15:20</var> UTC</small><br><strong>Monitoring</strong> - All Customer links are currently operational.<br />-Engineers have identified the cause and are currently investigating permanent solutions.<br />-Engineers will continue to monitor all applications.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>14:54</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>14:28</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>14:28</var> UTC</small><br><strong>Investigating</strong> - Customers within the US-EAST region are experiencing intermittent service disruptions with core StarRez applications .<br />-Engineers are actively reviewing this issue with our upstream provider. <br />-Next update expected within the next 3 hours, or as warranted by a change of events.</p>tag:status.starrezcloud.io,2005:Incident/164552282023-03-12T21:08:34Z2023-03-12T21:08:34ZService Disruption - Core Services - Australia East<p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>21:08</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>08:53</var> UTC</small><br><strong>Monitoring</strong> - All customer workload is now back online, engineers are watching the situation closely.<br />The situation will be monitored for stability before closing out.<br /><br />-Next update as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>08:04</var> UTC</small><br><strong>Identified</strong> - The issue has been identified with a number of hosts within the region causing these ongoing outages.<br />The hosts have been removed from service and customer workloads are being moved to healthy infrastructure.<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Mar <var data-var='date'>12</var>, <var data-var='time'>07:59</var> UTC</small><br><strong>Investigating</strong> - A subset of customers in the Australia East region are experiencing a service disruption with core services.<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/162439672023-02-23T05:38:52Z2023-02-23T05:38:52ZService Disruption - Core Services - Australia Southeast<p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>05:38</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>05:13</var> UTC</small><br><strong>Update</strong> - We are continuing to monitor for any further issues.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>05:12</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>05:01</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and the problematic hosts have been removed from service.<br />All customer sites should now be back online.<br /><br />-Engineers are actively monitoring the situation.<br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Feb <var data-var='date'>23</var>, <var data-var='time'>04:58</var> UTC</small><br><strong>Investigating</strong> - A subset of customers in the Australia Southeast region are experiencing a service disruption for core services.<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/160574602023-02-10T02:20:23Z2023-03-03T02:08:39ZService Disruption - Core Services - Asia Southeast<p><small>Feb <var data-var='date'>10</var>, <var data-var='time'>02:20</var> UTC</small><br><strong>Resolved</strong> - The incident within this region has been resolved.<br /><br />StarRez will work continue to monitor for stability to determine when it is safe to failback resources into the region.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>13:33</var> UTC</small><br><strong>Monitoring</strong> - All customers are now back online after successfully failing over core resources.<br /><br />Engineers will continue to monitor this situation closely before closing out.<br /><br />- Next update as warranted by a change of events.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>13:02</var> UTC</small><br><strong>Update</strong> - All production sites are now back online. The remaining Development sites are being worked on.<br />There continues to be no ETA for restoration of services within the Southeast Asia region. from our vendor.<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update as warranted by a change of events.</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>11:09</var> UTC</small><br><strong>Update</strong> - There continues to be no ETA for restoration of services from our vendor.<br /><br />Engineers are currently failing over these remaining customers to a functional region to bring services back online.<br /><br />- Engineers are actively working to remediate the issue. <br />- Next update expected within 60 minutes, or as warranted by a change of event</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>06:05</var> UTC</small><br><strong>Update</strong> - There continues to be no ETA for restoration of services from our vendor.<br /><br />The customer dev/test environments impacted by this will continue to sustain an outage at this time. Engineers are actively reviewing if the DR process should be engaged on these sites should the outage remain ongoing.<br /><br />- Engineers are actively working to remediate the issue. <br />- Next update expected within 60 minutes, or as warranted by a change of event</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>05:07</var> UTC</small><br><strong>Update</strong> - There continues to be no ETA for restoration of services. Our vendor has advised that restoration works are still underway within the impacted region<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Feb <var data-var='date'> 8</var>, <var data-var='time'>01:32</var> UTC</small><br><strong>Update</strong> - The workaround has helped to bring a subset of sites back online. Work continues with the remaining sites to restore service.<br /><br />There continues to be no ETA for restoration of services within this region from our vendor.<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>23:25</var> UTC</small><br><strong>Update</strong> - A workaround is current being investigated within the hope to restore services.<br /><br />- Engineers are actively working to remediate the issue. <br />- Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>22:36</var> UTC</small><br><strong>Update</strong> - Confirmed this is a Microsoft outage in the datacenter in this region. Will provide updates as they are provided to us</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>20:49</var> UTC</small><br><strong>Identified</strong> - The upstream provider has identified they are having issues in this region<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Feb <var data-var='date'> 7</var>, <var data-var='time'>20:47</var> UTC</small><br><strong>Investigating</strong> - Customers in Asia Southeast are experiencing a service disruption with some Core Services<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.</p>tag:status.starrezcloud.io,2005:Incident/159287822023-01-25T11:11:29Z2023-01-27T04:11:12ZService Disruption - Core Services - Global<p><small>Jan <var data-var='date'>25</var>, <var data-var='time'>11:11</var> UTC</small><br><strong>Resolved</strong> - The network connectivity issues have been resolved.</p><p><small>Jan <var data-var='date'>25</var>, <var data-var='time'>11:10</var> UTC</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Jan <var data-var='date'>25</var>, <var data-var='time'>08:53</var> UTC</small><br><strong>Update</strong> - We have confirmed that the problem is a networking issue with our upstream vendor. There is not yet an ETA on the resolution.</p><p><small>Jan <var data-var='date'>25</var>, <var data-var='time'>07:58</var> UTC</small><br><strong>Investigating</strong> - Customers in all regions are experiencing a service disruption for Core Services.<br />We are seeing sporatic network connectivity issues across a number of regions globally.<br />- Engineers are actively investigating the issue, it is unknown at this time what the cause is.<br />- Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/159227222023-01-24T16:00:00Z2023-01-24T16:33:46ZService Disruption - Core Services - Canada Central<p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>16:00</var> UTC</small><br><strong>Resolved</strong> - Customers in Canada Central experienced a service disruption with Core Services from 9:25 to 9:30am MST<br />A fix has been implemented and the incident has been resolved<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/159098142023-01-23T06:30:00Z2023-01-23T07:23:38ZService Disruption - Core Services - Australia East<p><small>Jan <var data-var='date'>23</var>, <var data-var='time'>06:30</var> UTC</small><br><strong>Resolved</strong> - Customers in Australia East were experiencing an intermittent service disruption with some core services<br />-Engineers actively worked to remediate the issue. <br />-All services are back online.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/158498292023-01-15T23:43:41Z2023-01-15T23:43:41ZService Disruption - Core Services - Australia Southeast<p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>23:43</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>22:45</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>22:38</var> UTC</small><br><strong>Identified</strong> - The unhealthy host has been removed from service which was impacting the customers sites.<br />Sites are now coming online.<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>22:29</var> UTC</small><br><strong>Investigating</strong> - Customers in Australia Southeast are experiencing a service disruption with some Core Services<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/158330832023-01-13T06:02:04Z2023-01-13T06:02:04ZService Disruption - Core Services - Australia SouthEast and UK South<p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>06:02</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>04:09</var> UTC</small><br><strong>Monitoring</strong> - All customer services are now back online.<br />Engineers have validated the outage was caused by a known bug within the platform and will continue to work closely with our upstream vendor to resolve.<br /><br />The platform will continue to be monitored closely before closing the outage.<br /><br />-Next update as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>03:53</var> UTC</small><br><strong>Update</strong> - A subset of customers in the Australia East region are also being impacted, this is being reviewed.<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>03:40</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and the bad infrastructure removed.<br />The UK South region is also experiencing a similar outage for a subset of customers.<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>03:34</var> UTC</small><br><strong>Investigating</strong> - Customers in Australia Southeast are experiencing a service disruption with Core Services<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/158280622023-01-12T15:32:06Z2023-01-12T15:32:06ZService Disruption - Core Services - UK South<p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>15:32</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>14:53</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>14:52</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.<br />Services will start coming back online within the next 5-15mins.<br /><br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'>12</var>, <var data-var='time'>14:04</var> UTC</small><br><strong>Investigating</strong> - Customers in the UK South region are experiencing a service disruption for Core StarRez Services.<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/158054392023-01-09T22:14:58Z2023-01-09T22:14:58ZService Disruption - Core Services - US West Central<p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>22:14</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>21:22</var> UTC</small><br><strong>Monitoring</strong> - A fix has been implemented and we are monitoring the results.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>21:17</var> UTC</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented.<br />Services will start coming back online within the next 5-15mins.<br /><br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>21:09</var> UTC</small><br><strong>Investigating</strong> - Customers in the US West Central region are experiencing a service disruption for Core StarRez Services.<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/157707652023-01-04T23:19:53Z2023-01-04T23:19:53ZService Disruption - Core Service - Australia East<p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>23:19</var> UTC</small><br><strong>Resolved</strong> - All environments have maintained stability. <br />The issue is now resolved</p><p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>15:28</var> UTC</small><br><strong>Monitoring</strong> - All sites are now back online.<br /><br />Engineers are actively monitoring this for stability before closing the outage out.. <br /><br />- Next update expected as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Jan <var data-var='date'> 4</var>, <var data-var='time'>13:11</var> UTC</small><br><strong>Identified</strong> - A subset of customers within the Australia East region are currently experiencing an outage due to backend database connectivity issues<br />-Engineers are actively working with our upstream vendor to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/130322272022-11-14T05:56:35Z2022-11-14T05:56:35ZService Disruption - Core Service - Australia South East<p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>05:56</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>04:32</var> UTC</small><br><strong>Identified</strong> - A bad host has been identified and removed from service.<br />Customer applications are starting to come back online now.<br /><br />- Engineers are actively monitoring this situation<br />- Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Nov <var data-var='date'>14</var>, <var data-var='time'>04:22</var> UTC</small><br><strong>Investigating</strong> - A subset of customers in the Australia South East region are experiencing service disruptions for core services<br /><br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/127715712022-11-10T03:50:36Z2022-11-10T05:33:32ZService Disruption - Core Service - Australia East<p><small>Nov <var data-var='date'>10</var>, <var data-var='time'>03:50</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>10</var>, <var data-var='time'>02:11</var> UTC</small><br><strong>Monitoring</strong> - All sites are now back online.<br /><br />Engineers are actively monitoring this for stability before closing the outage out.. <br /><br />- Next update expected as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Nov <var data-var='date'>10</var>, <var data-var='time'>01:57</var> UTC</small><br><strong>Identified</strong> - The issue has been tracked down to 2 erroneous nodes within our infrastructure, customer workloads are current being moved to healthy nodes and are starting to come back online.<br /><br />- Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Nov <var data-var='date'>10</var>, <var data-var='time'>01:50</var> UTC</small><br><strong>Investigating</strong> - A subset of customers in the Australia East region are experiencing a service disruption for core services such as Web and Portal<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/127371702022-11-07T02:54:15Z2022-11-07T08:41:18ZService Disruption - Core Applications - Australia East<p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>02:54</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>23:42</var> UTC</small><br><strong>Monitoring</strong> - All sites are now online.<br />Engineers will be monitoring this region closely and will close this incident out once stability has been confirmed.<br /><br />-Next update as warranted by a change of events.<br /><br />StarRez Team</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>23:01</var> UTC</small><br><strong>Identified</strong> - The underlying infrastructure causing this outage has been found. <br />Engineers are currently removing this infrastructure from the platform with sites now starting to come back online.<br /><br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p><p><small>Nov <var data-var='date'> 6</var>, <var data-var='time'>22:55</var> UTC</small><br><strong>Investigating</strong> - Customers in some regions are experiencing a service disruption with Core Applications within the Australia East.<br />-Engineers are actively working to remediate the issue. <br />-Next update expected within 60 minutes, or as warranted by a change of events.<br /><br />Apologies for any inconvenience,<br />StarRez Team</p>tag:status.starrezcloud.io,2005:Incident/126923182022-11-02T09:45:41Z2022-11-07T08:39:32ZService Disruption - Core Applications - Switzerland North<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>09:45</var> UTC</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>09:45</var> UTC</small><br><strong>Monitoring</strong> - The underlying infrastructure has been removed from production and all sites are now back online.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>09:37</var> UTC</small><br><strong>Identified</strong> - A cluster issue has occurred within the Switzerland North region. <br />The majority of customers in this region were impacted by an outage of up to 30minutes.<br />All sites are now starting to come back online whilst engineers investigate the root cause.<br /><br />- Next update as warranted by change of events.<br /><br />Apologies for the inconvenience<br />StarRez</p>