AWS us-east-1 single availability zone outage
Monitoring - Despite the ongoing AWS incident, our own services are now stable. We are continuing to monitor our services closely, and are ready for further action should the need arise. We are also watching AWS services closely as they recover.
May 08, 2026 - 08:07 UTC
Update - We are continuing to move infrastructure resources out of the affected AWS Availability Zone. Brief latency and error blips may continue while these manual failovers occur.

(Apologies if you receive duplicated notifications for this update.)
May 08, 2026 - 07:22 UTC
Update - We are continuing to move infrastructure resources out of the affected AWS Availability Zone. Brief latency and error blips may continue while these manual failovers occur.
May 08, 2026 - 07:04 UTC
Update - We are continuing to move infrastructure resources out of the affected AWS Availability Zone. Brief latency and error blips will unfortunately continue while these manual failovers occur.
May 08, 2026 - 05:45 UTC
Update - We are actively moving resources out of us-east-1c. Similar brief latency and error blips will be visible to customers while these manual failovers occur.
May 08, 2026 - 05:10 UTC
Update - We have provisioned additional capacity in unaffected availability zones so that they are able to support the additional load. Automatic failovers continue to occur where necessary.

Some latency and transient errors will be visible to customers.
May 08, 2026 - 04:08 UTC
Update - We are continuing to actively monitor the impacts of this availability zone outage for Buildkite customers. Some transient errors are visible due to availability zone failover events.
May 08, 2026 - 02:35 UTC
Update - A small subset of our customers are experiencing delayed notifications. We are actively provisioning additional capacity for these customers.

Availability zone automatic failovers are occurring in response to the outage, and this is causing some brief error blips for some customers.
May 08, 2026 - 01:50 UTC
Investigating - We're aware that AWS is reporting availability zone failures in us-east-1. We are monitoring the situation but so far there is no customer impact.
May 08, 2026 - 01:12 UTC

About This Site

Status updates for Buildkite’s services and components. You can also follow @buildkitestatus on Twitter for updates.

Uptime over the past 90 days. View historical uptime.
Web Operational
90 days ago
99.98 % uptime
Today
Agent API Operational
90 days ago
99.97 % uptime
Today
REST API Operational
90 days ago
100.0 % uptime
Today
Job Queue Operational
90 days ago
99.77 % uptime
Today
Notifications Operational
90 days ago
99.86 % uptime
Today
GitHub Commit Status Notifications Operational
Email Notifications Operational
Slack Notifications Operational
Webhook Notifications Operational
90 days ago
99.86 % uptime
Today
Hosted Agents Operational
90 days ago
100.0 % uptime
Today
Hosted Agents Operational
90 days ago
100.0 % uptime
Today
MacOS Operational
90 days ago
100.0 % uptime
Today
Linux (ARM64) Operational
90 days ago
100.0 % uptime
Today
Linux (AMD64) Operational
90 days ago
100.0 % uptime
Today
Package Registries Operational
90 days ago
100.0 % uptime
Today
Web Operational
90 days ago
100.0 % uptime
Today
Package Managers - API Operational
90 days ago
100.0 % uptime
Today
Rest API Operational
90 days ago
100.0 % uptime
Today
Test Engine Operational
90 days ago
100.0 % uptime
Today
Web Operational
90 days ago
100.0 % uptime
Today
Ingestion Operational
90 days ago
100.0 % uptime
Today
REST API Operational
90 days ago
100.0 % uptime
Today
SCM Integrations Operational
90 days ago
100.0 % uptime
Today
SCM Providers Operational
GitHub Operational
GitHub API Requests Operational
GitHub Webhooks Operational
Atlassian Bitbucket SSH Operational
Atlassian Bitbucket Website and API Operational
Atlassian Bitbucket Git via HTTPS Operational
Third Party Services Operational
AWS ec2-us-east-1 Operational
AWS elasticache-us-east-1 Operational
AWS elb-us-east-1 Operational
AWS rds-us-east-1 Operational
Docs Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

System Metrics Month Week Day
Web Response Time ?
Fetching
REST API Response Time ?
Fetching
Agent Job Dispatch
Fetching
Agent API Response Time ?
Fetching
May 8, 2026
Delays in job dispatch, webhook processing, and outbound webhooks
Resolved - All customer workloads have now recovered.
May 8, 00:13 UTC
Monitoring - We have now monitoring the incident. We are seeing most customers have recovered, and some showing signs of recovery.
May 7, 23:50 UTC
Identified - We've identified the issue and are working on applying mitigations. At this time we can confirm inbound and outbound webhooks, and notifications are delayed.
May 7, 23:13 UTC
Investigating - We've spotted that something has gone wrong. We're currently investigating the issue, and will provide an update soon.
May 7, 22:45 UTC
May 7, 2026
Jobs not starting on hosted agents and agent-stack-k8s
Resolved - We've reverted a change that caused stale environment variables provided to acquire job used in Hosted Agents, agent-stack-k8s and other agent implementations using acquire job.
May 7, 09:37 UTC
Identified - We're currently seeing recovery at 50% rate. We'll provide next update soon.
May 7, 09:24 UTC
Update - We've identified issue with job acquiring endpoint. We're rolling back now. We'll provide next update in ~20 minutes.
May 7, 09:09 UTC
Investigating - We've spotted that something has gone wrong. We're currently investigating the issue with new builds not starting.
May 7, 08:48 UTC
May 6, 2026
Test Engine: Delayed processing of test result ingestion
Resolved - Processing of test execution ingestion data has successfully caught up.
May 6, 05:26 UTC
Monitoring - We've identified the issue and the system is currently processing the backlog of test executions
May 6, 04:21 UTC
Investigating - A process writing test results to our Test Engine data store stalled, we've restarted the process and are seeing it catching up. We expect to be fully caught up on the backlog within the next couple of hours.
May 6, 03:57 UTC
May 5, 2026

No incidents reported.

May 4, 2026
Delayed notifications
Resolved - Notifications continue to be delivered without delay for the previously affected subset of customers. This incident is resolved.
May 4, 19:36 UTC
Monitoring - Applied remediations have resolved the previous notification delays affecting a subset of our customers. We're continuing to monitor the affected services for stability.
May 4, 18:54 UTC
Identified - We've identified the source of the notification delays affecting a subset of our customers. Our engineers are applying remediations to reduce these delays.
May 4, 18:06 UTC
Investigating - We are investigating delays with build and job notifications for a subset of customers.
May 4, 17:02 UTC
Increased latency and error rates
Resolved - An increase in requests has lead to the API service being temporarily saturated. We have updated rate limits to ensure this doesn't re-occur and will add further resources if necessary
May 4, 06:30 UTC
Investigating - We're observing increased latency and error rates in the Agent API for a subset of our customers. We're currently investigating and will provide status updates as they become available.
May 4, 06:02 UTC
May 3, 2026

No incidents reported.

May 2, 2026

No incidents reported.

May 1, 2026
Buildkite service disruption
Postmortem - Read details
May 8, 06:09 UTC
Resolved - This incident has been resolved.
May 1, 03:30 UTC
Monitoring - We've corrected the issue that caused this disruption and normal service has been restored. We are monitoring the situation now.
May 1, 02:52 UTC
Identified - We've identified a service change that is causing a service disruption. We are reverting this change.
May 1, 02:41 UTC
Apr 30, 2026

No incidents reported.

Apr 29, 2026
Increased latency and error rates
Resolved - We have confirmed that latency and error rates have returned to normal for impacted customers.
Apr 29, 18:48 UTC
Monitoring - We have identified and fixed the issue with the underlying database for a subset of customers. We are now monitoring the issue.
Apr 29, 18:18 UTC
Investigating - We're observing increased latency and error rates for a subset of our customers. We're currently investigating and will provide status updates as they become available.
Apr 29, 17:43 UTC
Apr 28, 2026
Increased dispatch latency and error rates
Resolved - Previously elevated loads with Hosted Agents dispatch have fully recovered.
Apr 28, 19:16 UTC
Monitoring - We have mitigated the issue causing increased Hosted Agents dispatch latency and intermittent timeout errors for a subset of customers. We identified abnormal workload activity that was placing elevated load on a supporting service, and have now blocked that activity and applied additional protections. Service metrics have returned to normal, and we are continuing to monitor closely.
Apr 28, 18:45 UTC
Identified - The issue has been identified and a fix is being implemented.
Apr 28, 18:26 UTC
Investigating - We're observing increased error rates and dispatch latency for a subset of our customers. We're currently investigating and will provide status updates as they become available.
Apr 28, 18:00 UTC
Apr 27, 2026

No incidents reported.

Apr 26, 2026

No incidents reported.

Apr 25, 2026

No incidents reported.

Apr 24, 2026

No incidents reported.

← Incident History Powered by Atlassian Statuspage