By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
World of SoftwareWorld of SoftwareWorld of Software
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Search
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
Reading: Atlassian’s 4 Million PostgreSQL Database Migration: When Standard Cloud Strategies Fail
Share
Sign In
Notification Show More
Font ResizerAa
World of SoftwareWorld of Software
Font ResizerAa
  • Software
  • Mobile
  • Computing
  • Gadget
  • Gaming
  • Videos
Search
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Have an existing account? Sign In
Follow US
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
World of Software > News > Atlassian’s 4 Million PostgreSQL Database Migration: When Standard Cloud Strategies Fail
News

Atlassian’s 4 Million PostgreSQL Database Migration: When Standard Cloud Strategies Fail

News Room
Last updated: 2025/07/05 at 11:36 AM
News Room Published 5 July 2025
Share
SHARE

Atlassian recently migrated 4 million Jira databases to Amazon Aurora, intending to reduce costs and improve the reliability of its Jira Cloud platform. Due to the large number of files involved and the constraints of managed services, the team developed a custom tool to orchestrate the process, as traditional cloud migration strategies were not viable.

In an article on the Atlassian engineering blog, the team describes the technical challenges and outcomes of migrating thousands of PostgreSQL clusters with up to 4000 databases each.

Atlassian’s architecture for Jira uses one database per tenant (an approach that is usually justified when the tenant count is small), which translates into over 4 million PostgreSQL databases. Pat Rubis, principal site reliability engineer at Atlassian, explains:

One database per tenant is an uncommon architecture, and we’ve opted for it in order to maximize isolation, scalability, and operational control at Atlassian’s massive scale. It makes it much easier to ensure that data from one tenant cannot accidentally or maliciously be accessed by another, and allows us to scale our fleet horizontally, balancing load and optimising performance for tenants of significantly different sizes.

Due to the specific architecture, the team has to occasionally rebalance the databases across instances to maintain an even spread of load. In late 2023, the team decided to perform a replatform of the entire fleet to Amazon Aurora, involving all the accounts of the Jira Cloud platform. The goals were to take advantage of Aurora’s better SLA (99.99%), increase elasticity by autoscaling the reader instances, and achieve some cost optimizations.

The project was estimated to last a few months, minimizing tenant downtime and migration costs. It was orchestrated using AWS Step Functions and relied on feature flags to immediately override the tenants’ database endpoints on the application servers. While the conversion of an Amazon RDS for PostgreSQL instance to Aurora is usually a simple task, the large number of databases per instance forces a cutover in unison for all those tenants, each with their own connection endpoint and credentials.

Furthermore, as a single Jira database corresponds to about 5000 files on disk, the overall number of files per PostgreSQL instance was in the millions, hitting a limitation on Aurora’s side, with the new replica instance timing out while performing a status check activity and impacting Atlassian’s ability to convert the clusters safely. A different approach, called “draining,” was devised to orchestrate the migration, reducing first the number of tenants on instances to be converted and controlling the number of databases moved across clusters.

Source: Atlassian blog

To minimize the impact on normal operations during the migration process, one of the challenges of the project was controlling both source and destination concurrency. Rubis adds:

Ultimately, we had to find a balance between how much additional infrastructure we wanted in each region to perform the migrations (and how much that would cost), and how long we were comfortable with each region taking to complete.

At peak, Atlassian managed to migrate up to 90000 Jira databases per day, with an average of 38000 databases per day. Cassian Cox, senior engineering manager at Atlassian, comments on LinkedIn:

This was a huge piece of infrastructure work that’s been a big part of my time at Atlassian. This unlocked huge improvements in scalability, reliability, and cost efficiency.

Migrations by day

Source: Atlassian Engineering Blog

The entire project involved 2403 RDS database instances to be converted, with 2.6 million databases migrated and 1.8 million databases drained from the source instances.

Overall, the team estimates the total number of database files used in Jira at over 27.4 billion but has not disclosed additional metrics or details on the cost savings achieved.

The startup timeout threshold experienced by Atlassian is currently not documented on the Amazon Aurora quotas and constraints page.

 

Sign Up For Daily Newsletter

Be keep up! Get the latest breaking news delivered straight to your inbox.
By signing up, you agree to our Terms of Use and acknowledge the data practices in our Privacy Policy. You may unsubscribe at any time.
Share This Article
Facebook Twitter Email Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Congress Won't Block State AI Regulations. Here's What That Means for Consumers
Next Article DDN targets enterprise-shaped hole in its AI storage offer | Computer Weekly
Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Stay Connected

248.1k Like
69.1k Follow
134k Pin
54.3k Follow

Latest News

This Incredible Lens Let Me Take Amazing Star Photos
News
Yes, You Can Upgrade Windows 11 for $10 — But Not for Long
News
Telegram blockchain developer startup TOP raises $28.5M at $1B valuation – News
News
What Does This Mean for Android Flagships?
Mobile

You Might also Like

News

This Incredible Lens Let Me Take Amazing Star Photos

9 Min Read
News

Yes, You Can Upgrade Windows 11 for $10 — But Not for Long

4 Min Read
News

Telegram blockchain developer startup TOP raises $28.5M at $1B valuation – News

5 Min Read
News

Put an AI note-taking assistant in your pocket for just $60

2 Min Read
//

World of Software is your one-stop website for the latest tech news and updates, follow us now to get the news that matters to you.

Quick Link

  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact

Topics

  • Computing
  • Software
  • Press Release
  • Trending

Sign Up for Our Newsletter

Subscribe to our newsletter to get our newest articles instantly!

World of SoftwareWorld of Software
Follow US
Copyright © All Rights Reserved. World of Software.
Welcome Back!

Sign in to your account

Lost your password?