Dropbox’s Magic Pocket with James Cowling

Dropbox has been storing files on Amazon Web Services for 8 years, and Dropbox’s core business is storing files. For the past three years, Dropbox has been working on a project to migrate its file storage from Amazon Web Services to its own custom built infrastructure. Magic Pocket is the name of Dropbox’s new infrastructure layer, and it gives Dropbox more control and improved economics.

James Cowling leads the storage team at Dropbox. On today’s episode, James takes us into the architecture of Dropbox and explains how the team moved all of the user file storage from Amazon S3 to Dropbox’s Magic Pocket infrastructure. Dropbox’s architecture is built with a focus on simplicity–and there are numerous challenges to maintaining that simplicity in the face of an extremely complex problem like this.


hired-logo IT Pro TV has online training for AWS, Microsoft Azure, and many other topics. Go to itpro.tv/sedaily to get started with a free 7 day trial of videos. You can use the promo code sedaily and get a 30% discount.
braintree-logo Braintree makes it easy to accept payments in your app or website. Select from a range of client and server SDKs and integrate payments ASAP. Check out braintreepayments.com/sedaily to check out Braintree and support Software Engineering Daily.

Software Weekly

Software Weekly

Subscribe to Software Weekly, a curated weekly newsletter featuring the best and newest from the software engineering community.