Who is Goldfinch Bio

Goldfinch Bio is a venture backed, clinical stage bio technology company developing new therapeutics for kidney disease. Goldfinch is identifying new therapeutics to develop the best in class drugs using a precision medicine approach.

The Challenge

Goldfinch Bio was doing large scale genomic analysis using Hail that runs on Apache Spark and AWS EMR. They developed a solution using an early version of Hail that proved to be very brittle. It had problems running reliably and took a very long time to bootstrap. Due to the complexity and time it would take to launch new clusters, they were hesitant to destroy clusters. Existing clusters would run for a very long time causing them to fall behind on new Hail releases and miss out on new features they needed. Goldfinch would spend hours and sometimes days to get the solutions working properly with lots of failed clusters along the way which cost them time and money. 

The Solution

Privo built a new automated AMI pipeline using Hashi Corp's Packer. This new pipeline allowed Goldfinch to automate the installation of Hail along with all its dependencies.  This AMI was made available as a public resource so that they can launch a new cluster at any time without having to worry about Hail breaking.  


Create your digital transformation roadmap

Are you in a similar situation as Goldfinch Bio? Trapped by your outdated systems and inefficient solutions? Let us take a look at what you have and offer suggestions for improvement with a Well-Architected Review.

That will allow our team to learn about your system and put together a digital transformation roadmap to help modernize your infrastructure.

The Benefits

Notebooks separate from clusters

Prior to adopting this new solution, when clusters were torn down they would lose code, work, and most importantly - time.  The new solution separates concerns and gives them the ability to now have clusters running independently of the notebooks. 

Reduced cluster deployment time

Existing clusters took over 45 minutes to bootstrap. With the new solution, the clusters launch in about 7 to 8 minutes.  Goldfinch is now much more willing to change cluster configurations, and launch clusters tailored to the compute job because they can be more agile with this new solution in place. 

Maintenance Free

With Privo owning the responsibility of maintaining the Hail AMI, Goldfinch can focus their time and effort on creating tailored clusters to their data scientists, and not have to worry about building and maintaining the complexities of Hail. 

View All Services

“Privo helped us get where we are with this solution and we couldn't have built this on our own. They were a great benefit to our business and we are excited to keep working with them”

- Adam Tebbe, Senior Director of IT and Informatics, Goldfinch Bio


Privo logo - dark

Privo is an APN Premier Consulting Partner with offices near Boston and San Francisco that helps organizations migrate, optimize, monitor and manage Amazon WorkSpaces, AppStream 2.0, and other AWS services that support end users and their access to back office IT infrastructure.


AWS allows you to have an agile, cost-effective, and scalable infrastructure to enable operational efficiency, and simplify access to applications for end users. With AWS, companies of all sizes can focus more on their core business instead of IT administration.

About Us

Get your project started with a
Well-Architected Review

Learn more about how Privo and AWS can revolutionize your IT