After nearly two years of competition among more than 3,800 teams from 91 countries, Zillow has awarded the $1 million Zillow Prize in the contest to improve the accuracy of the Zestimate. The winning team beat the Zillow benchmark model by approximately 13 percent. As a result of these improvements, their work will help push the Zestimate’s current nationwide error rate of 4.5 percent to below 4 percent.
The winning team, Team ChaNJestimate, comprises data scientists and engineers from around the world: Chahhou Mohamed of Morocco, Jordan Meyer of the U.S., and Nima Shahbazi of Canada. In the competition’s initial qualifying round, Shahbazi and Mohamed competed as a duo while Meyer competed on his own. For the final round, the three joined forces after realizing the potential power of combining their Zestimate models. Working across two continents and multiple time zones, the team members have yet to meet in person, but have spent hundreds of hours collaborating to beat the algorithm that changed real estate.
“People are incredibly passionate about their home and understanding its value, and we are amazed by the winning team’s hard work the past two years to make the Zestimate even more precise,” says Stan Humphries, chief analytics officer at Zillow and creator of the Zestimate. “We’ve been on a 13-year journey making the Zestimate more accurate, and hosting Zillow Prize allowed us to invite thousands of brilliant data scientists from around the world to join us on this journey. We’re so proud that the winning team’s huge achievement, and the work of all the teams in the competition, will provide millions of homeowners with a better understanding of one of their biggest life investments.”
The winning team’s algorithm incorporated several sophisticated machine learning techniques, including using deep neural networks to directly estimate home values and remove outlier data points that fed into their algorithm. They also leveraged publicly-available, external data including rental rates, commute times, and home prices, among other types of contextual information, such as road noise—all variables that factor into a home’s estimated value.
Zillow’s team of data scientists has already begun to incorporate parts of the winning team’s algorithm—as well as other ideas inspired by top Zillow Prize competitors—into the Zestimate model that automates home valuations of 110 million homes across the U.S. While home valuation tools will likely never be perfect, incremental improvements in the Zestimate’s error rate will result in more precise home valuations potentially by thousands of dollars—a meaningful amount for homeowners everywhere. On average, the Zestimate is $10,000 off of the actual sale price for a typical home, and with the learnings from Zillow Prize, future Zestimates could be approximately $1,300 closer to the sale price.
“It’s amazing to know that millions of people will benefit from our ideas,” says Shahbazi, one of the winning team members. “We brought every novel idea we could to our code and kept experimenting. For every idea that worked, there were a hundred that didn’t work—but we kept going.”
“Everyone knows the Zestimate, whether you’re a data scientist or not. It’s still unbelievable that we won the million-dollar prize,” adds teammate Meyer. “I feel so lucky and so proud of all our hard work.”
The winner announcement comes nearly two years after launching the competition. In that time, the contest has become one of the most popular machine learning competitions ever on Kaggle, the platform administering the contest. Zillow also awarded $100,000 to the second-place team, Team Silogram-2, and $50,000 to the third-place team, Team Zensemble. In the qualifying round, Team Zensemble placed first and Team Silogram-2 placed second.
Designed to be a starting point to help people estimate the value of a home, the introduction of the Zestimate in 2006 marked the first time homeowners had instant access to information about their homes’ estimated values, for free. Today, constantly improving the Zestimate’s accuracy is a top priority for Zillow as it helps homeowners understand the value of what’s likely their largest asset, their home.
For more information, please visit www.zillow.com/zprize.
