«
»

Extreme Makeover: Database or MySQL@YouTube

Posted on 26/4/2007, 1:38 pm, by Colin Charles, under MySQL.

Arguably one of the most interesting keynotes (and technical to boot!), Paul Tuckfield not only entertained us in his 40 minute keynote, he also did so outside when the keynotes ended.

Just the DBA at PayPal, just the DBA at YouTube. Only 3 DBAs at YouTube that make it all happen. Only a MySQLer for ~8 months (Oracle for ~15 years). So guess PayPal is a Oracle shop.

MySQL is one (important) piece of the scalability picture.

Technologies: Python, Memcache, MySQL replication. Praises Python, a lot (its much quicker, than C++, to implement goodness).

Click tracking on a separate MyISAM site. But Read/write on InnoDB, using replication. Far more reads than writes at YouTube

4x2ghz Opteron core, 16GB ram, 12x10krpm scsi – constantly crashing, replication saved them

5.0 “mystery cache hits” – when you export and import (mysqldump and load back into 5.0), you boost your performance, rather than if you upgrade in place, because there’s a compact row format. They moved from 4.1 -> 5.0.

Cache is king. Writes, cache by RAID controller rather than the OS. Only the DB should cache reads (not raid, not linux buffer cache)

Software striping atop hardware array.

The oracle caching algorithm – in academia. Not something I’ve heard much about, and definitely need to look into it further.

The talk was too long, but would make a most interesting read, and an actual presentation rather than a keynote. I hope his presentation makes it online, sometime soon.

Note-to-entrepreneurs: If building a web business, and you want to be acquired by Google, its quite largely possible that their due diligence includes “python” compatibility. Most of their released tools, are all python-related or based. Oh, and make sure you use commodity hardware (in fact, do that if you want to get VC funded, even.)

Update: A little note on the oracle algorithm. If anyone has papers, and more credible links, please do drop me a line.

Technorati Tags: , , , , , ,

7 Comments

  1. » web 2.0 backends says:
    9/6/2007 at 4:15 pm

    […] link: http://www.bytebot.net/blog/archives/2007/04/26/extreme-makeover-database-or-mysqlyoutube […]

  2. Database says:
    14/6/2007 at 1:19 pm

    Thank you.
    Good Article

  3. Scalable web architectures » Blog Archive » Talks and slides from various web 2.0 architects says:
    3/8/2007 at 1:34 am

    […] Extreme Makeover: Database or MySQL@YouTube […]

  4. Scaleable web architectures says:
    28/12/2007 at 3:42 pm

    […] Extreme Makeover: Database or MySQL@YouTube […]

  5. arnimation says:
    28/5/2008 at 2:08 pm

    interesting..

  6. kyio says:
    29/6/2008 at 5:46 am

    thanks dude. nice to read

  7. kyio says:
    6/10/2009 at 12:17 am

    thanks dude. nice to read

«
»
i