![](https://s.togetter.com/static/web/img/placeholder.gif)
MySQL loses: bad ID gen at scale, replication inefficiency sux, lag sux.... #twdata #mysqlconf
2011-04-15 08:08:03![](https://s.togetter.com/static/web/img/placeholder.gif)
TwitterでMySQLがフィットしないところ:IDの生成。ソーシャルグラフ生成。レプリケーションスレーブがシングルスレッド。 #mysqlconf #twdata
2011-04-15 08:08:31![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - MySQL replication improvements like crash safe multi-threaded slave exactly what they need
2011-04-15 08:08:58![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - MySQL's happy place: <= 1.5 TB datasets, archive store for larger sets.
2011-04-15 08:09:31![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf @jeremycole MySQL dba uses MySQL when less then 1.5 TB of data.
2011-04-15 08:09:50![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - Twitter open sourced snowflake (id generation system) and Gizzard distributed data storage
2011-04-15 08:11:04![](https://s.togetter.com/static/web/img/placeholder.gif)
Note to self, look into snowflake for unique ids #twdata #mysqlconf
2011-04-15 08:11:26![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - Gizzard builds in MySQL/InnoDB handles sharding, replication, job scheduling
2011-04-15 08:11:32![](https://s.togetter.com/static/web/img/placeholder.gif)
Snowflake:OSSのID生成ツール。連番じゃないけど順番居並んだIDが生成可能。Gizzard:分散データ管理フレームワーク。MySQL(InnoDB)上で利用。シャーディング、レプリケーション(冗長化)。 #mysqlconf #twdata
2011-04-15 08:11:45![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - More twitter open source: FlockDB - gizzard based edge storage (followers, lists, blocks)
2011-04-15 08:12:48![](https://s.togetter.com/static/web/img/placeholder.gif)
MySQL is the key data storage at @Twitter @jeremycole #mysqlconf
2011-04-15 08:12:51![](https://s.togetter.com/static/web/img/placeholder.gif)
T-bird, T-flock:GizzardベースのTweet格納先, セカンダリインデックス。 #mysqlconf #twdata
2011-04-15 08:14:55![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - Twitter uses Cassandra too for some projects. high velocity writes, schemaless design
2011-04-15 08:15:49![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - Twitter uses HADOOP for analyzing extremely large datasets: 10 to 100 blns rows (http logs)
2011-04-15 08:16:39![](https://s.togetter.com/static/web/img/placeholder.gif)
Cassandra:「TwitterはCassandraだけを使ってる」はガセw Hadoop:httpログの分析などに利用。 Vertoca:SQLが利用可能な水平分散&冗長データソース。JOINが高速。一部の分析に利用。 #mysqlconf #twdata
2011-04-15 08:17:58![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf - @jeremycole MySQL dba at twitter - Twitter also uses vertica for analysis, 100M - 10Blns of rows. Runs 100x faster than MySQL
2011-04-15 08:18:08![](https://s.togetter.com/static/web/img/placeholder.gif)
Twitter Projects: Gizzard, FlockDB, Snowflake, Haplo, Kestrel, Scala: twitter.com/about/opensource & github.com/twitter #twdata #mysqlconf
2011-04-15 08:19:45![](https://s.togetter.com/static/web/img/placeholder.gif)
MySQLは主に5.0と5.1。マイナーバージョンは6,7種類。今年5.5にバージョンアップ予定。ハードウェアは一般的なもの=特殊なものはない。HPとDell。 #mysqlconf #twdata
2011-04-15 08:21:52![](https://s.togetter.com/static/web/img/placeholder.gif)
#mysqlconf Jeremy Cole says Twitter uses HP DL380.
2011-04-15 08:22:10![](https://s.togetter.com/static/web/img/placeholder.gif)
I scream, you scream - we all scream for ice cream! Ice Cream Social Closing Reception at 4:35pm Ballroom A-D Foyer #mysqlconf
2011-04-15 08:25:00![](https://s.togetter.com/static/web/img/placeholder.gif)
wonder if @jeremycole went to baron's math talk on forecasting perf. & scaling? #twdata #mysqlconf
2011-04-15 08:25:49![](https://s.togetter.com/static/web/img/placeholder.gif)
wonder if @jeremycole went to baron's math talk on forecasting perf. & scaling? #twdata #mysqlconf
2011-04-15 08:25:50![](https://s.togetter.com/static/web/img/placeholder.gif)
Reflecting on #mysqlconf, new players & projects are part of the ecosystem. The raise of the #DSA (data store admin)?
2011-04-15 08:48:00