I am a Data Architect for Shutterfly Inc. in Redwood Shores, CA.
LinkedIn Profile-
Github activity
2010-09-07 20:31:11: kgorman created gist: 5690412010-09-07 20:18:04: kgorman created gist: 5690182010-08-28 01:48:18: kgorman updated gist: 5545412010-08-28 01:48:05: kgorman updated gist: 5545412010-08-28 01:46:34: kgorman updated gist: 554541 Categories
- Data Architecture (5)
- Database Engineering (12)
- Mongodb (12)
- MySQL (1)
- Oracle (5)
- PostgreSQL (18)
- Python (7)
- Random (6)
Recent Comments
- jametong on Data clustering in MongoDB using embedded docs
- Data clustering in MongoDB using embedded docskennygorman.com | kennygorman.com on Cluster data, save cash
- kgorman on WordPress 3.0
- Disk I/O: PCI Based SSDs « makeitfaster on Fusion-io SSD
- Log Buffer #189, A Carnival of the Vanities for DBAs « So Many Oracle Manuals, So Little Time on Wayback Machine: snapshots still valid technique
Tags
acid architecture auto-increment backups cap theorem clustering database Database Engineering direct i/o durability fusion-io gnuplot hp Mongodb mongosf mongostat MySQL nosql open source Oracle performance pgstat pg_reorg PostgreSQL postgresql Python replica sets replication rrdtool rss scalability sequence Shutterfly slony snapshots Solaris SSD statspack strace Sun tools vxfs WordpressBlogroll
Archives
Category Archives: Data Architecture
MongoDB: Lagged Replica with Replica Sets
In an enterprise database architecture, it’s very common to create a standby or replica database with a ‘lag’ in it’s state relative to the primary. Operations applied to the primary are not seen on the replica for some amount of … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb
Tagged Mongodb, replica sets
View Comments
Why Not Auto Increment in MongoDB
I came across this blog post with a nice pattern for auto-increment in MongoDB. It’s a great post, but there is something to think about beyond how to logically perform the operation; performance. The idea presented in the blog is … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb, Python
Tagged auto-increment, Mongodb, postgresql, Python, sequence
View Comments
Data clustering in MongoDB using embedded docs
I wrote a while ago about how to cluster data to save cash. This post was geared towards relational stores. But in reality, the technique is applicable to any block store on disk. To recap, the premise is simple. When … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb
Tagged architecture, clustering, Mongodb, performance
View Comments
MongoSF Slides
I had a great time at the MongoSF Conference on Friday. There were a ton of great presentations, and lots and lots of excitement. A big thanks to 10gen for inviting me to speak. I had a great time and … Continue reading
Dropping ACID
The de-facto durability story in MongoDB is essentially… there is none. Or at least single server durability. OMFG! No ACID WTF! &^%#^#?! For the next generation of internet scale, downtime intolerant systems, ACID may not be a desirable property. Traditional … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb, MySQL, Oracle
Tagged acid, architecture, cap theorem, durability, MySQL, Oracle, postgresql, replication, scalability
View Comments