
I am a Data Architect for Shutterfly Inc. in Redwood Shores, CA.
LinkedIn Profile-
Github activity
2010-09-07 20:31:11: kgorman created gist: 5690412010-09-07 20:18:04: kgorman created gist: 5690182010-08-28 01:48:18: kgorman updated gist: 5545412010-08-28 01:48:05: kgorman updated gist: 5545412010-08-28 01:46:34: kgorman updated gist: 554541 Categories
- Data Architecture (5)
- Database Engineering (12)
- Mongodb (12)
- MySQL (1)
- Oracle (5)
- PostgreSQL (18)
- Python (7)
- Random (6)
Recent Comments
- jametong on Data clustering in MongoDB using embedded docs
- Data clustering in MongoDB using embedded docskennygorman.com | kennygorman.com on Cluster data, save cash
- kgorman on WordPress 3.0
- Disk I/O: PCI Based SSDs « makeitfaster on Fusion-io SSD
- Log Buffer #189, A Carnival of the Vanities for DBAs « So Many Oracle Manuals, So Little Time on Wayback Machine: snapshots still valid technique
Tags
acid architecture auto-increment backups cap theorem clustering database Database Engineering direct i/o durability fusion-io gnuplot hp Mongodb mongosf mongostat MySQL nosql open source Oracle performance pgstat pg_reorg PostgreSQL postgresql Python replica sets replication rrdtool rss scalability sequence Shutterfly slony snapshots Solaris SSD statspack strace Sun tools vxfs WordpressBlogroll
Archives
Tag Archives: Mongodb
MongoDB: Lagged Replica with Replica Sets
In an enterprise database architecture, it’s very common to create a standby or replica database with a ‘lag’ in it’s state relative to the primary. Operations applied to the primary are not seen on the replica for some amount of … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb
Tagged Mongodb, replica sets
View Comments
Why Not Auto Increment in MongoDB
I came across this blog post with a nice pattern for auto-increment in MongoDB. It’s a great post, but there is something to think about beyond how to logically perform the operation; performance. The idea presented in the blog is … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb, Python
Tagged auto-increment, Mongodb, postgresql, Python, sequence
View Comments
mongo_graph: a rrdtool graphing utility for MongoDB
I just uploaded a little utility that pulls performance data from MongoDB and loads it into rrdtool for trending and analysis. Sure there are options like cacti out there, but this is just a simple raw utility vs something designed … Continue reading
Data clustering in MongoDB using embedded docs
I wrote a while ago about how to cluster data to save cash. This post was geared towards relational stores. But in reality, the technique is applicable to any block store on disk. To recap, the premise is simple. When … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb
Tagged architecture, clustering, Mongodb, performance
View Comments
mongostat
The MongoDB command line performance monitoring utility named mongostat is now (well since 1.3.3) part of the core distribution of Mongodb. The python version hosted on my site is now deprecated in lieu of the C++ version in the distro.
MongoSF; Video’s up
The videos from MongoSF are starting to get posted now on the 10gen site. The presentations are there too. Here is my talk:
MongoSF Slides
I had a great time at the MongoSF Conference on Friday. There were a ton of great presentations, and lots and lots of excitement. A big thanks to 10gen for inviting me to speak. I had a great time and … Continue reading
mongodb 1.3.3 (devel) with mongostat
MongoDB 1.3.3 (devel) was released today. My tool called mongostat has been incorporated into mongo1.3.3 and changed from python to C++. So further development will come inside the mongodb distribution itself. Also of note is new slave lag for replication. … Continue reading
mongostat 0.2b
I have been playing quite a bit with MongoDB lately. MongoDB is a nosql type database. It’s different than a simple k/v store however. It allows sorting, secondary indexes and such. It’s format is BSON a binary representation of JSON … Continue reading