
I am a Data Architect for Shutterfly Inc. in Redwood Shores, CA.
LinkedIn Profile-
Github activity
2010-09-07 20:31:11: kgorman created gist: 5690412010-09-07 20:18:04: kgorman created gist: 5690182010-08-28 01:48:18: kgorman updated gist: 5545412010-08-28 01:48:05: kgorman updated gist: 5545412010-08-28 01:46:34: kgorman updated gist: 554541 Categories
- Data Architecture (5)
- Database Engineering (12)
- Mongodb (12)
- MySQL (1)
- Oracle (5)
- PostgreSQL (18)
- Python (7)
- Random (6)
Recent Comments
- jametong on Data clustering in MongoDB using embedded docs
- Data clustering in MongoDB using embedded docskennygorman.com | kennygorman.com on Cluster data, save cash
- kgorman on WordPress 3.0
- Disk I/O: PCI Based SSDs « makeitfaster on Fusion-io SSD
- Log Buffer #189, A Carnival of the Vanities for DBAs « So Many Oracle Manuals, So Little Time on Wayback Machine: snapshots still valid technique
Tags
acid architecture auto-increment backups cap theorem clustering database Database Engineering direct i/o durability fusion-io gnuplot hp Mongodb mongosf mongostat MySQL nosql open source Oracle performance pgstat pg_reorg PostgreSQL postgresql Python replica sets replication rrdtool rss scalability sequence Shutterfly slony snapshots Solaris SSD statspack strace Sun tools vxfs WordpressBlogroll
Archives
Tag Archives: Oracle
Wayback Machine: snapshots still valid technique
I came across this old article I wrote for the NOCOUG newsletter in 2002 about using OS snapshots for backups. This technique is still very much a valid and widely used technique to perform backups. The idea is simple: – … Continue reading
Posted in Database Engineering, Mongodb, Oracle, PostgreSQL
Tagged backups, Oracle, postgresql, snapshots
View Comments
The death of a Sun
As I was shutting down my last Sun server in my colo, I was thinking back about how things have changed. It’s sad to see such a great company fall. But it seems there is little reason to keep using … Continue reading
Dropping ACID
The de-facto durability story in MongoDB is essentially… there is none. Or at least single server durability. OMFG! No ACID WTF! &^%#^#?! For the next generation of internet scale, downtime intolerant systems, ACID may not be a desirable property. Traditional … Continue reading
Posted in Data Architecture, Database Engineering, Mongodb, MySQL, Oracle
Tagged acid, architecture, cap theorem, durability, MySQL, Oracle, postgresql, replication, scalability
View Comments
Open source databases; scaling the application stack.
After reading Allan Packers excellent blog entry; Are Proprietary Databases Doomed?, a couple of additional thoughts came to mind. He mentions that open source databases (OSDB’s) are becoming ‘good enough’, and explains about how most users don’t need or use … Continue reading
Posted in PostgreSQL
Tagged architecture, open source, Oracle, postgresql, scalability
View Comments
Incremental Commits in PostgreSQL
On large and/or busy databases it’s often not feasible to update an entire table at one time. For instance, if one has to perform some background DML task to change all credit card limits on a 300gb table that sees … Continue reading
Python/cx_Oracle utility functions
I recently created some utility functions to startup, mount and stop Oracle via cx_Oracle and thought I would share them. You will want to make sure you have password files setup correctly in order for this stuff to work. # … Continue reading
Python and cx_oracle
I decided to start futzing with Python and Oracle. I generally use perl for most everything, and sometimes php for web based things, but I wanted to try Python at the urging of colleagues. I downloaded the source from here, and added … Continue reading
Backing up Oracle optimizer statistics
Oracle 10g has some neat features for keeping track of old statistics. Pre-10g It used to be important to backup your statistics before you analyzed a table just in case your plans went crazy. Now Oracle does this for you … Continue reading
Using Statspack Effectively
Statspack has been around since Oracle 8.1.5 and many DBAs regularly use it to diagnose and troubleshoot problems. Most of the time the stock report ($ORACLE_HOME/rdbms/admin/spreport.sql) is what is used. While good, this report only shows a snapshot of the … Continue reading