Tag Archives: Python

Why Not Auto Increment in MongoDB

Posted on August 4, 2010 by kgorman

I came across this blog post with a nice pattern for auto-increment in MongoDB. It’s a great post, but there is something to think about beyond how to logically perform the operation; performance. The idea presented in the blog is … Continue reading →

Posted in Data Architecture, Database Engineering, Mongodb, Python | Tagged , , , , | View Comments

mongo_graph: a rrdtool graphing utility for MongoDB

Posted on July 23, 2010 by kgorman

I just uploaded a little utility that pulls performance data from MongoDB and loads it into rrdtool for trending and analysis. Sure there are options like cacti out there, but this is just a simple raw utility vs something designed … Continue reading →

Posted in Mongodb, Python | Tagged , , | View Comments

mongostat 0.2b

Posted on February 9, 2010 by kgorman

I have been playing quite a bit with MongoDB lately. MongoDB is a nosql type database. It’s different than a simple k/v store however. It allows sorting, secondary indexes and such. It’s format is BSON a binary representation of JSON … Continue reading →

Posted in Mongodb, Python | Tagged , , , | View Comments

pgstat 1.0 released

Posted on November 10, 2009 by kgorman

I added a couple of fixes to the code and released it as 1.0. We have been using it here at hi5 for some time w/o problems. Thanks everyone who has helped with feedback. Also thanks to Devrim GUNDUZ for … Continue reading →

Posted in PostgreSQL | Tagged , , | View Comments

pgstat: a database utility like iostat

Posted on October 21, 2008 by kgorman

I needed a utility for capturing various data-points about a PostgreSQL database as I performed load tests. I copied a utility I have used previously on Oracle that worked quite well. The new utility is called pgd pgstat. This utility … Continue reading →

Posted in PostgreSQL | Tagged , , | View Comments

Unique identifier for a database without connecting to the database?

Posted on September 16, 2008 by kgorman

In PostgreSQL, the working directory is a unique identifier for a database, and sometimes you want to use that working dir in your script(s). But what if you don’t want to actually connect and query the database? Is there a … Continue reading →

Posted in PostgreSQL | Tagged , | View Comments

Python script showing PostgreSQL objects in linux memory: pg_osmem.py

Posted on July 2, 2008 by kgorman

I got some email and comments about the code I used for my post; Mapping Linux memory for PostgreSQL using fincore so I thought I would post the code I am using. Nothing too fancy here, it needs a config … Continue reading →

Posted in PostgreSQL | Tagged , | View Comments

pg_standby lag monitoring

Posted on June 24, 2008 by kgorman

I have been using pg_standby quite a bit lately, and thus we needed some management tools around it.  One simple thing that was sorely missed was lag monitoring.  When you have 100′s of standby’s,  and many of them on the … Continue reading →

Tagged , | View Comments

Mapping Linux memory for PostgreSQL using fincore

Posted on June 18, 2008 by kgorman

PostgreSQL, more-so than other databases generally relies on OS file system cache to keep performance high. It is pretty common not to see gains in performance for buffer cache sizes over about 2GB, why this is true I am unsure, … Continue reading →

Posted in PostgreSQL | Tagged , | View Comments

Python/cx_Oracle utility functions

Posted on March 31, 2008 by kgorman

I recently created some utility functions to startup, mount and stop Oracle via cx_Oracle and thought I would share them. You will want to make sure you have password files setup correctly in order for this stuff to work. # … Continue reading →

Posted in Python | Tagged , | View Comments