RE: Building Fast Data Warehouse Schema's, Deploying a Star Schema - a New Webcast at Tue 2/22/10 at 2:00pm EST

> Date: Mon, 22 Feb 2010 22:33:42 +0000 > From: obnoxio@serendipita.com > CC: informix-list@iiug.org > Subject: Re: Building Fast Data Warehouse Schema's, Deploying a Star Schema - a New Webcast at Tue 2/22/10 at 2:00pm EST > > Ian Michael Gumby wrote: > > > > > What it means is that you can't just buy a tool and expect it to do wonders. > > What, you mean like Hadoop or something? > Exactly. First, people don't buy Hadoop/HBase, its free. And unlike a general purpose database, HBase is column oriented and a bit primitive. But it performs pretty well. If you want to use Pig and Hive over Hadoop, you can apply more SQL type commands for analytics. Even in Hadoop, you have to write your own map/reduce code. But here's the thing. The people who are doing the coding and working are the guys coming out of school. They're not looking at relational databases because they don't scale. You're looking at a cloud because for the price of just the database license on one node, you can pay for 10 nodes in the cloud. So you gain more from being able to take advantage of the distributed nature. There's no free ride, but the tROI is much shorter and ROI is larger because you're making less of an investment. IN IT departments you can't really continue to make people redundant. So you have to look at other ways of cutting costs. If you look at the companies behind this technology, you'd understand why people are investigating using it in large scale production. The question you have to ask yourself, can you scale your data warehouse linearly over 100+ nodes? And then ask yourself, how much would it cost to do this w 100 nodes of XPS on 8 core Xeon boxes w 8TB of disk per node? And unlike your traditional RDBMSs you don't have a performance penalty w SATA vs SAS disks. So its a compelling technology. But not right for all occasions. Speaking of which, I think that it was released publicly. Twitter's analysis from the super bowl ads was here. http://blog.twitter.com/2010/02/super-data.html Its kind of cool actually. But hey! What do I know? :-) -G _________________________________________________________________ Your E-mail and More On-the-Go. Get Windows Live Hotmail Free. http://clk.atdmt.com/GBL/go/196390709/direct/01/