Madison - High end scale out for data warehousing

-
As with my other TechEd 09 notes, this will be a list of notes that I made during the presentation. These will give a start point to find out further information.

Project Madision:
  • 100's of terabytes
  • FastTrack reference architecture - guarantees consistent throughput for high scale data warehouses
  • Massive scale out to 100's TB
  • Developed by DatAllegro, MS bought them a year ago and are now incorporating their software into Kilimanjaro
  • Large tables are hash distributed
  • Small tables and dimension tables are replicated
  • Create DB is now a simple script for DBAs. This script triggers a system script that will set up an optimally created database.
  • Create table/partition is now combined in one statement

Comments

Jon said…
Thanks for posting your notes about Madison! I've been following all the latest about it - it certainly sounds like it's going to be exciting - now let's just hope it isn't horribly expensive. :)
18 September 2009 at 04:01
Post a Comment

Popular posts from this blog

Yay - It works! Rebuild/Reorganize all indexes in one go - woo hoo

-
/*Version 1 of my script to fix all fragged indexes on a database */ /*Must be logged in as [sa] for this to work, if not, you will get permissions errors*/ /*You should be able to copy and paste this script in its entirity to your SQL 2005 or higher query window and run it without altering anything other than the USE .*/ /*Perform a 'USE ' to select the database in which to run the script.*/ USE AdventureWorks GO -- Make sure temp table doesn't exist IF EXISTS (SELECT * FROM sys.objects WHERE object_id = OBJECT_ID(N'[dbo].[tmp_fraglist]') AND type in (N'U')) DROP TABLE [dbo].[tmp_fraglist] GO -- Declare variables SET NOCOUNT ON DECLARE @tablename NVARCHAR (255) DECLARE @indexname NVARCHAR (255) DECLARE @indextype NVARCHAR (255) DECLARE @execstr NVARCHAR (255) DECLARE @pagecounts INT DECLARE @frag DECIMAL DECLARE @reorgFragSize DECIMAL DECLARE @rebldFragSize DECIMAL DECLARE @numrecords INT DECLARE @rowcount INT DECLARE @errorMessage
Read more

The Grace Jones

-
Well, we finished recording the CD and now all the hard work is starting, the editing, mixing, production etc... We've also got some guys working on a video for us which sounds as though it's going to be interesting. Time to sell the house in order to pay for the tour of Ireland next year I guess. :)
Read more

What is a geek?

-
Someone raised an interesting point on Monday night at a GGD dinner and I feel they have missed the entire point of Girl Geek Dinners and have also, with their comments, seriously undermined other women who are looking to come out of their shell and interact with other 'geeks'. If you don't agree with what we're doing then don't come to a Girl GEEK dinner, and certainly don't turn up and throw cold water on people, make belittling comments and then moan that it was too technical and you didn't enjoy it. So what is a geek? There seemed to be some confusion. These women throwing around the derogatory comments seem especially confused. So let's refresh everyones' minds. You don't need to be in IT to be a geek folks! It's not an exclusive club limited to women who don't baulk at the thought of writing code. We're a diverse crowd and we celebrate each others geekiness, even if it isn't something we're into. We certainly
Read more