Data Warehouse

[VINICIUS RAMOS 0]

Aí galera,Alguém sabe onde encontro um bom material de DW(como funciona, data marts, datamining, etc)?Se souberem algum livro que compense comprar também, agradeço pela dica.

[Motta 645]

1)Ralph Kimball & Bill Inmon são os papas deste troço

 

 

2) Este é o site do orgão que tenta padronizar o DataWareHouse

 

http://www.omg.org/technology/cwm/

 

3) Esta biblio me foi passada no curso que fiz na puc-rj

(deve ir meio bagunçada pois era um .doc)

 

Curso de Data Warehousing

Puc-Rio Prof. Rubens

Esta é uma tabela que achei no site do Kimball (www.ralphkimball.com) que comenta alguns dos principais livros, cursos (web) e sites de DWing.

Despite all the technology around today, the book remains the most cost effective communication/learning mechanism available to us. For less than $US80 in most cases you can gain access to the finely distilled knowledge of many years experience. That's a bargain.

If you can learn from books, you have the opportunity to go far in the data warehousing business because there are now quite a few available. The rather astounding sales numbers for 'The Data Warehouse Toolkit' has encouraged quite a few others in the industry to turn their hands at writing books.

These are the books I recommend a person new to data warehousing go out, buy and actually read.

Book Description

Building the Data Warehouse This was the first major book published on building a data warehouse. It has been revised and extended. This book formed the core of Bills early seminars on data warehousing. A must read.

Building the Operational Data Store Not long after people started building data warehouses that centralised all customer information into one place other people in the organisations started hanging call centres off the data warehouse. This was because often times the data warehouse was the only place that all customer information was readily available in one relational database, hence it's value as the major input for the call centre. This, unfortunately, destroyed the use of the data warehouse for analysis because the transaction needs of the call centre superseded the analytical needs of the data warehouse users. So, in a lot of places, an integration layer was introduced to provide access too customer information for the call centre. This was the 'genesis' of something that finished up being called the 'Operational Data Store'. The ODS has evolved a long way from being a call centre database and this book tells you pretty much all you need to know about building one. A must read if you are going to build an ODS within your informational systems.

Corporate Information Factory As time has gone on the architecture of 'information systems' has evolved and become more thoroughly understood. Bill Inmon, Claudia Imhoff and Ryan Sousa have published 'The Corporate Information Factory' as one proposed architecture for implementing 'Information Systems'. The Data Warehouse has evolved into being just one component of the CIF. There is public debate over whether the CIF is the 'one true' way to implement information systems. My opinion about that is you could do much worse than to use the CIF as input to what you are doing. A must read.

The Data Warehouse Toolkit I, for one, was very pleased when Ralph published this book. For one thing, DBAs stopped kicking me out of the building without even talking to me because there seemed to be more to this 'star schema' thing than just my 'rants and raves'. Indeed, I bought and gave away many copies of this book as well as recommended it to endless customers. This book provides an excellent foundation for learning about multi-dimensional modelling. The example databases can be used to learn on. If you ever intend to build a star schema database this is a must read.

The Data Warehouse Lifecycle Toolkit What Ralph did not talk about in his first book was how to actually build a star schema data warehouse. This book was the follow up which contains a great deal of detail as to how to build a star schema data warehouse. It puts the whole data warehouse project into a proposed architecture called the 'BUS Architecture' and provides a methodology which is quite serviceable. What I liked most about it was the advanced dimensional modelling techniques. Again, a must read if you are going to build a star schema data warehouse. It would help greatly if you had read the first book when reading this one. So buy them both and read them one after another.

The Data Webhouse Toolkit With the hype of the internet it was almost inevitable that many authors would come out with books about it. Ralph's book on the topic is a good effort. Unfortunately I have not had the chance to actually build a web warehouse so I can't comment as to whether everything works as advertised. Perhaps other people who have used it would like to provide comment. I would think that if you are going to build a data warehouse based on web logs this book is an excellent place to start.

Data Warehousing in Action This was the second effort by Sean Kelly after 'Mass Customisation'. It provides excellent coverage of all aspects of data warehousing for beginners and takes a look into the future about what might be next. The 'what next' is happening now. A must read if you are starting out.

Data Warehouse Design Solutions With the success of Ralphs book, The Data Warehouse Toolkit, it was inevitable that other 'data model toolkit' books would come out. The one I like the best is this one. It provides good working models for a variety of functions that are common in many companies. This is a very useful book for people who are consulting across numerous companies or who have an EDW to implement in a sizable company.

 

 

 

Web Sites to Read

Site Description

Larry Greenfield Larry's site is the best set of links to further material available on the web. If you are looking for a vendor or good article you are pretty sure to find what you want on this web site.

Bill Inmon White Papers Bill has published a lot of 'white papers' and 'tech topics' over the years. You should browse through these to see which ones are relevant to exactly what you want to learn. Sign up for the newsletters, they are often interesting reads.

Ralph Kimball Design Tips Ralph has published a series of Design Tips, many of which are over and above what has been published in his books. If you are going to build dimensional models you should print and read these design tips.

The OLAP Report The OLAP Report has a small amount of well researched public information available. Worth a browse to understand where the front end tools market is at. The market share and changes in market share give you a quick view of how vendors are doing. The subscription based report has the most comprehensive report on the OLAP space that money can buy. I was working with a customer a while ago and we used the OLAP report to assist us in evaluating products. It was very good. It's not cheap though.

Intelligent Enterprise Data Warehousing Page The Intelligent Enterprise Magazine is one of the best sources of articles and information on what is happening lately in the data warehousing world. The articles stored on the data warehouse page are interesting and informative. Well worth a look.

 

 

 

Classes to Take

Site Description

RKA University Many years ago when I was at HDS I decided it would be a very good idea to create a 'Data Warehouse University'. The concept was to create a suite of courses that consultants working in the team would have to take (and pass) in order to be 'qualified' for certain consulting engagements. The idea being to differentiate us from other organisations who all too often put people into customers who didn't know how to spell data warehouse. My Data Warehouse University didn't get off the ground at the time. Such is life. However, RKA has now put together a suite of classes which will take you from the quite basic to the quite advanced. If you have the budget they are well worth taking, even if you have read the books.

The Data Warehouse Institute Another organisation who has excellent classes is TDWI. I must say I haven't had the opportunity to go to them. All I can say is that I am reliably informed that they have been very worthwhile for other people I have talked to who have gone to such classes. TDWI classes are generally full day and highly focused.

 

Controversies

Here we tackle various topics related to dimensional design that come up with surprising regularity in data warehouse literature, training and marketing information. These are often powerful issues rooted in incomplete or misleading information that ends up influencing decision making. Ultimately only you can decide how to build your data warehouse, but we do want you to build your data warehouse and broader business intelligence system on a sturdy foundation of accurate information.

 

Fables and Facts about Data Warehousing

Misinformation often comes in the form of a sound bite that sounds plausible, but isn’t based on actuality. Such sound bites unfortunately tend to reverberate without correction, creating more misinformation. While misinformation in any venue is disappointing to us, we are energized to provide you accurate information.

 

Mastering Data Warehouse Design: Relational and Dimensional Techniques

by Claudia Imhoff, Nicholas Galemmo and Jonathan Geiger (Wiley, 2003).

Learn about Ralph’s “open letter to the data warehousing community” mentioned on the back cover of this book. The full datawarehousing.com list server posting is provided.

 

Interview with Ralph Kimball by PASS (Professional Association

for SQL Server)

This interview addresses broad issues in Business Intelligence including definitions, methodologies, ETL and his impressions of current databases, Microsoft technology and end user tools for Business Intelligence. (PDF of interview)

[alphamek 2]

Segue um link nacional:

 

DW BRASIL

 

Muito bom o texto motta... não conhecia o site. Show!

 

Abraços, http://forum.imasters.com.br/public/style_emoticons/default/joia.gif

[kakaroto gonzales 0]

Segue um link nacional: DW BRASIL Muito bom o texto motta... não conhecia o site. Show! Abraços, http://forum.imasters.com.br/public/style_emoticons/default/joia.gif

tenho umas duvidas sobre dwsobre o tipo de consultas que um gestor pode fazer usando um DWe que tipo de informação um datawarehouse não consegue fornecer?qual se destaca (das caracteristicas do dw) como mais importante do ponto de vista do gestor da empresa? valeus

[alphamek 2]

BOM! Pelo que trabalhei com DW, ele é capaz de fornecer todas as informações da empresa, porque propriamente dito, ele é um armazén de informação desnormalizada.

 

A função dele é histórico, então consultas gerencias, para diretoria e presidencia executam sobre ele, para consulta mensais, semestrais e anuais... isso vai de DW para DW.

 

Abraços,

[Motta 645]

DW é ferramente de gerencia.

 

O gestor analisa o histórico e vê soluções de problemas ou possíveis novos mercados.

 

Por exemplo um gestor de supermercado pode ver que uma determinada loja vendeu muito menos um determinado produto que outras , vai analisar o porque e descobre que o público ali e maior de pessoas solteiras e a loja concentra a venda em produtos de embalagens do tipo grande, muda o tipo de embalagem como solução.

 

Exemplinho meio capenga mas é algo por aí.

[kakaroto gonzales 0]

podiscre

valeu galera

 

so uma coisa que nao foi respondida

 

que tipo de informação um datawarehouse não consegue fornecer?

 

valeu

[Motta 645]

Informações operacionais.

 

Tipo :

Totais de títulos em aberto.

Endereço de um cliente.

[kakaroto gonzales 0]

O DW nao consegue fornecer um endereço de um cliente?

[ri_nepo 0]

Até pode , isso depende de como você monta o DW , mas na pratica o foco são informações gerenciais para tomadas de decisão

 

abraços

 

Ricardo Nepomuceno

Analista DBM

www.dotz.com.br

[Motta 645]

"Consegue" não é bem o verbo , um DW em relação a endereços deveria responder a perguntas do tipo :

 

Qts clientes do sexo feminino entre 20 e 30 anos tenho no RJ