ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo

Getting The Runs On The Board One Run At A Time V5

?Download as PPT, PDF?
?
D
David Waters

AAIR Data Warehousing (DW) Special Interest Group (SIG) Forum 2009 27-28 August, 2009, Griffith University, Nathan campus

1 of 37
Download to read offline
Getting the Runs on the Board One Run at a Time Business intelligence initiatives Ralph Kimball¡¯s dimensional modelling design patterns. Business Intelligence, Planning, Budgeting & Reporting
Getting the Runs on the Board One Run at a Time Two to three month sprints Extensive data warehouse, one data mart at a time Business Intelligence, Planning, Budgeting & Reporting
Getting the Runs on the Board One Run at a Time Focusing on user needs Delivering as rapidly as possible Business Intelligence, Planning, Budgeting & Reporting
OR Agile Business Intelligence Lean mean business intelligence team Business Intelligence, Planning, Budgeting & Reporting
Supporting Processes Source Control Infrastructure Control Automagical Testing Bug Tracking Business Intelligence, Planning, Budgeting & Reporting
Manifesto for Agile Software Development Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan That is, while there is value in the items on the right, we value the items on the left more http:// agilemanifesto.org / Business Intelligence, Planning, Budgeting & Reporting
What Agile Isn¡¯t Lack of processes and tools Lack of documentation Lack of contract negotiation Lack of planning Business Intelligence, Planning, Budgeting & Reporting
What Else Agile Isn¡¯t A religious dogma The difference between a methodologist and a terrorist is that you can negotiate with a terrorist - Ralph Kimball Business Intelligence, Planning, Budgeting & Reporting
Which Agile Method Do We Use? Agile Unified Process (AUP)? Agile Data Method? DSDM? Essential Unified Process (EssUP)? Extreme programming (XP)? Feature Driven Development (FDD)? Getting Real? Open Unified Process (OpenUP)? Scrum? Lean software development? Crystal Clear Business Intelligence, Planning, Budgeting & Reporting
Which Agile Method Do We Use? We haven¡¯t chosen a methodology Principle and practices that experience shows as working Business Intelligence, Planning, Budgeting & Reporting
Lean Software Development I¡¯m personally a fan of Mary Poppendieck¡¯s work which is based on Toyota¡¯s lean manufacturing Eliminate waste Amplify learning Decide as late as possible Deliver as fast as possible Empower the team Build integrity in See the whole Business Intelligence, Planning, Budgeting & Reporting
Minimal Documentation Design Documentation Handover Documentation Change Management Documentation (Technical How To Documents and End User Documentation) Business Intelligence, Planning, Budgeting & Reporting
Stage 1 ¨C SET and SEC Model Our First Star Schema ¨C SET and SEC Business Intelligence, Planning, Budgeting & Reporting
Stage 2 ¨C Student Model Plus Live Student Feed Business Intelligence, Planning, Budgeting & Reporting
Stage 3 ¨C GDS Model Plus Graduate Destination Survey Business Intelligence, Planning, Budgeting & Reporting
Stage 4 ¨C At Risk Students, Staff, Admissions Models Plus Students at Risk, Staff, QTAC Feed Business Intelligence, Planning, Budgeting & Reporting
Documentation Data Warehouse Framework ¨C Warehouse Architect User Requirements ¨C Business Analysts Star Schema Design ¨C Business Systems Analyst ETL Jobs ¨C Intern/Business Systems Analyst Initiatives Support ¨C Business Systems Analyst Training Documents ¨C BI Trainer ? How To Documents ¨C All Business Intelligence, Planning, Budgeting & Reporting
Agile Still Needs Planning Design Documents Good Architecture and Design Source Control Migration Control Managed Infrastructure Testing++ Handover and Training Documents Business Intelligence, Planning, Budgeting & Reporting
Manifesto for Agile Software Development Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan http://agilemanifesto.org/ Business Intelligence, Planning, Budgeting & Reporting
Agile BI Absolutely Needs Individuals and interactions Talented well trained staff Working software Good Testing Automagical where possible Frequent customer collaboration and interaction Engage the end users Responding to change Tools and data models that allow for adaptability It¡¯s hard to be adaptable when the tools are old Business Intelligence, Planning, Budgeting & Reporting
Good Design As an architect you design for the present; with an awareness of the past; for a future which is essentially unknown ¨C Norman Foster Jan 2007 Munich Germany http:// www.ted.com/talks/norman_foster_s_green_agenda.html Note: Photos about Norman Foster from Wikipedia or www.fosterandpartners.com Business Intelligence, Planning, Budgeting & Reporting
Good Design - Willis Faber & Dumas Headquarters The country headquarters for insurance company Willis Faber & Dumas was a pioneering example of energy-conscious design that challenged accepted thinking about the office building. Offering a new social dimension with its swimming pool, roof-top garden and restaurant, it was conceived in the spirit of democratising the workplace and engendering a sense of community. http://www.fosterandpartners.com/Projects/0102/Default.aspx Constructed 1970 to 1975 Open plan, three floors,1300 office staff Listed by British Heritage as a Grade 1 building of outstanding architectural or historic interest. Business Intelligence, Planning, Budgeting & Reporting
Good Design - 30 St Mary Axe ¨C The Gherkin Built on the site of the Baltic Exchange Building Heritage listed building damaged beyond repair by a PIRA bomb in April 1992 London¡¯s first ecological tall building ... is rooted in a radical approach - technically, architecturally, socially and spatially. Generated by a radial plan, its energy-conscious enclosure resolves walls and roof into a continuous triangulated skin, allowing column-free floor space, light and views. http://www.fosterandpartners.com/Projects/1004/Default.aspx Business Intelligence, Planning, Budgeting & Reporting
Good Design - Millau Viaduct - Southern France Business Intelligence, Planning, Budgeting & Reporting
Good Design - Millennium Bridge (London) Business Intelligence, Planning, Budgeting & Reporting
Good Design - Millennium Bridge (London) Opened June 2000 ?18.2m (?2.2m over budget) Closed 3 days later due to wobbling People walking caused the bridge to sway in step Retrofitted with 89 dampers to control movement Reopened February 2002 Retrofit cost ?5m Romans first bridged Thames in 50AD ? Medieval London Bridge lasted from 13th to 19th Century Harry Potter and the Half Blood Prince Business Intelligence, Planning, Budgeting & Reporting
Design Patterns A design pattern is a formal way of documenting successful solutions to problems. The idea was introduced by the Austrian born American architect Christopher Alexander and has been adapted for various other disciplines. Christopher Alexander is Professor Emeritus at the University of California (Berkeley) Alexander, Christopher et al (1977). A Pattern Language: Towns, Buildings, Construction This book contains 253 Architectural Design Patterns e.g. 146. Flexible Office Space 147. Communal Eating 148. Small Work Groups 149. Reception Welcomes You 150. A place to Wait 151. Small Meeting Rooms 152. Half-Private Office ( http:// downlode.org/Etext/Patterns / ) Business Intelligence, Planning, Budgeting & Reporting
Design Patterns ¨C Pattern 21 Four-Story Limit Pattern 21 Four-Story Limit May be part of Magic of the City (10), City Country Fingers (3), Lace of Country Streets (5) Conflict There is abundant evidence to show that high buildings make people crazy Resolution In any urban area, no matter how dense, keep the majority of buildings for stories high or less. It is possible that certain buildings should exceed this limit, but they should never be buildings for human habitation May contain Number of Stories (96), Density Rings (29), Building Complex (95), Housing Hill (39), High Places (62) http://downlode.org/Etext/Patterns/ptn21.html Business Intelligence, Planning, Budgeting & Reporting
Pattern Language Pattern Language (Wikipedia) Noticing and naming the common problems in a field of interest, Describing the key characteristics of effective solutions for meeting some stated goal, Helping the designer move from problem to problem in a logical way, and Allowing for many different paths through the design process. ( http:// en.wikipedia.org/wiki/Pattern_language ) Business Intelligence, Planning, Budgeting & Reporting
Design Patterns Are Not One off Problems Usable only in one business Specific to a location, state or country One off business problems with a very specific set of parameters can be solved elegantly and simply but that is not a design pattern Business Intelligence, Planning, Budgeting & Reporting
Software Design Patterns October 1994 (2005 Copyright notice) Design Patterns: Elements of Reusable Object-Oriented Software Software engineering book describing recurring solutions to common problems in software design Written by Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides (The Gang of Four ¨C None were married to Chairman Mao) The book goes through common generic software engineering problems and discusses solutions to the problems in Object Oriented terms Gives a common vocabulary to fairly abstract terms Business Intelligence, Planning, Budgeting & Reporting
Example Design Pattern - Singleton Used to restrict instantiation of a class to one object (What is that in English???) For example, my software wants to connect to an Oracle database, but we only connect once; we would create the database connection as a singleton. If it exists at run time we use the one that exists, if not we create one. Prior to GOF¡¯s book we described this in English but now we just say, ¡°Use a singleton on the Oracle connection¡±. Singleton is the simplest pattern (IMHO). Business Intelligence, Planning, Budgeting & Reporting
Dimensional Modelling Design Patterns Dimension Design Patterns Role Playing Dimension Slowly Changing Dimensions (Type 1, Type 2, Type 3, Type 6 / Hybrid) Audit Dimension Ragged Hierarchies using Bridge Tables Etc Business Intelligence, Planning, Budgeting & Reporting
Fact Table Patterns The Kimball method uses only three fact table design patterns Transactional Fact Table Periodic Snapshot Fact Table Accumulating Snapshot Fact Table Fundamental Grains - Almost all data warehouses sit on one of three bedrock designs ( www.intelligententerprise.com/db_area/archives/1999/993003/warehouse.shtml ) In Auckland 2007 he used stronger words than this, he said something like: ¡°After looking at thousands of designs and being the chief architect on more than 30 enterprise data warehouse projects, I have yet to see a design that couldn¡¯t fit into one of these three fact table grains¡±. Business Intelligence, Planning, Budgeting & Reporting
Summary Agile works if Staff are talented, well trained, well funded and appreciated Software is well tested, delivered rapidly Customers are engaged, interaction, regarded as capable Software can rapidly adapt to change Agile Requires Good design (i.e. easily extendable) Source Control Infrastructure Control Automagical Testing Bug Tracking Dimensional Design Patterns Common vocabulary Solutions to common design problems are available Training and peer groups available Business Intelligence, Planning, Budgeting & Reporting
References Lean software development : an agile toolkit / Mary Poppendieck, Tom Poppendieck. Author: Poppendieck, Mary. Publication: Boston : Addison-Wesley, c2003. Norman Foster's Green Agenda http:// www.ted.com/talks/norman_foster_s_green_agenda.html Alexander, Christopher et al (1977). A Pattern Language: Towns, Buildings, Construction. Oxford University Press, USA, 1216. ISBN 0195019199. Gamma, Erich; Richard Helm, Ralph Johnson, and John Vlissides (1995). Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley. ISBN 0-201-63361-2. http:// www.ralphkimball.com / Ralph Kimball, Margy Ross, Warren Thornthwaite, Joy Mundy, Bob Becker The Data Warehouse Lifecycle Toolkit, 2nd Edition: Practical Techniques for Building Data Warehouse and Business Intelligence Systems John Wiley & Sons, 2008 Business Intelligence, Planning, Budgeting & Reporting
Questions? Contact Details Telephone (07) 373 54052 Mobile 0408 074 082 Email Address [email_address] Facebook [email_address] Business Intelligence, Planning, Budgeting & Reporting

More Related Content

Getting The Runs On The Board One Run At A Time V5

  • 1. Getting the Runs on the Board One Run at a Time Business intelligence initiatives Ralph Kimball¡¯s dimensional modelling design patterns. Business Intelligence, Planning, Budgeting & Reporting
  • 2. Getting the Runs on the Board One Run at a Time Two to three month sprints Extensive data warehouse, one data mart at a time Business Intelligence, Planning, Budgeting & Reporting
  • 3. Getting the Runs on the Board One Run at a Time Focusing on user needs Delivering as rapidly as possible Business Intelligence, Planning, Budgeting & Reporting
  • 4. OR Agile Business Intelligence Lean mean business intelligence team Business Intelligence, Planning, Budgeting & Reporting
  • 5. Supporting Processes Source Control Infrastructure Control Automagical Testing Bug Tracking Business Intelligence, Planning, Budgeting & Reporting
  • 6. Manifesto for Agile Software Development Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan That is, while there is value in the items on the right, we value the items on the left more http:// agilemanifesto.org / Business Intelligence, Planning, Budgeting & Reporting
  • 7. What Agile Isn¡¯t Lack of processes and tools Lack of documentation Lack of contract negotiation Lack of planning Business Intelligence, Planning, Budgeting & Reporting
  • 8. What Else Agile Isn¡¯t A religious dogma The difference between a methodologist and a terrorist is that you can negotiate with a terrorist - Ralph Kimball Business Intelligence, Planning, Budgeting & Reporting
  • 9. Which Agile Method Do We Use? Agile Unified Process (AUP)? Agile Data Method? DSDM? Essential Unified Process (EssUP)? Extreme programming (XP)? Feature Driven Development (FDD)? Getting Real? Open Unified Process (OpenUP)? Scrum? Lean software development? Crystal Clear Business Intelligence, Planning, Budgeting & Reporting
  • 10. Which Agile Method Do We Use? We haven¡¯t chosen a methodology Principle and practices that experience shows as working Business Intelligence, Planning, Budgeting & Reporting
  • 11. Lean Software Development I¡¯m personally a fan of Mary Poppendieck¡¯s work which is based on Toyota¡¯s lean manufacturing Eliminate waste Amplify learning Decide as late as possible Deliver as fast as possible Empower the team Build integrity in See the whole Business Intelligence, Planning, Budgeting & Reporting
  • 12. Minimal Documentation Design Documentation Handover Documentation Change Management Documentation (Technical How To Documents and End User Documentation) Business Intelligence, Planning, Budgeting & Reporting
  • 13. Stage 1 ¨C SET and SEC Model Our First Star Schema ¨C SET and SEC Business Intelligence, Planning, Budgeting & Reporting
  • 14. Stage 2 ¨C Student Model Plus Live Student Feed Business Intelligence, Planning, Budgeting & Reporting
  • 15. Stage 3 ¨C GDS Model Plus Graduate Destination Survey Business Intelligence, Planning, Budgeting & Reporting
  • 16. Stage 4 ¨C At Risk Students, Staff, Admissions Models Plus Students at Risk, Staff, QTAC Feed Business Intelligence, Planning, Budgeting & Reporting
  • 17. Documentation Data Warehouse Framework ¨C Warehouse Architect User Requirements ¨C Business Analysts Star Schema Design ¨C Business Systems Analyst ETL Jobs ¨C Intern/Business Systems Analyst Initiatives Support ¨C Business Systems Analyst Training Documents ¨C BI Trainer ? How To Documents ¨C All Business Intelligence, Planning, Budgeting & Reporting
  • 18. Agile Still Needs Planning Design Documents Good Architecture and Design Source Control Migration Control Managed Infrastructure Testing++ Handover and Training Documents Business Intelligence, Planning, Budgeting & Reporting
  • 19. Manifesto for Agile Software Development Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan http://agilemanifesto.org/ Business Intelligence, Planning, Budgeting & Reporting
  • 20. Agile BI Absolutely Needs Individuals and interactions Talented well trained staff Working software Good Testing Automagical where possible Frequent customer collaboration and interaction Engage the end users Responding to change Tools and data models that allow for adaptability It¡¯s hard to be adaptable when the tools are old Business Intelligence, Planning, Budgeting & Reporting
  • 21. Good Design As an architect you design for the present; with an awareness of the past; for a future which is essentially unknown ¨C Norman Foster Jan 2007 Munich Germany http:// www.ted.com/talks/norman_foster_s_green_agenda.html Note: Photos about Norman Foster from Wikipedia or www.fosterandpartners.com Business Intelligence, Planning, Budgeting & Reporting
  • 22. Good Design - Willis Faber & Dumas Headquarters The country headquarters for insurance company Willis Faber & Dumas was a pioneering example of energy-conscious design that challenged accepted thinking about the office building. Offering a new social dimension with its swimming pool, roof-top garden and restaurant, it was conceived in the spirit of democratising the workplace and engendering a sense of community. http://www.fosterandpartners.com/Projects/0102/Default.aspx Constructed 1970 to 1975 Open plan, three floors,1300 office staff Listed by British Heritage as a Grade 1 building of outstanding architectural or historic interest. Business Intelligence, Planning, Budgeting & Reporting
  • 23. Good Design - 30 St Mary Axe ¨C The Gherkin Built on the site of the Baltic Exchange Building Heritage listed building damaged beyond repair by a PIRA bomb in April 1992 London¡¯s first ecological tall building ... is rooted in a radical approach - technically, architecturally, socially and spatially. Generated by a radial plan, its energy-conscious enclosure resolves walls and roof into a continuous triangulated skin, allowing column-free floor space, light and views. http://www.fosterandpartners.com/Projects/1004/Default.aspx Business Intelligence, Planning, Budgeting & Reporting
  • 24. Good Design - Millau Viaduct - Southern France Business Intelligence, Planning, Budgeting & Reporting
  • 25. Good Design - Millennium Bridge (London) Business Intelligence, Planning, Budgeting & Reporting
  • 26. Good Design - Millennium Bridge (London) Opened June 2000 ?18.2m (?2.2m over budget) Closed 3 days later due to wobbling People walking caused the bridge to sway in step Retrofitted with 89 dampers to control movement Reopened February 2002 Retrofit cost ?5m Romans first bridged Thames in 50AD ? Medieval London Bridge lasted from 13th to 19th Century Harry Potter and the Half Blood Prince Business Intelligence, Planning, Budgeting & Reporting
  • 27. Design Patterns A design pattern is a formal way of documenting successful solutions to problems. The idea was introduced by the Austrian born American architect Christopher Alexander and has been adapted for various other disciplines. Christopher Alexander is Professor Emeritus at the University of California (Berkeley) Alexander, Christopher et al (1977). A Pattern Language: Towns, Buildings, Construction This book contains 253 Architectural Design Patterns e.g. 146. Flexible Office Space 147. Communal Eating 148. Small Work Groups 149. Reception Welcomes You 150. A place to Wait 151. Small Meeting Rooms 152. Half-Private Office ( http:// downlode.org/Etext/Patterns / ) Business Intelligence, Planning, Budgeting & Reporting
  • 28. Design Patterns ¨C Pattern 21 Four-Story Limit Pattern 21 Four-Story Limit May be part of Magic of the City (10), City Country Fingers (3), Lace of Country Streets (5) Conflict There is abundant evidence to show that high buildings make people crazy Resolution In any urban area, no matter how dense, keep the majority of buildings for stories high or less. It is possible that certain buildings should exceed this limit, but they should never be buildings for human habitation May contain Number of Stories (96), Density Rings (29), Building Complex (95), Housing Hill (39), High Places (62) http://downlode.org/Etext/Patterns/ptn21.html Business Intelligence, Planning, Budgeting & Reporting
  • 29. Pattern Language Pattern Language (Wikipedia) Noticing and naming the common problems in a field of interest, Describing the key characteristics of effective solutions for meeting some stated goal, Helping the designer move from problem to problem in a logical way, and Allowing for many different paths through the design process. ( http:// en.wikipedia.org/wiki/Pattern_language ) Business Intelligence, Planning, Budgeting & Reporting
  • 30. Design Patterns Are Not One off Problems Usable only in one business Specific to a location, state or country One off business problems with a very specific set of parameters can be solved elegantly and simply but that is not a design pattern Business Intelligence, Planning, Budgeting & Reporting
  • 31. Software Design Patterns October 1994 (2005 Copyright notice) Design Patterns: Elements of Reusable Object-Oriented Software Software engineering book describing recurring solutions to common problems in software design Written by Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides (The Gang of Four ¨C None were married to Chairman Mao) The book goes through common generic software engineering problems and discusses solutions to the problems in Object Oriented terms Gives a common vocabulary to fairly abstract terms Business Intelligence, Planning, Budgeting & Reporting
  • 32. Example Design Pattern - Singleton Used to restrict instantiation of a class to one object (What is that in English???) For example, my software wants to connect to an Oracle database, but we only connect once; we would create the database connection as a singleton. If it exists at run time we use the one that exists, if not we create one. Prior to GOF¡¯s book we described this in English but now we just say, ¡°Use a singleton on the Oracle connection¡±. Singleton is the simplest pattern (IMHO). Business Intelligence, Planning, Budgeting & Reporting
  • 33. Dimensional Modelling Design Patterns Dimension Design Patterns Role Playing Dimension Slowly Changing Dimensions (Type 1, Type 2, Type 3, Type 6 / Hybrid) Audit Dimension Ragged Hierarchies using Bridge Tables Etc Business Intelligence, Planning, Budgeting & Reporting
  • 34. Fact Table Patterns The Kimball method uses only three fact table design patterns Transactional Fact Table Periodic Snapshot Fact Table Accumulating Snapshot Fact Table Fundamental Grains - Almost all data warehouses sit on one of three bedrock designs ( www.intelligententerprise.com/db_area/archives/1999/993003/warehouse.shtml ) In Auckland 2007 he used stronger words than this, he said something like: ¡°After looking at thousands of designs and being the chief architect on more than 30 enterprise data warehouse projects, I have yet to see a design that couldn¡¯t fit into one of these three fact table grains¡±. Business Intelligence, Planning, Budgeting & Reporting
  • 35. Summary Agile works if Staff are talented, well trained, well funded and appreciated Software is well tested, delivered rapidly Customers are engaged, interaction, regarded as capable Software can rapidly adapt to change Agile Requires Good design (i.e. easily extendable) Source Control Infrastructure Control Automagical Testing Bug Tracking Dimensional Design Patterns Common vocabulary Solutions to common design problems are available Training and peer groups available Business Intelligence, Planning, Budgeting & Reporting
  • 36. References Lean software development : an agile toolkit / Mary Poppendieck, Tom Poppendieck. Author: Poppendieck, Mary. Publication: Boston : Addison-Wesley, c2003. Norman Foster's Green Agenda http:// www.ted.com/talks/norman_foster_s_green_agenda.html Alexander, Christopher et al (1977). A Pattern Language: Towns, Buildings, Construction. Oxford University Press, USA, 1216. ISBN 0195019199. Gamma, Erich; Richard Helm, Ralph Johnson, and John Vlissides (1995). Design Patterns: Elements of Reusable Object-Oriented Software. Addison-Wesley. ISBN 0-201-63361-2. http:// www.ralphkimball.com / Ralph Kimball, Margy Ross, Warren Thornthwaite, Joy Mundy, Bob Becker The Data Warehouse Lifecycle Toolkit, 2nd Edition: Practical Techniques for Building Data Warehouse and Business Intelligence Systems John Wiley & Sons, 2008 Business Intelligence, Planning, Budgeting & Reporting
  • 37. Questions? Contact Details Telephone (07) 373 54052 Mobile 0408 074 082 Email Address [email_address] Facebook [email_address] Business Intelligence, Planning, Budgeting & Reporting