![eMed :: Faculty of Medicine UNSW [email_address] luc_betbeder on twitter all the photos are mine 息 flickr.com/betbeder thanks](https://image.slidesharecdn.com/collectiveintelligencetalk-v3-100304050427-phpapp02/85/IBM-Collective-Intelligence-Talk-UNSW-CASE-STUDY-V3-25-320.jpg)
More Related Content
Similar to IBM Collective Intelligence Talk - UNSW CASE STUDY V3 (16)
Recently uploaded (20)
IBM Collective Intelligence Talk - UNSW CASE STUDY V3
- 1. 油
- 2. eMed :: Faculty of Medicine UNSW luc betbeder faculty of medicine, UNSW. a case study
- 3. eMed :: Faculty of Medicine UNSW a leading university
- 4. eMed :: Faculty of Medicine UNSW a knowledge workplace
- 5. eMed :: Faculty of Medicine UNSW undergraduate medicine
- 6. eMed :: Faculty of Medicine UNSW my audience
- 7. eMed :: Faculty of Medicine UNSW my team
- 8. eMed :: Faculty of Medicine UNSW new medicine program new curriculum new approach to assessment our journey
- 9. eMed :: Faculty of Medicine UNSW a curriculum map graduate capabilities the portfolio new concepts
- 10. eMed :: Faculty of Medicine UNSW a portal with lots of links requirements start to grow a new system?
- 11. eMed :: Faculty of Medicine UNSW lots of documents web web web granular security with roles requirements
- 12. eMed :: Faculty of Medicine UNSW nothing on the shelves hacking can be lose / lose opportunity: make it as you need it buy or build
- 13. eMed :: Faculty of Medicine UNSW custom + iterative partners + in-house licensed + open to boldly go
- 14. eMed :: Faculty of Medicine UNSW the core databases
- 15. eMed :: Faculty of Medicine UNSW items in a context student perspective academic perspective collective intelligence
- 16. eMed :: Faculty of Medicine UNSW student intelligence timetable + map navigating the degree
- 17. eMed :: Faculty of Medicine UNSW demo from timetable to map
- 18. eMed :: Faculty of Medicine UNSW from timetable to map
- 19. eMed :: Faculty of Medicine UNSW academic intelligence asking the map know thyself
- 20. eMed :: Faculty of Medicine UNSW demo asking the map
- 21. eMed :: Faculty of Medicine UNSW collective intelligence map + portfolio + results building a portfolio
- 22. eMed :: Faculty of Medicine UNSW demo submit/mark/review
- 23. eMed :: Faculty of Medicine UNSW submit/mark/review
- 24. eMed :: Faculty of Medicine UNSW intelligence systems not IT systems used every day measuring success
- 25. eMed :: Faculty of Medicine UNSW [email_address] luc_betbeder on twitter all the photos are mine 息 flickr.com/betbeder thanks
Editor's Notes
- #3: a case study (intro) 油 morning everyone. My name is luc and I am the IT Manager for the Faculty of Medicine at the University of New South Wales. 油 the case study I want to share with you today is an application that we call eMed. 油 but before I jump into the app and possible demo meltdown I just want to give you a little bit of context and set the scene
- #4: a leading university 油 UNSW is one of Australia's leading research and teaching universities and has about 40,000 students and 1,500 staff 油 That makes us bigger than many towns in Australia 油 It's a great place to study and it's a great place to work. Thats my sales pitch done.. 油 But one point I want to make is that it really is a workplace with a culture of collaboration and innovation
- #5: a knowledge workplace.油 油 It's a knowledge workplace where people are passionate about learning and teaching on a daily basis.油 油 and so, themes like todays "collective intelligence" are really important to our core business.油 油 (benefit of today? say something nice about previous talks...) 油 One thing that I like to think we are providing is a continuous output of change agents into the workplace 油 And so the systems that we use are really important because they are the tools that the students are going to become familiar with and will expect to use in the workplace 油 Email and the web ...
- #6: undergraduate medicine 油 the Faculty of Medicine at UNSW is one of the few places in Australia that offers a six year undergraduate medical degree. 油 We currently have about 1500 students in years 1-6 油 the very top high school students from Australia and overseas come to UNSW to study medicine and its the job of the Faculty to turn them from high scoring high school students into someone you will feel confident hovering over you in a hospital within six years. 油 We are also an incredibly research intensive Faculty and so many of our teachers are not only delivering courses but carrying out major research projects.
- #7: my audience 油 And so the audience for my systems are on the one hand these bright young university students who are actually very mature users of online and collaboration tools.. they will live inside my systems for at least six years.. 油 and on the other hand I have these super busy academics with brains the size of planets who are knowledge experts in their particular disciplines油 but who also need to be told where to go to teach on any given day油 油 And so I have to get both of these audiences together or I end up with an empty lecture room油 油 As you can imagine, with this kind of an audience, I get a lot of feedback on how our systems are performing. 油 They are incredibly critical but also, I must say, incredibly supportive.
- #8: my team 油 so thats one of the challenges my team faces as we support many of the internal IT systems of the Faculty. 油 we are a small specialist IT unit internal to the Faculty and we have a mandate to support specialist research and teaching activities within the faculty. 油 as a result we get to be involved in some wonderful projects.. over the last few years we have developed 油 a wireless barcode tracking system for the body parts in our Morgue 油 and a Virtual Microscope system that will support over 80 students doing a Google earth syle zoom into the same tile at the same time 油 today tho I want to talk to you about our journey with our eMed system
- #9: our journey 油 our journey with eMed properly starts back in 2002-3 when the Faculty proposed a very significant overhaul to the undergraduate degree 油 the new medicine program would include massive changes to both the content of the curriculum and to how it would be assessed. 油 This was in response to some major shifts 油 There was a changing community expectation of doctors.. that they should be able to communicate and work in teams.. we wanted to address that in the curriculum 油 There were also major shifts in patterns of health and disease with increased focus on chronic illnesses.. and a huge expansion of new knowledge within the biomedical sciences.. these kinds of developments needed to be included in 油 And lastly there was a massive shift in information technology allowing much more expanded access to expanding sources of information. 油 So from the very start there was an expectation that new program would use IT resources and systems more extensively.. 油 both as internal tools for the students but also as part of their professional development.
- #10: new concepts 油 the new medicine program also introduced some new key new concepts that would shape our decisions. 油 First, there is this concept of a curriculum map that would contain each and every learning activity in the degree. 油 Everything we teach would be in the map 油 Secondly, we have this concept of graduate capabilities. 8 Key attributes we want all of our graduates to possess... 油 .. things like "effective communication" or " working as a member of a team" or "patient assessment and management" and "ethics in medicine". 油 And so every item inside the map, everthing we teach and assess against is targeted at these 8 capabilities. 油 lastly, there is this concept of the portfolio.油 油 The portfolio contains everything that a student submits over the six years of their degree. 油 And everything they submit is marked against the graduate capabilities. And so there is this growing store of data about how they are tracking against what we are teaching.
- #11: a new system 油 So we started thinking about what kind of IT system we would need to support the program and these new concepts. 油 we knew we wanted it to be a place where all the relevant undergraduate activities could sit and so we had this picture of a portal that had lots of links between the key components 油 this was mid 2002 and the concept of a web portal was only a fairly recent one and enterprise portal technologies were油only just coming onto the market 油 and so with the deadline of our students starting in 2004 we started thinking seriously about what our requirements for this system would be.
- #12: requirements 油 we knew we would need to handle lots of different types of documents.. from timetable data to marks, to learning activities and assignment submissions.. 油 every item for 6 years of coursework and 6 years of assignments for 1500 would need to be managed.. 油 preferably we wanted as system that would use our concepts and our terms so that the huge amount of work that was going on in the restructure of the teaching program would be mirrored in the IT system 油 we also knew that it all needed to be web based. Our audience would be using the system from home and campus and from behind hospital firewalls so web technologies were very important to us from the start 油 lastly we knew that roles and a very granular role based security model would be very important to us. We would have lot of items where we wanted to show some things to teachers and some things to students 油 Obviously we wanted to keep our marking secure. So security was very important.
- #13: buy or build 油 today these are pretty normal requirements but back in 2002 we could not find anything off the shelf to buy that really looked like it would fit油 油 bolting on to or hacking an existing app was also considered but again we would be compromising a lot on our key concepts 油 I also tend to think that hacking existing tools can be a dangerous compromise. You dont get exactly what you want and you are still paying for some customising .. for me thats a lose lose proposition. 油 we knew that building a new system would cost us more on the development side but we also knew that we had an opportunity. 油 We did not need to get absolutely everything done for day one. 油 On the teaching side, they would be actively creating new content and processes each year and we could, to a certain extent.. mirror that. 油 As the students moved through the degree we would be laying down the railway tracks in front of them and so we needed an approach and tools that would flexible enough to cope with all of these goals 油 with all of that in mind we decided to boldly go forth...
- #14: boldly to 油 油 we would set out on a 7 year journey 油 to release a new application, tailored to our program that would iterate the development through at least 6-10 major releases 油 we would use a partnership with a good code shop to get the big fist version one out the door... thanks go to NotesApps who did a great job 油 and then our approach would be to build up internal skills for both for support and to provide an aggressive schedule of feature releases. 油 On the technology side we decided to leverage the some of the real benefits we found in lotus notes and domino for rapid application development in terms of ready made forms, views, security and the like (which saved a huge amount of time ) along side using a range of more open web frameworks like Java 油 with the hindsight of seven years I am still very happy with the choices we made.. 油 Oh and seeing William Shatner at lotusphere this year was lots of fun.. thanks IBM.
- #15: the core databases 油 right from the start we started thinking of eMed as a collection of individual web-facing databases. 油 This helped us break up the development work into parallel projects. 油 For example, we could work on the Map with one set of users and requirements and not halt progress on a simpler system like results. 油 This is still how we work and we are still improving this set of core databases as well as occasionally adding one when we absolutely have to. 油 For example, we just finished a major update to the Timetable but Results has remained almost unchanged for 3 years.
- #16: Collective intelligence 油 I want to show you how eMed is used by our students and academics 油 But, as we go through these examples, I want to point out how having individual items correctly linked into contexts can powerfully build into how we see collective intelligence approaches working in our organisation.
- #17: navigating the degree 油 The first example is one our students face every day and that is navigating their way through their degrees 油 In foundations, which is the first course our students do, they will be involved in 95 discrete learning activities. In total, our students will pass through 1458 mapped activites in their 6 years. 油 So the map provides the overall contex but the very first interaction students normally have with a course is through their timetables. 油 So what we want to provide to the students is a constant link between timetabled activities and how these activities are placed within the context of their course and degree. 油 Lets try to see that in action.
- #18: DEMO or use this SLIDE 油 So in this slide I'm showing 油 a student in timetable will click on an entry in their timetable for more information 油 They can then link to the map for even more details and contextual information. 油 They can find out how what that activity is targeting in terms of Graduate Capabilies and see if there are any additional resources. 油 They can then see how that resource fits into the overall course and how that course fits within the degree. 油 Item in their right context provide our students with additional intelligence on their activities.
- #19: DEMO or use this SLIDE 油 So in this slide I'm showing 油 a student in timetable will click on an entry in their timetable for more information 油 They can then link to the map for even more details and contextual information. 油 They can find out how what that activity is targeting in terms of Graduate Capabilies and see if there are any additional resources. 油 They can then see how that resource fits into the overall course and how that course fits within the degree. 油 Item in their right context provide our students with additional intelligence on their activities.
- #20: know thyself 油 The second example I want to show you is on the academic side... 油 Here I want to show you how we use the map as our knowledge base of our courses and assessments and activities. 油 This is where we store our secret sauce.. everything we know about ourselves is in the Map. 油 We have a rule that nothing goes into the timetable unless it is mapped first. 油 And we review the content of each item in the map whenever we teach it. Because the content is not just internal but external also. 油 So the map becomes the place we can think about the big picture. We can ask it questions like.. are we teaching enough about cancer and what kinds of assessments do we have on cancer. 油 Lets do that now...
- #21: Asking the map 油 DEMO or use this SLIDE 油 油 So I go into map and map search 油 And I type in Cancer 油 And see that there are 165 different kinds of items in the map about Cancer 油 油 Im interested in lectures only... and there are 55 lectures 油 And i want to know how we assess all that teaching.. and I see that there are 8 assignment choices available on this keyword search.. 油 Its a database.. of course it can search.. its not even that pretty a search. The point is not in the search or in the IT. The point is that the content is there and is being used. 油 It is an intelligence system before it is an IT system.
- #22: building a portfolio 油 the last example I want to share with you is around building the students portfolio 油 as our students submit items for marking they become part of their portfolios. 油 Every single assessment item over 6 years is stored in the portfolio system. 油 and each of these items is marked, it is marked against the graduate attributes and feedback is provided. 油 and so we build intelligence on how that student is performing over the course of their degree油 油 And this is a collective intelligence based on both student content and the feedback provided by the academics. 油 Let me show you what that looks like.
- #23: submit/mark/review 油 DEMO or use this SLIDE 油 油 Here we have this process of a student submitting an assignment.. which is done online油 油 and a marker marking that assignment .. again this is done online.. not showing you that part 油 and then the student looking at their marks .. 油 and note that this is within the context of all their other marks. 油 So as a student builds their portfolio .. they will need to show competence in all 8 graduate capabilities .. 油 and so there is a feedback loop as students will pick their next assessments based on what they still need to cover and on the feedback from previous assignments. 油 We use this system to guide the students and at years 2, 4 and 6 we carry out a complete review of the current status of each student's entire portfolio to get a clear picture of how they are performing 油 so there is this constant evaluation over 6 years based on the information provided in the portfolio. 油 The portfolio has become such a key part of the degree that when a student graduates we provide them with a copy showing every mark and every word of feedback on each graduate attribute.
- #24: submit/mark/review 油 DEMO or use this SLIDE 油 油 Here we have this process of a student submitting an assignment.. which is done online油 油 and a marker marking that assignment .. again this is done online.. not showing you that part 油 and then the student looking at their marks .. 油 and note that this is within the context of all their other marks. 油 So as a student builds their portfolio .. they will need to show competence in all 8 graduate capabilities .. 油 and so there is a feedback loop as students will pick their next assessments based on what they still need to cover and on the feedback from previous assignments. 油 We use this system to guide the students and at years 2, 4 and 6 we carry out a complete review of the current status of each student's entire portfolio to get a clear picture of how they are performing 油 so there is this constant evaluation over 6 years based on the information provided in the portfolio. 油 The portfolio has become such a key part of the degree that when a student graduates we provide them with a copy showing every mark and every word of feedback on each graduate attribute.
- #25: measuring success 油 I just want to end up with a couple of points on how I measure the success of a system like this one. 油 Yes we got it out on time and yes it is incredibly stable 油 But the real metric for me is, can it answer the questions the questions my audience asks on a daily basis... 油 Can it tell me how many students in year 1 right now.. 273 油 Can it tell me how many leaning activities in Ageing and Endings include the topic of pain? 22 油 Can I find out easily how this one student is perfoming in terms of their effective communication graduate attribute.. yes 油 If it is an effective intelligence system and our users are using it on a daily basis then Im happy
- #26: thanks for your time.