Talk:Decision analysis and risk management: Difference between revisions

From Opasnet
Jump to navigation Jump to search
(→‎Lectures related to uncertainty: an attempt to distribute and clarify arrangement responsibilties)
 
(8 intermediate revisions by 2 users not shown)
Line 1: Line 1:
== Draft synopsis ==
==Comments about DARM course (18.3.2011):==


For a draft synopsis of the course, see a [http://en.opasnet.org/en-opwiki/index.php?title=Talk:Decision_analysis_and_risk_management&oldid=18242 previous version].
* Are these methods used in the actual decision situation/in real world?
* Some of issues too complicated (especially Bayes lectures);
* Links of this course to other issues taught in environmental risk assessment;
* More concrete examples would be useful;


== Case study exercise (draft) ==
== Some things to take into account in planning/arranging/conducting the course ==


Imagine that the Ministry of Social and Health affairs of Finland has given you an assignment to assess the case of AH1N1 (aka swine flu) vaccinations and the sudden increase in narcolepsy among young people in Finland. Consider yourself as an expert in protecting and promoting public health. The minister expects your assessment to shed light on e.g following aspects of the issue:
# Harkkatyön ohjeistukset: [[:Category:DARM exercise]]. Ainakin RM harkan (osa 2) ohjeistuksessa lienee täsmentämistä. Muutenkin saa parannella niin paljon kuin osaa.
# Kunhan tiedostojen jakelun systeemi saadaan taas tavalla tai toisella pelaamaan, N:\YMAL\Presentations\2011\0228_DARM\materials sisältää jakeluun sopivaa tavaraa. Ainakin NRC:n kirjojen executive summaryt minulla oli alunperin tarkoituksena panna heande-sivulle (m-filesiin).
#* Understanding risk –kirjasta en saanut executive summarya pdf:na ladattua nap.edu:sta. Voisi vaikka skannata, jos ei muuten onnistu.
# Luento-/harkka-aikataulu on vielä aika epämääräinen ja sekava, etenkin loppupäästään (RM-osio). Jos kokonaiskuva alkaa kirkastumaan (esim. tämänpäiväisten kokemusten pohjalta), saa täsmentää kurssisivun kalenteriin vaikkapa sen kummemmin minulta kyselemättä.
# Sikaflunssatarinaakin voisi vähän miettiä. Esim.:
#* Taustamateriaalilinkkejä [[Decision analysis and risk management#General information sources on AH1N1 influenza (Swine_flu)]] voisi tarkistella. Kirsti on niitä keräillyt ja varmasti ovat tolkullisia, mutta olisihan se hyvä jonkun muunkin tietää mitä kaikkea sieltä löytyy. Olisiko Teemu sopiva henkilö tähän?
#* Aikataulun ja linkkilistan aihe-/vaihejaottelu eivät ole aivan yhdenmukaiset. Sikaflunssastoorituokioiden rajauksia ja niiden sijoittelua aikatauluun voisi varmaankin parantaa/tarkentaa nykyisestä. Jouni & Marko, jos ehditte?
#* Edellisen yhteydessä voisi myös miettiä, jos sikaflunssalinkkejä nostelisi sivun lopusta aikataulun yhteyteen sopiviin kohtiin.
# Kunhan alkaa selviämään kuinka monta ryhmää ja yksilöä tulee harkat tekemään, voidaan miettiä tarvitaanko kahta päivää loppuseminaariin. Nyt seminaarivaraus on aikataulussa sekä 11.4. että 12.4.
# En vielä kovin hyvin tiedä miten RM osio tulee kurssin loppupuolella järjestymään, mutta olisiko ideaa varata 1-2 päivää lopusta koko kurssin kokonaiskuvan kertaamiseen ja esille nousevien/nousseiden erityiskysymysten lisätarkasteluun? Esim. DA summary & specific topics 7.4. ja RM summary & specific topics 8.4. Tai jotain sinne päin.
#* {{comment|# |Ehkä yksikin sessio riittäisi tähän. 8.4. tai 11.4.?|--[[User:Mikko Pohjola|Mikko Pohjola]] 13:16, 4 March 2011 (EET)}}


* Did something go wrong? If so, what, when, and why?
--[[User:Mikko Pohjola|Mikko Pohjola]] 13:08, 4 March 2011 (EET)
* How could have things been done better? What, when, and why?
* With the knowledge we have now in this situation, what could/should be done?
* What can be learned about this case regarding possible similar urgent public health risk management situations in the future?
* Are there any more general risk management or other lessons to learn from this case?


The case study exercise is done in two parts; the first pertaining more to decision analysis (DA), the second more to risk management (RM). The first part is group work, while the second is individual work (can also be agreed otherwise if needed).
== Draft synopsis ==


''For non-ToxEn students participating in the course it could be considered that the lectures and exercises, the DA study plan, and the Discussion and conclusions regarding RM options are worth 2 study credits each (or should it be 3, 2, and 1 respectively?). For ToxEn students all the parts of the course are obligatory.
For a draft synopsis of the course, see a [http://en.opasnet.org/en-opwiki/index.php?title=Talk:Decision_analysis_and_risk_management&oldid=18242 previous version].
 
=== Part one: Decision analysis study plan ===
 
''group work (~3-5 people/group)
 
Based on the lecture and exercise contents, the materials and discussions regarding the swine flu/narcolepsy case on the course, as well as all your own expertise and opinions, work out a plan how a DA study could/should be made. The plan should address at least the following:
 
# Background description
#* purpose of the study
#* main question(s) related to the case
#* relevant actors related to the case
#* roles of different actors related to the case
#* timeline of major events
#* expected outputs and impacts of the study
# Decision analysis study plan
#* decisions considered
#* outcomes of interest that the decisions (are intended to) have influence on
#* the factors ([[variable]]s) that link decisions to their (intended) outcomes
#* different sources of information
#* all the above at certain different timepoints along the progress of the case
#** which timepoints?
#** what knowledge emerged between different timepoints?
#** how does the model change from a timepoint to another?
#* analyses over the model and its parts
 
The DA study plans are intended to be worked on gradually alongside the lectures and exercises, and progress will be presented to and discussed with other students as well as lecturers in classroom a few times during the course. In the end of exercice part 1, the group will present the final plan to other students as well as lecturers in classroom. If possible, the final DA study plans will be, at least partly, executed by means of the demonstrator model that will be developed for demonstration purposes on the course. At least the possible results that could be achievable according to the plan will be discussed at the presentation of the plan. Results (actual or anticipated) are added to the plan.
 
''(part 1 can be considered as corresponding roughly to the introduction and methods sections of a scientific article, or to the scope and definition attributes of an [[assessment]] object in [[open assessment]])
 
=== Part two: Discussion and conclusions regarding risk management options and actions ===
 
''Planned as individual work, but can also be combined as a part of the group work if so desired
 
Following the work done in exercise part 1, and taking account of the discussions regarding the plans by different groups in, consider what does (may) a decision analysis study tell, what can the results be used for, and how? Think that you are explaining the DA study results to the social and health minister.
 
# What does the analysis tell?
#* were the right decisions made?
#* what decisions should have been made?
#* could things have gone in a different way?
#* what implications other courses of events would have had? What would it have required?
#* is possible that such could have happened in reality?
# What can be concluded?
#* if anything, what went wrong? why?
#* if a somewhat similar situation occurred, what should be done?
#* if possible, what should be done in preparation?
 
''(part 2 can be considered as corresponding roughly to the discussion and conclusions sections of a scientific article, and also to the conclusions sub-attribute of an [[assessment]] in [[open assessment]]).
 
=== Basis for evaluating the case study exercises ===


The main point is not to write long and detailed texts of any specific topic within this course. Instead the idea is to try to make use of what has been taught on the course by combining them in relation to a practical question. Most important issues in evaluating the exercises are:
== Case study exercise ==


* general clarity of thought
Case study exercise description and instructions can be found at: [[:Category:DARM exercise]].
* comprehension and description of the big picture
* meaningful connections between the aspects of the case
* application of the knowledge and methods provided in lectures, exercises and discussions along the course
* ability to argue for or against different statements or actions
 
=== Practical case study guidance ===
 
The DA study plans will be written in [[:heande:Main page|Heande]], a password protected project-wiki, similar to Opasnet (this site). The writing can take place directly within Heande, or the text can be copied to Heande from external documents. However, the evaluation of the group's work will be done based only on the material on the group's Heande-page. The Heande-pages will be opened for each group, creation of user accounts, and the basics of wiki-editing will be taught in practical classroom exercises in the beginning of the course. In case of problems with Heande or just need of advice, feel free to contact the lecturers.
 
Also the individual discussions and conclusions regarding risk management options actions will be written and evaluated similarly in Heande.
 
The course participants are encouraged to actively discuss own and others work. In addition to oral classroom discussions the discussion can take place in Heande. Also the principles, tools, and practices of discussing in a wiki-system will be presented and instructed in practical classroom exercises during the course. Activity in discussing the exercise topics in Heande will be considered as a benefit in evaluating the group and individual works. Discussions may address the group's or individual's own works as well as other groups and individual works.
 
=== Suunnittelussa huomioonotettavaa ===
 
* aikataulurajoitteet
* tila-, väline- yms. vaatmukset
* tilavaraukset
* videointi, koneet, verkko?
* DA-mallin kehikko
* infomateriaali omatoimiseen työhön
** case
** käsitteistö ja teoria
* perusasialuennot ? työnjako, suunnitelmat, tausta- ja esitysmateriaalit
* harjoitustehtävät ? peruskäsitteistö yms. / DA-case / kyselyt kurssin kuluessa


== Lectures related to uncertainty ==
== Lectures related to uncertainty ==
Line 140: Line 75:
* collection and preparation of study and background materials for both theory and case to be done by whom?
* collection and preparation of study and background materials for both theory and case to be done by whom?
* '''classroom reservations to be done by whom? (us or UEF?)
* '''classroom reservations to be done by whom? (us or UEF?)
** '''needs for specific equipment or space needs must be clearly indicated in teh course schedule
** '''needs for specific equipment or space needs must be clearly indicated in the course schedule
* video recording / streaming of lectures? (which lectures are suitable?)
* video recording / streaming of lectures? (which lectures are suitable?)
* is there a need for an increased continuous Opasnet up-keeping or help desk -service during the course?
* is there a need for an increased continuous Opasnet up-keeping or help desk -service during the course?
* requirements/needs for keeping up participation lists? how is this to be done?
* requirements/needs for keeping up participation lists? how is this to be done?
== theory vs. story vs. case study exercise ==
An idea for creating and keeping up a tight linkage between the swine-flu story and the theory lectures as well as case study exercises: Let us make the detailed theory lecture/exercise plans, so that in every possible theory topic there is a connection (at least a weak one) to the swine-flu story. It can be done e.g. by:
* taking lecture/exercise examples from the case to demonstrate the theory
* after presenting the theory, making students work out what the particular part of theory would mean in the case context
* making students explore and discuss a certain aspect(s) of the case as an introduction to the particular part of theory, presented afterwards.
The theory and the exercise are now implemented in the schedule to progress in unison. If a good linkage between the case story and theory lectures/exercises is achieved, it also guarantees contentual support for progressing the case study exercises. It is not necessary to be strictly bound to the chronological order of events in the story (the story parts will probably naturally fall into a nearly chronological order if in line with the theory and cases study exercise plans).

Latest revision as of 10:12, 6 April 2011

Comments about DARM course (18.3.2011):

  • Are these methods used in the actual decision situation/in real world?
  • Some of issues too complicated (especially Bayes lectures);
  • Links of this course to other issues taught in environmental risk assessment;
  • More concrete examples would be useful;

Some things to take into account in planning/arranging/conducting the course

  1. Harkkatyön ohjeistukset: Category:DARM exercise. Ainakin RM harkan (osa 2) ohjeistuksessa lienee täsmentämistä. Muutenkin saa parannella niin paljon kuin osaa.
  2. Kunhan tiedostojen jakelun systeemi saadaan taas tavalla tai toisella pelaamaan, N:\YMAL\Presentations\2011\0228_DARM\materials sisältää jakeluun sopivaa tavaraa. Ainakin NRC:n kirjojen executive summaryt minulla oli alunperin tarkoituksena panna heande-sivulle (m-filesiin).
    • Understanding risk –kirjasta en saanut executive summarya pdf:na ladattua nap.edu:sta. Voisi vaikka skannata, jos ei muuten onnistu.
  3. Luento-/harkka-aikataulu on vielä aika epämääräinen ja sekava, etenkin loppupäästään (RM-osio). Jos kokonaiskuva alkaa kirkastumaan (esim. tämänpäiväisten kokemusten pohjalta), saa täsmentää kurssisivun kalenteriin vaikkapa sen kummemmin minulta kyselemättä.
  4. Sikaflunssatarinaakin voisi vähän miettiä. Esim.:
    • Taustamateriaalilinkkejä Decision analysis and risk management#General information sources on AH1N1 influenza (Swine_flu) voisi tarkistella. Kirsti on niitä keräillyt ja varmasti ovat tolkullisia, mutta olisihan se hyvä jonkun muunkin tietää mitä kaikkea sieltä löytyy. Olisiko Teemu sopiva henkilö tähän?
    • Aikataulun ja linkkilistan aihe-/vaihejaottelu eivät ole aivan yhdenmukaiset. Sikaflunssastoorituokioiden rajauksia ja niiden sijoittelua aikatauluun voisi varmaankin parantaa/tarkentaa nykyisestä. Jouni & Marko, jos ehditte?
    • Edellisen yhteydessä voisi myös miettiä, jos sikaflunssalinkkejä nostelisi sivun lopusta aikataulun yhteyteen sopiviin kohtiin.
  5. Kunhan alkaa selviämään kuinka monta ryhmää ja yksilöä tulee harkat tekemään, voidaan miettiä tarvitaanko kahta päivää loppuseminaariin. Nyt seminaarivaraus on aikataulussa sekä 11.4. että 12.4.
  6. En vielä kovin hyvin tiedä miten RM osio tulee kurssin loppupuolella järjestymään, mutta olisiko ideaa varata 1-2 päivää lopusta koko kurssin kokonaiskuvan kertaamiseen ja esille nousevien/nousseiden erityiskysymysten lisätarkasteluun? Esim. DA summary & specific topics 7.4. ja RM summary & specific topics 8.4. Tai jotain sinne päin.
    • ----#: . Ehkä yksikin sessio riittäisi tähän. 8.4. tai 11.4.? --Mikko Pohjola 13:16, 4 March 2011 (EET) (type: truth; paradigms: science: comment)

--Mikko Pohjola 13:08, 4 March 2011 (EET)

Draft synopsis

For a draft synopsis of the course, see a previous version.

Case study exercise

Case study exercise description and instructions can be found at: Category:DARM exercise.

Lectures related to uncertainty

I was briefly discussing with Jouni from the uncertainty, Monte-Carlo and Value of Information path of the lectures.

I think this “path” has three main pieces:

  • What is uncertainty, how to identify uncertainty etc. This could include all kind of issues like expert elicitation, data analysis, literature search, expert estimates, modelers estimate etc.
  • How to implement uncertainty to the calculations? Thus, how to actually combine uncertainties from different sources and/or how to create uncertainty functions. This could be divided to two different parts, Bayes and Monte-Carlo, since these two are the two most common ways of implementing uncertainty to the assessment.
  • Third phase consist sensitivity analysis and value of information. Thus, these are methods that are applied after the model is done and after the uncertainties have been implemented.

I think the basic idea of this is already included in the course structure, but we could try to make it clearer in the lecturing structure?


Responsibilities among organizers

The course basically consists of three temporal/contentual sections:

  1. Introduction 28.2.-4.3.
  2. DA 8.3.- 29.3.
  3. RM 30.3.-12.4.

The two main teaching/studying methods are employed in parallel more or less throughout the course:

  • Theory lectures and exercises (classroom)
  • Case discussions and group/independent work (classroom and outside)

In order to allow us to concentrate on certain things below is suggestion for distribution of (primary) responsibility on certain issues along the course

Intro

Jouni and Mikko to agree on who leads which parts, and prepare corresponding teaching materials. Basically exercise introduction and instruction prepared by Mikko, general course arrangement basically a responsibility of Jouni. Marko to participate and help as available/needed.

DA

Marko and Jouni to agree on who leads which parts, and prepare corresponding teaching materials. Also developing the model for demonstrations a responsibility of Jouni and Marko (Can the study plans also be executed with the demonstrator model (updated according to needs of the plans)?). Jouni to create and keep up the linkage between case study/exercise and theory. Mikko will be back to participate in the exercise part 1 presentations and discussions. Also Mikko is available if assessment performance is wanted to be taken up in DM under uncertainty.

RM

Mikko to plan the story-/timelines for both theory and case for the last section. More detailed distribution of lead responsibilities to be agreed upon by Jouni and Mikko. Follow-up and assistance for post-seminar improvement work on exercises needs to arranged. Also exercise output checks and student evaluations need to be agreed upon.

Other

In addition there are certain general issues that also need to be agreed upon and taken care of, e.g:

  • collection and preparation of study and background materials for both theory and case to be done by whom?
  • classroom reservations to be done by whom? (us or UEF?)
    • needs for specific equipment or space needs must be clearly indicated in the course schedule
  • video recording / streaming of lectures? (which lectures are suitable?)
  • is there a need for an increased continuous Opasnet up-keeping or help desk -service during the course?
  • requirements/needs for keeping up participation lists? how is this to be done?

theory vs. story vs. case study exercise

An idea for creating and keeping up a tight linkage between the swine-flu story and the theory lectures as well as case study exercises: Let us make the detailed theory lecture/exercise plans, so that in every possible theory topic there is a connection (at least a weak one) to the swine-flu story. It can be done e.g. by:

  • taking lecture/exercise examples from the case to demonstrate the theory
  • after presenting the theory, making students work out what the particular part of theory would mean in the case context
  • making students explore and discuss a certain aspect(s) of the case as an introduction to the particular part of theory, presented afterwards.

The theory and the exercise are now implemented in the schedule to progress in unison. If a good linkage between the case story and theory lectures/exercises is achieved, it also guarantees contentual support for progressing the case study exercises. It is not necessary to be strictly bound to the chronological order of events in the story (the story parts will probably naturally fall into a nearly chronological order if in line with the theory and cases study exercise plans).

Retrieved from "https://en.opasnet.org/index.php?title=Talk:Decision_analysis_and_risk_management&oldid=19987"