Assessment

This page is a knowledge crystal of subtype method. The page identifier is Op_en2017
Moderator:Nobody (see all) Click here to sign up.
Upload data

<section begin=glossary />

Assessment is a process for describing a particular piece of reality in aim to fulfill a certain information need in a decision-making situation. The word assessment can also mean the end product of this process, i.e. an assessment report of some kind. Often it is clear from the context whether the term assessment refers to the making of the report or the report itself. Methodologically, these are two different objects, called the assessment process and the assessment product, respectively.

<section end=glossary /> R↻

Question

What is a structure for an assessment so that it

• contains a description of a certain piece of reality R↻ ,
• the description is produced according to the use purposes of the product,
• describes all the relevant phenomena that connect the decision under consideration and outcomes of special interest (called indicators),
• combines value judgements with the descriptions of physical phenomena
• can be applied in any domain,
• inherits the main structure from universal objects,
• complies with the PSSP ontology,
• complies with decision analysis,
• complies with Bayesian networks?

Answer

All assessments aim to have a common structure so as to enable effective, partially automatic tools for the analysis of information. An assessment has a set of attributes, which have their own subattributes.

Attributes of an assessment

Attribute	Sub-attribute	Description
Name		Identifier for the assessment.
Scope		Defines the purpose, boundaries and contents of the assessment. Why is the assessment done?
	Question	What are the research questions whose answers are needed to support the decision? What is the purpose of the assessment?
	Intended use and users	Who is the assessment made for? Whose information needs does the assessment serve? How do we expect them to use the information?
	Participants	Who is needed to participate to make the assessment a well-balanced and well-informed work? Also, if specific reasons exists: who is not allowed to participate? The minimum group of people for a successful assessment is always described. If some groups must be excluded, this must be explicitly motivated.
	Boundaries	Where are the boundaries of observation drawn? In other words, which factors are noted and which are left outside the observation. Spatial, temporal and population subgroup boundaries are typical in assessments.
	Decisions and scenarios	Which decisions and their options are considered by the decision maker? Also, if scenarios (defined here as deliberate deviations from the truth) are used: which scenarios are used and why? In scenarios, some possibilities are excluded from the observation in order to clarify the situation (e.g. what-if scenarios). For example, one could ask which climate change adaptation acts should be executed in a situation where the average temperature rises over two degrees centigrade. In this case, all the scenarios where the temperature does not rise over two degrees are excluded from the assessment.
	Timing	Description of the work process. When does the assessment take place? When will it finish and when will the decision be made?
Answer		Gives the best possible answers to the research questions of the assessment based on the information collected. Answer is divided into two parts:
	Results	Answers to all of the research questions asked in the scope and the analyses described in the rationale. If possible, a numerical expression or distribution using clear units.
	Conclusions	What are the conclusions about the question based on the results obtained regarding the purpose of the assessment?
Rationale		Anything that is needed to make a critical reader understand the conclusions and to convince that the conclusions are valid. Includes all the information that is required for a meaningful answer.
	Stakeholders	What stakeholders relate to the subject of the assessment? What are their interests and goals?
	Dependencies	What are the causal connections between decision actions and endpoints of interest? What issues must be studied to be able to predict the impacts of decisions actions? These issues are operationalised using structured objects. A few different types of objects are needed: Endpoints: What are the endpoints of interest for the decision maker? If stakeholders have other interests than the decision maker, what are they? Consider including these other interests into the assessment as well. Variables: What are the issues that should be looked at to be able to predict the impacts of the decision options? How do they relate to each other (through causation or other ways)? Typically, with health impact assessments: What emissions and exposures should be considered? What health endpoints should be considered? What exposure-response functions should be considered? What population subgroups should be considered? Value variables: What are people's values and what do they think of as good or bad? Values are processed by scientific means by making observations on people's behaviour and opinions. Methods: Methods describe their subject indirectly by answering the question "how can I find the answer to question X?" When using a method, the answer to X can only be found when it is connected to the correct frame of reference. For example, a method may include emission factors for a car and equations to calculate emissions. The emissions of a particular car can only be calculated when case-specific information is known, such as kilometres driven.
	Analyses	What statistical or other analyses are needed to be able to produce results that are useful for making conclusions about the question? Typical analyses are decision analysis (which of the decision alternatives produces the best - or worst - expected outcome) and value of information analysis (how much would the decision making benefit if all uncertainties were resolved?).
	Indices	What indices are used in the assessment and what are cut out as unnecessary and when?
	Calculations	Actual calculations to produce the result. Typically an R code.

See also

• Variable