Talk:Opasnet Journal: Difference between revisions

From Opasnet
Jump to navigation Jump to search
(rewritten based on our new discussion)
Line 3: Line 3:
We are researchers in the field of environmental health and work on developing open practices to creation and use of scientifically sound knowledge on issues relevant to environment and health. In our work we have come to identify some important shortcomings in the current dominant practice of publishing scientific information as peer reviewed articles in scientific journals.
We are researchers in the field of environmental health and work on developing open practices to creation and use of scientifically sound knowledge on issues relevant to environment and health. In our work we have come to identify some important shortcomings in the current dominant practice of publishing scientific information as peer reviewed articles in scientific journals.


First of all, many articles are only available to those who subscribe to the journal or purchase the specific article. In addition, long review and publication processes and copyright issues often prevent scientists from publishing their findings openly. Despite the recent increase in open access journals and quickened review processes, the reality of disseminating scientific information is still far from being open.
If we think of a typical article, it consists of two parts: first, a description of the study design and the data obtained; second, interpretations of the results and discussion in a wider context. The first part is permanent in time, as the observed data does not change. In contrast, making interpretations is a social activity (involving also other researchers than the original authors), and it will change in time (sometimes dramatically).


Scientific meriting based on the number of publications directs scientists to write manuscripts that conform to consensual views and propose only incremental changes to current understanding in order to make them easily acceptable by peer-reviewers. Thereby, although the practice of peer review itself does not necessarily suppress new and provocative ideas, the meriting practice makes scientists themselves to suppress them. It also encourages scientists to keep their data secret in order to maximize the amount of publications based on the data under their own name. It is difficult to see this as being beneficial to developing scientific understanding.
Only the first part should be archived in a frozen, article-type form. These could well be published first and peer reviewed only later, as is the current practice in some fields of science (see (http://arxiv.org/).


Furthermore, the common idea of a journal article as the basic unit of scientific information is somewhat misleading. It tends to divert attention too much on things of secondary relevance, such as who did the study, who wrote the article and where was it published, instead of focusing on what are the study results, what evidence and reasoning is provided, and what conclusions can be drawn? Journal articles are static objects that do not develop after publication. Further development on the issues considered in the article requires creating new articles that mostly consist of reproduction of already published information. As articles  considering similar phenomena can be widely dispersed both in time and across the whole range of different scientific journals, the knowledge base created by the current scientific publication practices can not be honestly described as anything else than fragmented.
The second part, interpretations, should be dealt with in open workspaces designed for mass collaboration. There are methods to effectively organise these discussions to achieve convergence. To give one example, see pragma-dialectics in Wikipedia. These methods are still under-utilised (this blog is a typical example).


There are no perfect and complete ready-made solutions to the problems described above, but some possible approaches are worth mentioning.
Let's look at the current discussion raised by Peter Duesberg and David Rasnick. It is all about interpretations on shaky grounds. These could have been shot down easily in an open workspace, without any need of editorial decisions. In an open workspace, anyone could publish their statements (idea promoted by Bruce G Charlton) and all statements incoherent with facts would be invalidated (idea promoted by Ben Goldacre) by peers. There is no need to remove invalid statements, because they are shown to be invalid. It is much easier to discuss issues statement by statement, rather than article by article, as each article can have some valid and some invalid statements.


# Publish first, review later. This principle is already somewhat applied in physics and some related fields of science (see (http://arxiv.org/). It speeds up the process of getting new ideas published and poses no unnecessary need of suppressing controversial ideas. Review and evaluation procedures can well be designed and implemented so that they address already published articles. We believe that open publication policy complemented with good "review later" practices is rather likely to increase than decrease the scientific quality of publications.
A paradigm shift to open scientific workspaces has at least two major problems. It is not clear how scientists could get merit from participating in mass collaboration instead of writing articles. In addition, this might cause problems to the business logic of scientific journals.
# Publishing in web-based information bases/workspaces. Article databases could be replaced with web-based collaborative workspaces where "publication" takes place in form of contributions to shared pieces of information. Instead of publishing study-based articles, scientists could produce contributions and provide reasonings, and evidence on phenomenon-based shared pieces of information.
 
If current publication practices are to be developed, changes in the scientific meriting system are also necessary. Instead of mere number of publications, merit should be awarded based on how much the collective knowledge base improved by scientific contributions. At least in some fields of science, merit should be awarded based on the societal relevance and impacts of research results.


We have drafted a procedure description for a journal that is based on the ideas briefly described above: Opasnet journal (http://en.opasnet.org/w/Opasnet_Journal). Please have a look and give your comments!
We have drafted a procedure description for a journal that is based on the ideas briefly described above: Opasnet journal (http://en.opasnet.org/w/Opasnet_Journal). Please have a look and give your comments!

Revision as of 13:02, 18 September 2009

A response to a Bad Science blog text touching peer review

We are researchers in the field of environmental health and work on developing open practices to creation and use of scientifically sound knowledge on issues relevant to environment and health. In our work we have come to identify some important shortcomings in the current dominant practice of publishing scientific information as peer reviewed articles in scientific journals.

If we think of a typical article, it consists of two parts: first, a description of the study design and the data obtained; second, interpretations of the results and discussion in a wider context. The first part is permanent in time, as the observed data does not change. In contrast, making interpretations is a social activity (involving also other researchers than the original authors), and it will change in time (sometimes dramatically).

Only the first part should be archived in a frozen, article-type form. These could well be published first and peer reviewed only later, as is the current practice in some fields of science (see (http://arxiv.org/).

The second part, interpretations, should be dealt with in open workspaces designed for mass collaboration. There are methods to effectively organise these discussions to achieve convergence. To give one example, see pragma-dialectics in Wikipedia. These methods are still under-utilised (this blog is a typical example).

Let's look at the current discussion raised by Peter Duesberg and David Rasnick. It is all about interpretations on shaky grounds. These could have been shot down easily in an open workspace, without any need of editorial decisions. In an open workspace, anyone could publish their statements (idea promoted by Bruce G Charlton) and all statements incoherent with facts would be invalidated (idea promoted by Ben Goldacre) by peers. There is no need to remove invalid statements, because they are shown to be invalid. It is much easier to discuss issues statement by statement, rather than article by article, as each article can have some valid and some invalid statements.

A paradigm shift to open scientific workspaces has at least two major problems. It is not clear how scientists could get merit from participating in mass collaboration instead of writing articles. In addition, this might cause problems to the business logic of scientific journals.

We have drafted a procedure description for a journal that is based on the ideas briefly described above: Opasnet journal (http://en.opasnet.org/w/Opasnet_Journal). Please have a look and give your comments!

Mikko Pohjola
Jouni Tuomisto THL