File:Opasnet base connection.ANA: Difference between revisions

Revision as of 18:44, 11 July 2010

This page is a knowledge crystal of subtype method. The page identifier is Op_en2676
Moderator:Jouni (see all)

Upload data {{#opasnet_base_link:Op_en2676}}

This model is an interface for uploading data to and downloading it from the Opasnet base. This file is an editable version of a web interface. For using the file, you need Analytica Enterprise. For using the web interface, you only need a web browser (Mozilla Firefox recommended).

TODO: {{#todo:OBC:n lataustapa 1 (copy-paste table) pitäisi koodata R:lle. Kuka osaisi?|Juha Villman|}}

An improved web interface

There is also a web interface for downloading only; this interface produces raw data tables that you can copy-paste to an external software. You can select slices from a variable.

The data is stored into the Opasnet base as two-dimensional tables, one for each data object (data objects can be either studies or variables. For details, see the description of the database structure. For example, the data called Morbidity data for Europe consists of a table that is indexed by four indices: Year, Sex, Age, and Country. Indices define the specifics of a particular observation. In addition, there is one parameter (morbidity), which is the field that contains the observations (values of interest).

Developmental needs

Kehitettävää (by Erkki):

A) Taulukkodatan syöttö on vielä epävarmaa, toimii välillä ja välillä ei, vailla selkeää johdonmukaisuutta. ==> Epävarma toiminta voisi Juhan mukaan viitata johonkin selain-/flash-/tms.-tekniseen fibaan.
B) Parametrisarakkeissa olevan puuttuvan datan käsittely näyttää keskeneräiseltä, koska 'Null' ei nähtävästi kelpaa arvoksi lainkaan (ko. rivit jäävät kokonaan pois), ja 'Undefined'-arvot AWP muuntaa nolliksi, mikä johtaa harhaan.

⇤--1: . There is no need to store null values, because all missing values are null anyway. --Jouni 11:57, 13 January 2010 (UTC) (type: truth; paradigms: science: attack)

C) Kun menen katsomaan http://base.opasnet.org/, niin ko. study näkyy kylläkin pudotusvalikossa, mutta "post"-painikkeella ei palaudu mitään dataa. Juha varmaan fiksailee tuon kun ehtii.

TODO: {{#todo:Järjestelmää voisi muuttaa seuraavasti:

Ensin ladataan obj-, act- ja loc-tiedot (explanations). Vasta sen jälkeen ladataan muut (observations: cell, loccell, res). Tämä edellyttää: a) kaikki loc-tietot kaikista ladattavista muuttujista käsitellään kerralla tai luodaan luuppi myös explanationsiin (edellinen parempi), b) kaikki lataustavat tuottavat standardimuotoisen Data_tablen.
Replace/append pitää toimia kaikilla lataustyypeillä.
Ind pitäisi erottaa omaksi taulukseen Obj:sta. Tämä kuitenkin vaatii niin paljon muutoksia, ettei siihen ryhdytä neuvottelematta Juhan ja Einarin kanssa. Alustavia valmisteluja kuitenkin tehdään halkaisemalla OBC:n Objects-taulu kahtia, Indices erikseen.

|Jouni, Juha Villman, Einari Happonen|Opasnet}}

File history

Click on a date/time to view the file as it appeared at that time.

	Date/Time	Dimensions	User	Comment
current	10:26, 21 August 2010	(80 KB)	Jouni (talk \| contribs)	Major simplifying revisions: lot of memory-saving improvements. Two input formats rejected. Intermediate nodes merged to save memory. Bugs corrected.
	19:30, 12 July 2010	(92 KB)	Jouni (talk \| contribs)	Now it is quick also with probabilistic data, as I changed while-do loop to for x[]:= b loop. In addition, the obs in a deterministic table is the row number, while before it was just zero.
	13:42, 12 July 2010	(92 KB)	Jouni (talk \| contribs)	As expected, Cellrow node was too heavy with large data. This part was streamlined. Now it is quick and simple with deterministic data, but takes a long time with large probabilistic data (little memory need, though).
	22:22, 11 July 2010	(92 KB)	Jouni (talk \| contribs)	Still some bugs found but it seems to work now.
	05:05, 10 July 2010	(107 KB)	Jouni (talk \| contribs)	Model tested with several options and now it always works! This is now version 2.0. All descriptions were moved to file:Opasnet base connection.ANA (technical) and Uploading to Opasnet Base (method) and updated.
	14:56, 9 July 2010	(121 KB)	Jouni (talk \| contribs)	Tested and now it works except bugs were found from W_Actobj and Cell, because they depend on uploaded tables and the update too fast. Maybe a static node in between solves this problem.
	23:05, 8 July 2010	(136 KB)	Jouni (talk \| contribs)	Update finalised and first tests are successful. The code has become much simpler, it can even been understood by outsiders.
	14:11, 8 July 2010	(126 KB)	Jouni (talk \| contribs)	Code streamlined. All different upload types seem to work to Data_table phase but not further. Added observise function to work with table-based prob data.
	22:50, 7 July 2010	(108 KB)	Jouni (talk \| contribs)	Index info was rejected because it caused trouble with updating, was complex, and didn't bring anything essential. Some bugs removed. Should work now but haven't tested yet. Code starts to be simple and beautiful. Stuff moved to Old parts.
	15:13, 7 July 2010	(105 KB)	Jouni (talk \| contribs)	Uploading part streamlined and corrected. Not all upload methods worked properly. There is still some problem.

You cannot overwrite this file.

File usage

The following 3 pages use this file:

File:RDB connection.ANA (file redirect)
File:RDB reader.ANA (file redirect)
File:Transferring to result database.ANA (file redirect)

@@ Line 35: / Line 35: @@
 [[Category:Opasnet Base]]
 * [http://cs.stanford.edu/people/thathoo/rmysql.pdf Guidance document for RMySQL] (the MySQL database connection for [[R]] software.
+[[Category:Opasnet]]