File:Opasnet base connection.ANA: Difference between revisions

From Opasnet
Jump to navigation Jump to search
(uploaded a new version of "File:Opasnet base connection.ANA": Copy-paste data table, Analytica table, and multi-variable model all work now. The model seems to be ready, but the actual connection must be tested. Note! This is actually a zip file.)
(technical edits)
 
(30 intermediate revisions by 3 users not shown)
Line 1: Line 1:
[[Category:Opasnet]]
[[Category:Opasnet Base]]
[[Category:Analytica tool]]
[[Category:Analytica tool]]
[[Category:SQL tool]]
[[Category:SQL tool]]
[[Category:Open assessment]]
[[Category:Open assessment]]
{{tool|moderator=Jouni}}
{{tool|moderator=Jouni}}
This model is an interface for uploading data to and downloading it from the [[Opasnet base]]. This file is an editable version of a [http://www.analyticaonline.com/24a/Client/AwpClient.aspx?inviteId=invite58&inviteCode=61143 web interface]. For using the file, you need [[Analytica]] Enterprise. For using the web interface, you only need a web browser (Mozilla Firefox recommended).  
''This page relates to old versions of [[Opasnet Base (2008-2011)]] and its connections. For the current database version, see [[Opasnet Base]].


==An improved web interface==
This model is an interface for uploading data to and downloading it from the [[Opasnet Base]]. For using the file, you need [[Analytica]] Enterprise.


There is also a [http://base.opasnet.org web interface for downloading only]; this interface produces raw data tables that you can copy-paste to an external software. However, some pieces of data are very large, and you may experience downloading the data, or handling the data afterwards. Therefore, there is a need to improve the interface. The improvement needs are described in this chapter.
[[Uploading to Opasnet Base]] helps you understand what data could and should be updated to [[Opasnet Base]] and what the recommended data structures and formats are. For technical instructions how to use the current upload software, see [[Opasnet Base connection]]. For a general description about the database, see [[Opasnet Base]] and for technical details about the database, see [[Opasnet Base structure]]. For details about downloading data, see [[Opasnet Base UI]].


The data is stored into the [[Opasnet base]] as two-dimensional tables, one for each data object (data objects can be either [[study|studies]] or [[variable]]s. For details, see the [[Opasnet Base structure|description of the database structure]].  For example, the data called [[Morbidity data for Europe]] consists of a table that is indexed by four [[index|indices]]: Year, Sex, Age, and Country. Indices define the specifics of a particular observation. In addition, there is one [[parameter]] (morbidity), which is the field that contains the observations (values of interest).
'''Some key parts of OBC explained


Often, the user is only interested in a part of the data, e.g. one year of observation, one country, and maybe a few age groups. So, there should be an interface that shows the data in the Opasnet in a few steps, when a user selects a data object.
; Findid: This function gets an id from a table. It has the following parameters: '''in''': the property for which the id is needed. In MUST be unique in cond and it must contain index i. '''table''': the table from where the id is brought. The table MUST have .j as the column index, .i as the row index, and a column named 'id'. '''cond''': the name of the field that is compared with in. Cond must be text.
# The user is shown the list of uploads (versions) of the data object. The default is the newest upload, but the user should be able to choose an older one as well. This is based on the query that is shown on the metadata box as "List of uploads".
# The user is shown the list of indices and locations (possible values). The user can choose any combination of locations with tick boxes beside each location.
# The user is shown a two-dimensional table of data with indices and parameters as fields, and observations as rows. This can then be copy-pasted to other programs. Alternatively, a comma separated file (CSV) is created and a Save as dialog box appears. Now the "The newest upload" link does something like this but does not allow for selecting locations, and the output format is not optimal for copy-pasting data into another software.
# In cases where the data is given as distributions instead of point estimates, the data can also be downloaded as a sample file of distributions.


==Development needs==
;Textify: Changes a number to a text value with up to 15 significant numbers. This bypasses the number formatting problem that tends to convert e.g. 93341 to '93.34K'. If the input is null, the result is ''.
 
* Now the model interprets the results as numbers if applicable, otherwise text.
* Analytica_node creates an indexname list where local indices start with dot (.Index). The dot should be removed, because in the Opasnet Base there are no local indices.
* Upload the read functions. The indices should have the real names from the Opasnet Base, not just In1, In2 and so on.
* The queries for read functions should be the same queries as in <nowiki>[[Template:Resultlink]]</nowiki>.
* The read functions don't work properly. They don't show Testvariable data uploaded 28.8.2009 for some reason.
* The first read function should show data in 2D format; only the next function should turn it into an array. This is because not all data has originally been arrays and would result in hugely multidimensional arrays with a lot of empty cells.
 
Kehitettävää (by Erkki):
*A) Taulukkodatan syöttö on vielä epävarmaa, toimii välillä ja välillä ei, vailla selkeää johdonmukaisuutta. ==> Epävarma toiminta voisi Juhan mukaan viitata johonkin selain-/flash-/tms.-tekniseen fibaan.
*B) Parametrisarakkeissa olevan puuttuvan datan käsittely näyttää keskeneräiseltä, koska 'Null' ei nähtävästi kelpaa arvoksi lainkaan (ko. rivit jäävät kokonaan pois), ja 'Undefined'-arvot AWP muuntaa nolliksi, mikä johtaa harhaan.
*C) Kun menen katsomaan http://base.opasnet.org/, niin ko. study näkyy kylläkin pudotusvalikossa, mutta "post"-painikkeella ei palaudu mitään dataa. Juha varmaan fiksailee tuon kun ehtii.


==See also==
==See also==


* [[Opasnet Base Connection for R]]
* [[Opasnet Base]]
* [[Opasnet Base structure]]
* [[Uploading to Opasnet Base]]
* [[Opasnet Base UI]]
* Previous version [[:image:RDB connection.ANA]] and [[:image:RDB reader.ANA]] were only for either reading or writing data.
* Previous version [[:image:RDB connection.ANA]] and [[:image:RDB reader.ANA]] were only for either reading or writing data.
[[Category:Opasnet Base]]
* [http://cs.stanford.edu/people/thathoo/rmysql.pdf Guidance document for RMySQL] (the MySQL database connection for [[R]] software.

Latest revision as of 19:01, 10 April 2015


This page relates to old versions of Opasnet Base (2008-2011) and its connections. For the current database version, see Opasnet Base.

This model is an interface for uploading data to and downloading it from the Opasnet Base. For using the file, you need Analytica Enterprise.

Uploading to Opasnet Base helps you understand what data could and should be updated to Opasnet Base and what the recommended data structures and formats are. For technical instructions how to use the current upload software, see Opasnet Base connection. For a general description about the database, see Opasnet Base and for technical details about the database, see Opasnet Base structure. For details about downloading data, see Opasnet Base UI.

Some key parts of OBC explained

Findid
This function gets an id from a table. It has the following parameters: in: the property for which the id is needed. In MUST be unique in cond and it must contain index i. table: the table from where the id is brought. The table MUST have .j as the column index, .i as the row index, and a column named 'id'. cond: the name of the field that is compared with in. Cond must be text.
Textify
Changes a number to a text value with up to 15 significant numbers. This bypasses the number formatting problem that tends to convert e.g. 93341 to '93.34K'. If the input is null, the result is .

See also

File history

Click on a date/time to view the file as it appeared at that time.

(newest | oldest) View (newer 10 | ) (10 | 20 | 50 | 100 | 250 | 500)
Date/TimeDimensionsUserComment
current10:26, 21 August 2010 (80 KB)Jouni (talk | contribs)Major simplifying revisions: lot of memory-saving improvements. Two input formats rejected. Intermediate nodes merged to save memory. Bugs corrected.
19:30, 12 July 2010 (92 KB)Jouni (talk | contribs)Now it is quick also with probabilistic data, as I changed while-do loop to for x[]:= b loop. In addition, the obs in a deterministic table is the row number, while before it was just zero.
13:42, 12 July 2010 (92 KB)Jouni (talk | contribs)As expected, Cellrow node was too heavy with large data. This part was streamlined. Now it is quick and simple with deterministic data, but takes a long time with large probabilistic data (little memory need, though).
22:22, 11 July 2010 (92 KB)Jouni (talk | contribs)Still some bugs found but it seems to work now.
05:05, 10 July 2010 (107 KB)Jouni (talk | contribs)Model tested with several options and now it always works! This is now version 2.0. All descriptions were moved to file:Opasnet base connection.ANA (technical) and Uploading to Opasnet Base (method) and updated.
14:56, 9 July 2010 (121 KB)Jouni (talk | contribs)Tested and now it works except bugs were found from W_Actobj and Cell, because they depend on uploaded tables and the update too fast. Maybe a static node in between solves this problem.
23:05, 8 July 2010 (136 KB)Jouni (talk | contribs)Update finalised and first tests are successful. The code has become much simpler, it can even been understood by outsiders.
14:11, 8 July 2010 (126 KB)Jouni (talk | contribs)Code streamlined. All different upload types seem to work to Data_table phase but not further. Added observise function to work with table-based prob data.
22:50, 7 July 2010 (108 KB)Jouni (talk | contribs)Index info was rejected because it caused trouble with updating, was complex, and didn't bring anything essential. Some bugs removed. Should work now but haven't tested yet. Code starts to be simple and beautiful. Stuff moved to Old parts.
15:13, 7 July 2010 (105 KB)Jouni (talk | contribs)Uploading part streamlined and corrected. Not all upload methods worked properly. There is still some problem.
(newest | oldest) View (newer 10 | ) (10 | 20 | 50 | 100 | 250 | 500)

You cannot overwrite this file.

The following 3 pages use this file:

Retrieved from "https://en.opasnet.org/index.php?title=File:Opasnet_base_connection.ANA&oldid=35358"