View Dataset

4P offers the possibility to host a large amount of data from a variety of acquisition vectors and calculation processes. Available datasets (made up of raw acquisition data and/or generated data) are accessible from the main left menu by clicking the section Data.

Note

Only the current installation’s / organization’s datasets are available. Besides, only the datasets which the user is granted access to are visible.

List of Datasets

The list of available datasets in 4P for the current installation is presented in a table ordered by loading date by default.

For each dataset, the table shows:

• Measuring session: The date and time when the raw data was acquired in the first place.

• Loading date: The date and time when the raw acquisition data was uploaded to 4P.

• Experiment(s): The experiment(s) to which the current dataset is related. It basically refers to group(s) of experimental plots in PHIS.

• Vector: The acquisition vector (Drone or Phenomobile) that was used for acquiring raw data.

• Data: List of types of data composing the current dataset by level and their current status.

• PHIS status: The status of this current dataset archiving to PHIS.

• Size: The size of all data composing the current dataset.

Hint

Each column of the table can be filtered so as to reduce the number of displayed datasets. A pagination system also allows to navigate through many datasets. Finally the table can be sorted by certain columns: measuring session, loading date and size.

Data Type, Level and Status

Datasets in 4P are composed by one or several data elements defined by their types which describe the kind of data and metadata it contains.

Note

For example, the type RGB Images for the Drone vector contains raw images acquired by a RGB camera mounted on a drone along with a series of metadata about the flight and measuring conditions.

Data are also defined by their level of scientific interpretation. 4P manages 3 levels of data each represented by its own color:

Raw data immediately extracted from acquisition with no transformation of any kind.

Pre-processed data obtained by a first transformation consisting in extracting, correcting or preparing data for advanced treatment.

Biological variables obtained by transformation and interpretation of pre-processed data to a measurable biological or physical quantity.

Data are finally defined by their status that can be one of the following:

The data loading - or processing- has been completed successfully. The style is in plain color (corresponding to the level) with no status icon.

The data loading - or processing - is still under progress and running. The style is in bordered color (corresponding to the data level) with a spinning progress icon.

The data loading - or processing - has failed, or data itself have been manually invalidated. The style is in bordered color (corresponding to the data level) with a red cross icon.

The data processing is complete, but the macro used for the process is not published. The style is in bordered color (corresponding to the data level) with a green ban icon.

Finally, when data validation failed (particularly for L0 data level) a Warning icon is shown next to the data itself, as shown on the right here.

Note

Please refer to the Data Types section of the current guide, to know more about data types.

Dataset Details

To visualize the details of a dataset just click a specific row in the datasets list.

The dataset details page displays key information of its content and status. On the top of the page, the breadcrumb trail shows the name of the current dataset as well as a link to return to the list and previous and next buttons to switch to another dataset in the list.

The toolbar beneath allows to upload to PHIS, Run a Process and Delete the current dataset.

Description

This box displays general information about the current dataset such as the experiment(s), the date of the measuring session, the loading date, the vector, and the size of the whole dataset.

The PHIS indicator gives information about the transfer of data to PHIS. Gray means that no data has been transfered. Orange means that some data have been transfered but not all of them. And green means that all the dataset is archived in PHIS.

Note

Of course users with no PHIS account won’t see this indicator neither the button to export data to PHIS.

Data

This table shows the list of data elements composing the current dataset according to their types, level and status as described in the previous section “Data Type, Level and Status”.

When a data is complete this button allows to download the actual files of the current data on the user machine.

Note

More detailed information for each data is available by a click on the desired row. Refer to the View Data Element

Task History

The box Task History when unfolded shows the list of tasks applied to the current dataset. The most recent tasks are in first position in the history.

Each task is defined by:

• Its Label: it is the name of the task. In the case of a processing task a link opens the detail page of the macro used.

• Its Input data: list of data elements used as inputs for the current processing task

• Its Output data: list of data created by the current processing task (or loading task)

• Its Author: name of the user who initiated the task

• Its Start date and Duration

• Its Status/Progress

Depending on the task and its status, some actions may be available:

Download a file containing the logs of the task.

Restart the processing task from the beginning.

Resume the processing task from where it stopped.

Cancel a running processing task.

Edit the metadata loaded with raw data.

Resume the transfer of an interrupted set of data to 4P.

Delete the task if it failed.

Note

More detailed information and actions about a task are available by clicking a row of the task history.