# Structural Representation Information

## Information structural Representation Information

A Data Object may be described down to the bit level in a text document, by which we mean they are meant for human use rather than a computer being able to use it (this may change as computers using deep learning to truly understand the text).

As an example the Internet Engineering Task Force standards, on which much of the Internet is based, is documented in [RFCs](https://www.ietf.org/standards/rfcs/). For example the RFC describing ASCII format for Network Interchange is [RFC20](https://datatracker.ietf.org/doc/html/rfc20), which includes a table, constructed using text characters, to show how ASCII alphanumeric characters and a number of control characters should be encoded in bits.

Other RFCs include complex diagrams constructed using ASCII characters, for example [RFC5755](https://www.rfc-editor.org/rfc/rfc5755.txt).

Other text descriptions are for example PDF documents such as for [SOHO](https://sohowww.nascom.nasa.gov/publications/soho-documents/ICD/icd.pdf), or indeed paper documents in the case of older instruments.

## Formal structural Representation Information

Several formal description languages are available which allow the description of Data Objects down to the bit level in a way which can be used by computers.

### EAST (Enhanced Ada SubseT)

This is a [CCSDS and ISO standard language](https://public.ccsds.org/Pubs/644x0b3.pdf) which allows data to be described. There is a support website for EAST Based Access Tools – the [BEST toolkit](http://debat.c-s.fr/), and [other tools](http://vds.cnes.fr/) supported by the French Space Agency. An example complex structure for a communications package which can be described by EAST is shown below.

![](https://2290386118-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MVFE6MnOK93sACDCxxx%2Fuploads%2FSlSyRJISMzsgQgHOoNGu%2FEAST-example.jpg?alt=media\&token=6701094c-2b89-4991-afc7-b4bef98ede18)

&#x20;[CDPP (Plasma Physics Data Centre)](http://www.cdpp.eu/) uses EAST to describe and provide access to and combine many types of data, and provides many examples.

### Data Resource Broker (DRB)

[DRB ](http://www.gael.fr/drb/)is is an Open Source Java application programming interface for reading, writing and processing heterogeneous data.

### Data Format Description Language (DFDL)

[DFDL ](https://www.ogf.org/ogf/doku.php/standards/dfdl/dfdl)is a modeling language from the Open Grid Forum that allows description of text, dense binary, and legacy data formats in a vendor- neutral declarative manner. DFDL is an extension to the XML Schema Description Language (XSD).

DFDL is a way of describing the data. It is not a data format. DFDL should be able to describe many data formats, including:

* Textual and binary
* Commercial record-oriented
* Scientific and numeric
* Modern and legacy
* Industry standards

An open source interpreter is available as [Apache Daffodil](https://daffodil.apache.org/)

DFDL is used to describe various scientific data files, particularly those used in Earth Observation, by ESA in the Standard Archive Format for Europe ([SAFE](https://earth.esa.int/eogateway/activities/safe-the-standard-archive-format-for-europe)).

### LABDRIVE Automated File Format Identification <a href="#file-format-identification" id="file-format-identification"></a>

On ingestion LABDRIVE uses a number of tools  (see <https://public.docs.libnova.com/labdrive/api/#/PRONOM>) that enable the automatic identification of the file format of a particular file, typically by examining file signatures, usually the first few bytes of the file.

![](https://2290386118-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MVFE6MnOK93sACDCxxx%2Fuploads%2FAmY9e1Qi1shkoaoI0HbD%2Fformat-image.png?alt=media\&token=e8db8e5f-b8d4-4b80-bc70-f37e24a7758b)

​The file formats are identified using [PRONOM ](https://www.nationalarchives.gov.uk/PRONOM/)identifiers, however PRONOM provides very little information about the format as illustrated in the following.

![](https://2290386118-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F-MVFE6MnOK93sACDCxxx%2Fuploads%2FvgomemsRjdYIZeDbkAmg%2Fformat-pronom.png?alt=media\&token=a30b00bf-54cf-480a-8254-47876c621c76)

The format identification allows the file to be displayed but does not normally identify the various components to which semantics may be attached.

### Tools to create Structural Representation Information

* the [BEST toolkit](http://debat.c-s.fr/), and [other tools](http://vds.cnes.fr/)&#x20;
* [Apache Daffodil](https://daffodil.apache.org/)
* DROID <https://www.nationalarchives.gov.uk/information-management/manage-information/preserving-digital-records/droid/>
* ASN.1 (<https://www.itu.int/en/ITU-T/asn1/Pages/asn1_project.aspx>)&#x20;
