Mick: Created page with "The great majority of sonification examples available on the web are audio files that represent a sequence of several data layers of a certain phenomena (physical, astronomical but also metadata, web statistics, economics, health parameters) during a certain period of time. These are stored data converted to an audio file. We call ''a posteriori'' when the data is sonified after being collected and stored. ''a posteriori'' comes from Latin and means "from the latter" o..."

2024-09-26T14:02:59Z

Created page with "The great majority of sonification examples available on the web are audio files that represent a sequence of several data layers of a certain phenomena (physical, astronomical but also metadata, web statistics, economics, health parameters) during a certain period of time. These are stored data converted to an audio file. We call ''a posteriori'' when the data is sonified after being collected and stored. ''a posteriori'' comes from Latin and means "from the latter" o..."

New page

The great majority of sonification examples available on the web are audio files that represent a sequence of several data layers of a certain phenomena (physical, astronomical but also metadata, web statistics, economics, health parameters) during a certain period of time. These are stored data converted to an audio file.

We call ''a posteriori'' when the data is sonified after being collected and stored. ''a posteriori'' comes from Latin and means "from the latter" or "from the one behind". It is usually used in philosophy to refer to a statement that comes after experience. While in real-time sonification we do not know what exactly will be the next data input, in ''a posteriori'' sonification, when we store a sequence of data we can take our time to analyze it and adjust our output sounds and test them. The data set is translated into a sound piece as a whole.

== TwoTone ==

There are many ''a posteriori'' sonification applications that you can find online. [https://twotone.io/ TwoTone] is a software program by Google that allows you to generate sounds from data. This software has its own database, and it is updated regularly. This shows how popular sonification is.

TwoTone is a flexible software that allows one to add multiple data tracks from a data source and map the data to a chosen scale, choosing the instrument, the octave, range, starting octave, tempo, etc. The user can also add soundtracks from the database, upload its soundtracks, and record sound from the microphone.

=== Using TwoTone ===

To start playing with it, TwoTone comes with a database that the user can explore to test the software features. After you feel comfortable with it, you can import your own data.

[[File:Soundscapes twotone db example.webm|center|a posterior sonification example with twotone.]]

=== Prepare and import data ===

After collecting and storing the data you want to sonify (either with a device like a microcontroller, a computer, a smartphone, from a web source, or by hand) you have to prepare the data in the right format. For instance, imagine you have collected air pollution data from an air quality station:

# Open Excel (or another equivalent spreadsheet software) and write the first row as headers. Use simple headers like "Timestamp" and "CO2". This row will be treated as the names of the data fields.
# The rows below the headers should contain the actual data.
# Save your file in .csv format.

In this example, the data file should look like the following:

[[File:Soundscapes twotone file example.png|300 px|center|TwoTone file format.]]

When selecting a data source, upload your file in the rectangular box, either by clicking it and browsing your local folders or by dragging the file into it:

[[File:Soundscapes twotone upload.png |500 px|center|TwoTone upload file]]

== Data from the Web ==

There are many certified/credited sources of data online that you can use in your sonification projects. Here is a list of suggestions:

* [https://ourworldindata.org/ Our World in Data] - comprehensive online resource that provides accessible data and research on global development, covering topics such as health, education, and the environment.
* [https://www.pordata.pt/ Pordata] - a Portuguese online database that offers statistical information on various aspects of Portugal's society, economy, and demographics, facilitating access to data for research and analysis.
* [https://datosclima.es/ Datos Clima]- Spanish platform that provides access to climate data and information, focusing on the impacts of climate change and promoting awareness and research on environmental issues.

== Collect and store data with micro:bit ==

There are many different ways to collect and store data. Using a microcontroller can be very helpful if you are designing your own data collection device, and the micro:bit is a great choice, as it is flexible and easy to use. If you are not yet familiar with the micro:bit microcontroller, we recommend you to start by reading the [https://wiki.soundscapes.nuclio.org/wiki/Real-time_sonification seal-time sonification] SoundScapes wiki page where we introduce the readers to quick tutorials and examples.

To store data on the micro:bit you need first to install the Makecode extension [https://makecode.microbit.org/reference/datalogger datalogger]:

[[File:Soundscapes makecode datalogger.gif |600 px|center|Install datalogger extension]]

=== Using internal sensors ===

The following is an example of how you can program the micro:bit to collect and log data on the board. The example logs the '''acceleration strength''' input, but another internal sensor (sound level, light level, compass heading, temperature) or external sensor can be used.

<HTML>
<div style="position:relative;height:0;padding-bottom:75%;overflow:hidden;"><iframe style="position:absolute;top:0;left:0;width:100%;height:100%;" src="https://makecode.microbit.org/#pub:_2id6ata7gKa7" frameborder="0" sandbox="allow-popups allow-forms allow-scripts allow-same-origin"></iframe></div>
</html>

To access the data, open the micro:bit in you file explorer/manager and open the file '''MY_DATA.HTM'''. Notice you can also copy it, save it in .csv format (ready to import to TwoTone), or visualize it.

[[File:Soundscapes mb datalog.png|600 px|center|Access logged data]]

=== Using external sensors ===

If instead of using a micro:bit sensor you want to collect data from an external digital/analog sensor on a micro pin or using for instance the I2C protocol (all of these blocks can be found under the advanced categories) you can use the same program but simply replace the '''acceleration''' input block with the corresponding block as follows:

[[File:Soundscapes digitalreadpin.png|350 px|center|Digital read pin]]

[[File:Soundscapes analogreadpin4.png|350 px|center|Analog read pin]]

[[File:Soundscapes i2c.png|700 px|center|i2c pin]]

'''Attention to the pin number or the i2c address!'''

3.3 ''a posteriori'' sonification - Revision history