MIDI tracks record MIDI data—performance data about sequences of notes played—whereas audio tracks record representations of actual sound waves. They are fundamentally different types of data. Yet, they can both be combined effectively using modern hardware and software to form coherent audio productions.
In this article we’ll look at:
How is MIDI data different from audio data?
MIDI, or Musical Instrument Digital Interface, is a standard for recording musical performance data in a digital format. It was developed in the 1980s and originally applied to keyboard instruments.
Audio data, on the other hand, refers to the representations of actual sound waves in analog or digital format.
MIDI does not represent sound waves. Instead, it is a set of instructions (or notations) about musical notes, chords, and sequences.
When audio data is processed using computers, digital audio data is used, and analog audio is often converted to digital audio for this purpose (using audio interfaces or other means of analog-to-digital conversion).
MIDI is, by design, a digital data format and can be stored and processed on computer systems.
There are several other differences between MIDI and digital audio worth noting:
- MIDI is only usable with MIDI-enabled electronic devices (MIDI devices), whereas digital audio data represents sound captured from any sound-producing device
- MIDI uses far less computer memory than digital audio data since it is only a set of instructions about notes, chords, and sequences of music, rather than a data-intensive capture of actual sound
- MIDI data can only be heard by triggering MIDI devices to play sounds, whereas digital audio data can be heard through any amplified speaker system or headphones (after digital-to-analog conversion has been done)
MIDI tracks vs audio tracks
MIDI data and audio data can both be stored as musical tracks using computer software (for MIDI and digital audio data) or using analog recording equipment (for analog audio data).
Analog recording equipment includes tape machines, vinyl, and other recording media that capture analog audio. Nowadays, most people prefer to work with digital audio as it can be processed using computer systems that offer more capabilities and versatility than analog systems.
We’ll focus on digital audio in this article.
Musical tracks of MIDI data—or MIDI tracks—contain only performance information (ie. what notes and chords to play, when to play them, and how to play them), whereas digital audio musical tracks—or audio tracks—contain actual sound data.
Several tracks can be combined to form a musical composition. There are many computer software applications available for this purpose, and these are often referred to as Digital Audio Workstations or DAWs.
Let’s look at an example to better understand the differences between MIDI tracks and audio tracks.
MIDI and audio tracks—a worked example
We’ll use Garage Band as our DAW to record MIDI and audio tracks (Garage Band is available for free on Mac OS).
We’ll also use virtual software instruments, a bass guitar, and an audio interface to generate and record our virtual (MIDI) and actual (audio) sounds.
Keep in mind that you could use any DAW, any virtual software instrument, and any analog (actual) instrument of your choice (including your own voice)—the concepts outlined in this example will still apply.
Setup
For our MIDI track, we’ll use a MIDI keyboard controller to play musical notes, and this will generate the MIDI information based on those notes. The MIDI keyboard will not generate any actual sound, only the MIDI information about the notes played.
The MIDI keyboard will be directly connected to a Mac (running Garage Band) via a USB cable—this allows the keyboard to pass on MIDI information to Garage Band.
For our audio track, we’ll use an (actual) bass guitar to play notes and convert the analog audio (coming from the bass guitar) to digital audio using a Focusrite Scarlett 2i2 audio interface—a relatively inexpensive, yet high-quality, audio interface.
The bass guitar plugs directly into the audio interface (using an instrument input jack), and the audio interface then connects to the Mac that’s running Garage Band.
Recording a MIDI track
Let’s play a few simple chords on the MIDI keyboard—say, the D, G, and C triads of the C Major scale—and record this in Garage Band. This will be recorded as a MIDI track in Garage Band.
Remember that Garage Band does not record any actual sound data on the MIDI track, it only records information about the notes played and the timing of those notes (along with some other information, such as how hard the keys were pressed).
This information is conveyed to Garage Band from the MIDI keyboard via MIDI messages. Garage Band interprets the MIDI messages to know what notes were played and how they were played.
Since Garage Band doesn’t have any sound data for the MIDI track, we’ll need to choose a virtual instrument for Garage Band to associate with the MIDI notes (chords) played—this will allow Garage Band to generate sounds based on the MIDI information it receives.
Let’s choose a “Steinway Grand Piano” as our virtual instrument, which is one of the many choices available in Garage Band.
Once we do all of this, we’ll have recorded our MIDI track in Garage Band—the picture below shows what this MIDI track looks like:
There are a few things to note about the MIDI track:
- The MIDI Track shows horizontal lines—each line represents a note (key) played, and the length of the line represents the timing (ie. how long the note was pressed, and the time at which each note was pressed and released)
- The Expanded View shows the keys that were played—the picture of the keyboard makes it easy to see which notes were played, and the green lines show the timing of the notes
- The MIDI Virtual Instrument in this case is a Grand Piano
You can listen to what this track sounds like by playing the below audio file.
Note that this audio file is an MP3 file that was generated by Garage Band, and the sound that you hear on the file is the sound made by the Grand Piano (software) virtual instrument. The MIDI information that generates the notes played by this virtual instrument has no sound—it is merely digital information about the notes played and how they were played.
Changing a virtual instrument
What if we wanted to play a different instrument on our MIDI track?
This is easy to do with MIDI—we simply need to assign a different virtual instrument to the MIDI track. The MIDI data will then trigger the new virtual instrument just as it did the previous virtual instrument (ie. the Grand Piano).
Let’s try this by changing our virtual instrument selection from Grand Piano to Trumpets—another one of the standard choices available in Garage Band.
The picture below shows what the MIDI track now looks like:
This MIDI track is exactly the same as the MIDI track that we saw before—the same notes are played with exactly the same timing—but, instead of using a Grand Piano as the virtual instrument, we’re using Trumpets.
You can listen to what this track now sounds like with the below audio file.
Did you notice how the same chords are being played? It’s just that the instrument playing the chords has changed.
This is one of the main advantages of using MIDI—you can swap and change the instruments (that generate sound) as you wish as the MIDI data only records the notes that you play and the way that you play them.
But how do the virtual (software) instruments generate the sounds that you hear?
It’s simply a matter of converting the digital data associated with the virtual instrument into an analog form that we (humans) can hear.
In our example, this was done using the Focusrite audio interface (that has an in-built, high-quality digital-to-audio converter, or DAC). But any computer system that has an audio output can do this using their in-built DACs to generate analog sound that can be heard through amplified speakers or headphones.
Recording an audio track
Let’s now look at recording an audio track.
We’ll play a few notes on our bass guitar that (we hope) match the chords in our MIDI track.
Remember that our bass guitar is connected to our audio interface which converts the (analog) sound coming out of the bass guitar to a digital form using its in-built analog-to-digital converter (ADC).
The audio interface records the actual sound waves coming from our bass guitar. And, after converting it to a digital form (using ADC), it sends the information to Garage Band to be recorded as an audio track.
The picture below shows what our audio track of the bass guitar looks like:
What do we notice about this audio track?
- It looks totally different from the MIDI track—rather than uniform horizontal lines, we see the characteristic waveforms associated with sound waves.
- We have no idea about which notes were played—the only way to find out is to play back the audio track
- The “height” of the waveform at various points in time reflects the amplitude (loudness) of the bass guitar notes that were played
- The “density” of the waveform reflects the frequencies of the sounds made by the bass guitar
Unlike our MIDI track, we cannot change the recorded instrument from a bass guitar to any other type of instrument—the only way to do so would be to play the different instrument and re-record the track.
You can listen to what the bass guitar audio track sounds like with the below audio file.
As before, this audio file is an MP3 file that was generated by Garage Band, but the sound that you hear in this case is an actual recording of the bass guitar—the notes that were played on the bass guitar.
Combining MIDI and audio tracks
Let’s now bring our tracks together to form a very simple “song”.
We’ll revert to our original MIDI instrument—the Grand Piano—for our MIDI track, and combine this with our bass guitar (audio) track.
The picture below shows what the tracks look like:
Seeing the tracks next to each other, the differences between them should be clearer.
You can listen to what these tracks sound like when played together in the below audio file.
So, using modern DAWs it’s easy to combine MIDI and audio tracks together. Although the data used in each of these tracks are fundamentally different, they can combine seamlessly to form a coherent audio production.
Conclusion
MIDI data and audio data are different:
- MIDI is performance data about the notes, chords, or sequences of music played, and the way in which they were played
- Audio data is an actual representation of sound waves
MIDI tracks record MIDI information about what notes were played, the timing of how they were played, and other information about how they were played (such as how “fast”, or how “hard”, the notes were struck).
MIDI tracks can be applied to any virtual (software) instrument—the MIDI information simply triggers a virtual instrument to play sequences of notes in the manner described by the MIDI data.
Audio tracks, in contrast, record actual representations of sound waves, and once recorded, the instrument that played the audio recording cannot be changed.
MIDI tracks and audio tracks can combine effectively to produce music or other audio productions—modern DAWs make it easy to record and combine both MIDI and audio tracks in this way.