Guillaume Jabbour
- Open (def: scores for unspecified instrumentation)
- Digital devices
- 5 to 12 years of age
- 13 to 18 years of age
3-4 hours
- Education
Audiovisual Mismatch
Description
Picture a muted video of a person walking inside a house. Imagine what the footsteps might sound like going up creaky steps or slightly dragging on the floor. Turn up the sound and become completely disoriented as you hear footsteps walking in crunchy snow, birds and a symphony of frogs. Sound artist Guillaume Jabbour demonstrates how to use an iphone to shoot and edit a short video in iMovie and capture, edit and mix real sounds in GarageBand. The sounds are then synced with video to create a surreal experience. The process offers insight into how movie sound effects are made by Foley artists.
Materials: iPhone or iPad with Voice Memo, GarageBand and iMovie
Target Audience: 10 years old +
Group Size: individual or pairs
Introduction (15 min.)
-
Watch the sample videos below with music AND without music.
-
Discussion:
-
What do you notice? (e.g. the audio does not match the visual, sounds like snow, nature).
-
ADAPTATION: The discussion could be directed by asking “Complete these statements, “I see… I hear…”
-
-
How do you think this was done? (e.g. audio was made separately from video, everything was glued together after).
-
-
Watch the Foley Artists video below.
-
Discussion:
-
What does a Foley Artist do?
-
Step 1: Capturing and Editing the Video (30 – 60 min.)
-
Open the camera app on your iPad or iPhone. Choose Video.
-
Choose a location indoors where you can walk for at least 1 min. without interruption.
-
Use your device to film a short scene (1 min. max). You can film a longer scene later but for now, keep it short. Film your own legs if you are working alone or take turns filming each other walking.
-
Don’t worry if there is extra footage at the beginning and end of your video; you can trim that out afterwards.
-
Watch your video and answer these questions:
-
Does the video look good?
-
Is the lighting even? Is anything blown out (very bright and difficult to look at) or too dark?
-
Is the image steady or is there lots of unwanted movement?
-
-
Consider the answer to these questions and decide whether you need to reshoot your video or not to make it look as good as possible.
-
Once you are happy with the quality of your video, open the iMovie app, select new project > Movie > choose the video you just shot and click on the + sign to add it to your iMovie project.
-
Tap the video in your iMovie project and at the bottom Tap Detach to detach the audio. Remember, you will be overlaying a different audio track later.
-
When you see the separate audio track below your video, tap and hold down to select it and press the delete key or flick it towards the top of your screen to delete it.
-
Trim the video to the desired length, cutting out any unnecessary footage.
-
To remove parts of your video in the middle of the clip, place your cursor close to where you want to cut, tap the video region and choose the “Split” option. Then pull the little scissors down to split your clip into two regions. You can now trim out any unnecessary footage on either side of the split.
-
Click on the Gear to access settings and toggle the slider to add a Fade in and out to your video to make it look smoother.
-
Once you have decided on the final version of your video, you are ready to begin working on the audio.
Step 2: Capturing and Exporting the Audio (30 min.)
-
Open the Voice Memo app on your iPhone or iPad – this app allows you to record even if you leave the app to watch your iMovie video at the same time. This is important for syncing the audio with the visual.
-
Figure out where you will walk to create a dramatic mismatch with the video footage. Crunchy snow, leaves or shallow water are great options.
-
When you are ready, start recording in Voice Memo, then leave the app and open your iMovie project. Hit play in iMovie and follow the video so that the audio capture of your footsteps matches your video. Do this as many times as you need to, until you are happy.
-
Go back to the Voice Memo app and stop the recording.
-
Rename the file to a name that makes sense so that you can find it easily later on if necessary – e.g. Footsteps crunchy snow
-
From the filelist in Voice Memo, click and hold down on your file, click Share > Save File > GarageBand > GarageBand File Transfer.
-
This is how you will access your file in GarageBand so that you can mix the audio adding effects, panning, EQ and compression.
Step 3: Mixing the Audio (30 – 60 min.)
-
Open the GarageBand app, then tap new project > microphone
-
At the top right, tap the loops symbol
-
Tap Files > GarageBand File Transfer > drag the file you just exported to the Garageband workspace
-
Wear ear buds, air pods or headphones and use your ears to edit the track until you are happy.
-
Use Track Pan to send your audio signal to the left or right.
-
Use the EQ function to bring out the high, middle and low frequencies of your audio track.
-
Use the Compressor to reduce the difference between your loudest and quietest sounds.
-
Use Effects (Reverb, Echo) to enhance your track.
-
Once you are happy with your track, tap Projects at the top left, then rename your project to something that makes sense like before (e.g. AV Mismatch Footsteps). Then tap Done.
Step 4: Adding the Audio to the Video and Exporting (15 – 30 min.)
-
In Garageband, tap and hold down on your project then select Share > Song > High Quality > Share > Open in… (this may take a few moments as your project must be exported) > Tap Open in iMovie > Choose your iMovie project
-
You will now see the audio and video in the same project
-
Place the audio where you want it.
-
You can add other audio tracks using the same process
-
You can also use GarageBand to create music to use as a soundtrack for your video.
-
Tap Done.
-
Tap the Share arrow.
-
Decide how you want to export the file. A good option if you have access to a Macbook or iMac is to Air Drop the Movie file to that and watch it there. Once the movie file is on a computer, you can also upload it to your Youtube account.
Taking it Further
What other audiovisual mismatches can you imagine? Here are some examples:
-
Birds chirping during a scene of a spaceship landing on the moon
-
A lizard walking with footsteps that sound like piano keys
-
Sounds of springs and saws during a scene of a doctor examining a patient
Happy editing and have fun!
Read More +