How do we learn from virtual reality and games? What happens in our working memory? This video goes into detail about how we process that information. 3D Learning is a multisensory learning theory which explains how we learn through multiple channels in working memory.
How do we learn? How do we learn while doing? 3D Learning is a multisensory theory that examines how we learn through multiple channels in working memory. This video focuses on a task – learning a song on the guitar.
Please see video for more in-depth explanations: https://youtu.be/NUbf5hi1sP4
To cite this:
Pastore, R. (2019). 3D Learning. Retrieved from http:// http://raypastore.com/wordpress/2019/03/3d-learning/
Link to PDF version: http://raypastore.com/wordpress/wp-content/uploads/2019/03/3dLearning-1.pdf
1.0 What is 3D Learning?
- Theory that expands on prior 2D cognitive theories (i.e. theories that focused on text and images) to explain how we process content to learn in the real world through all domains (psychomotor/affective/cognitive), from games, experience, virtual reality, hand on activities, etc.
- Its organic – living and changing
- Research has only begun to scratch the surface
2.0 Background Framework
Atkinson & Shiffrin (1968) – Memory Theory/Information Processing
- Memory has 3 parts – sensory, short term, and long term.
- Information is first delivered to sensory memory. In this stage the learner decides how to handle the information or its forgotten
- Short term/Working Memory – This is where information is processed.
- Long term memory – indefinite storage capacity. Information can be stored here and retrieved for later use in working memory.
Miller (1956) – Working memory capacity
- Learners can hold 7 concepts, plus or minus 2, in working memory at one time depending on how meaningful they are
Baddeley & Hitch (1974) and Baddeley (2000) – Model of Working Memory
- Working memory/short term memory has a short duration and is controlled by the central executive. It has 2 channels, one for visual/spatial information and one for verbal information
Paivio (1979) and Paivio (1986) – Dual Coding Theory
Working memory is composed of two channels – verbal and nonverbal (visual). Each channel can function independently or they can work together to use information or store it in long term memory.
Mayer (2001) and Mayer (2005) – Cognitive Theory of Multimedia Learning (CTML)
- Expands on Baddeley and Paivio’s theories
- The CTML is based on three assumptions
- (1) working memory is made up of a dual modality (dual coding) input channel system,
- (2) there is a limited capacity in working memory, and
- (3) that learners engage in active processing.
- These are limited in scope – 2D – Only focused on verbal and visual information
- We still have people trying to use learning styles and multiple intelligences even though research does not support them because they seem to make ‘sense’ to people
- How does any of this account for real hands on learning? Gaming? Virtual reality? Where we use other means of learning besides images and words (narration).
- Much of our learning combines all domains of learning. Psychomotor and affective tasks require cognitive resources (i.e. are using in working memory). The domains of learning are great for instructional strategy development but do not help explain what happens in working memory.
So I started digging…
- One of the first surprising pieces of information I found was from Baddeley (2012). This really sent me down the rabbit’s hole. “…can other modalities such as smell and taste be added without impacting visual or verbal capacity? Are there separate subsystems for smell and taste?” (p. 23) (Baddeley 2012)
- Then I started finding things like this from Quak, et al (2015) who says that we tend to look at the way we process information in a stationary fashion, examining 1-2 channels at a time (i.e. text and images) whereas in real life we take on many at a time – hearing, smell, sight, taste, etc.
Then I started to look at the way we work, play games, use our senses…
- For example, when we play a video game we are using our ears, eyes, and hands. So I started looking at the biology of humans. Specifically focusing on the senses and found that biologists recognize many senses (20-30 or more) such as Visual, Auditory, Haptic/kinesthetic, Olfactory, etc. I was surprised, but yes, we have many other senses. More than the standard 5 many of us learned in grade school. For example, hunger and thirst. Our body has a lot of senses.
And just like that, I realized we have researched some of these other modalities, though that research was rare and scattered. For instance, Jonsson et al (2011, p.1023) state that examining how the senses (i.e. olfactory system) operate in working memory has “received almost no attention in the literature”. Here is a sample of what I found:
- Andrade and Donaldson (2007) conducted a series of experiments that found that there was a modality specific space in working memory for a learner’s olfactory system. These results were then again confirmed by Jonsson, et. al (2011).
- Lerch, Cui, Patwardhan, & Visell (2016) conducted an experiment which found that haptic information can be stored in working memory and has its own channel. Seaborn, Riecke & Antle 2010 found similar results.
- So we have some initial evidence that these senses have their own place in working memory! Now this makes sense. The research is aligned to what we really experience. This explains what is happening in working memory when we learn from games, virtual reality, and in the real world! Now I am excited!
4.0 What I realized is that we have been focusing on a very small piece to a very large puzzle!
- 3D Learning is a theory that expands on prior 2D cognitive theories (i.e. theories that focused on text and images) to explain how we process content to learn in the real world through all domains (psychomotor/affective/cognitive), from games, from experience, in virtual reality, from hand on activities, etc.
- Its organic – living and changing
- Research has only begun to scratch the surface
- The model:
- Multiple Input sources
- Multiple input sources – There are a number of input sources that humans experience. These include vision, hearing, feeling, doing, smelling, tasting and many more
- Sensory Memory
- Sensory memory is where we first experience the input and put it into working memory or dismiss it
- Working Memory
- Learners have/can process information through a number of channels in working memory (i.e. visual, verbal, haptic/kinesthetic, olfactory, and more)
- Learners can process multiple channels at the same time (can work together or independently from one another).
- No matter how many channels we have, we can still only store a limited # of concepts in working memory
- Training can improve each channel.
- Learners will have natural strengths and preferences for one channel vs another.
- Learners can work with prior knowledge from long term memory
- Long term Memory
- Long term memory is said to be indefinite
- Multiple Input sources
5.0 What’s next…
- We need to expand the multimedia principles…and probably should be calling them the principles of learning
- What are the other channels/how many?
- Olfactory, haptic/kinesthetic, taste, etc. How many do we have?
- What combinations work best? How many is too many?
- For example, using our eyes, ears, and hands. Is that too many? How does that impact cognitive load?
- This is especially crucial to the gaming literature as virtual reality starts to become more common for hands on training
Andrade J. & Donaldson L. (2007). Evidence for an olfactory store in working memory?
Psychologia, 50, 76-89.
Atkinson, R.C., and Shiffrin, R.M.(1968). Human memory: a proposed system and its control processes. Psychol. Learn. Motiv. 2, 89–195.doi:10.1016/s0079- 7421(08)60422-3
Baddeley, A.D., and Hitch, G.(1974).Working memory. Psychol. learn. Motiv. 8, 47–89. doi:10.1016/S0079-7421(08)60452-1
Baddeley, A. (2012). Working Memory: Theories, Models, and Controversies Annu. Rev. Psychol. 2012.63:1-29.
Baddeley, A. (2000). The episodic buffer: a new component of working memory? Trends in Cognitive Sciences, 4(11), 417-423.
Jonsson, F., Moller, P., & Olsson, M. (2011). Olfactory working memory: effects of verbalization. Memory and Cognition, 39, 1023-1032.
Lerch, R., Cui, H., Patwardhan, S., & Visell, Y. (2016). Exploring haptic working memory as a capacity-limited information channel. Presented at the IEEE Haptics Symposium Conference.
Mayer, R. E. (2001). Multimedia learning. New York: Cambridge University Press.
Mayer, R., E. (2005). Introduction to multimedia learning. In R. Mayer (Ed.), The cambridge handbook of multimedia (pp. 1-16). NY: Cambridge University Press.
Paivio, A. (1986). Mental representations. New York: Oxford University Press.
Paivio, A. (1971).Imagery and Verbal Processes, Holt, Rinehart, and Winston, New York (Reprinted 1979, Erlbaum, Hillsdale, New Jersey).
Quak, M., London, R., & Talsma, D. (2015). A multisensory perspective of working memory. Frontiers in Human Neuroscience. 9, 1-11.
Seaborn, Katie & Riecke, Bernhard & Antle, Alissa. (2010). Exploring the interplay of visual and haptic modalities in a pattern-matching task. Paper presented at the 2010 IEEE International Symposium on Haptic Audio Visual Environments and Games
Please see the video for more info:
Why hire an ID for training design? Does ID matter?
I created this guide to help my students write the first draft of their resume. Usually they come to me during their last year, hand me a draft of their resume, and I give them the same initial feedback over and over – and my feedback is usually significant. Once they get the basics down and they have a good working draft, we can start to customize it to highlight their skill set, but this video is the starting point:
I hear this all of the time and for the most part, I agree with. We all do in a sense. No its not your learning style. We know that learning styles are not real. Its not even your learning preference. Its much simpler than that…so why?
It all comes down to learning taxonomies; the order in which we learn. Doing, is a high order task – meaning when you are doing, you are problem solving, thinking critically. Its high level learning. Its our end goal – to be able to problem solve and use (transfer to new situations/jobs). So shouldn’t we just ‘do’ then and bypass other types of learning? Absolutely NOT! Let me explain…
If my end goal was for you to be able to build a car engine, I couldn’t just say ‘go build a car engine’. You couldn’t do it. This is is especially true for learners with little to no prior knowledge. How can I teach you how to build a car engine when you might not even know what a wrench is? You might not know what a spark plug is? You see, I first need to teach you basic information, think factual information where you learn definitions, learn to identify, etc. Once you learn that information, like what a wrench is and what a screw is, you can learn to use the wrench to turn the screw. Now we know how to use the wrench!
Next we learn how to use that wrench to build a section of an engine…but first we need to lean about all of those parts to the engine. You see, this is how we learn. First we learn the basic facts, then we start learn concepts and how to apply that information. Only then can we really start to do! And once we start doing, we start to really learn the ins and outs – problem solving/high level learning! So you see, its not that you learn by doing, you learn many different ways. Learning by doing is how we perceive learning ‘best’ but only because its high level learning.
See video where I explain this further:
This post is for my instructional technology students for Fall 18:
I have had several students ask me about buying a new computer and figured I would post to the group…
When I get a new computer I do one of two things…1) I get one that will last me 2 years or 2) one that will last me 4 years. Obviously the 4 yr one is much more expensive.
So my recommendations…
1. Get a student discount. All of the companies offer them. Now is a great time to get back to school deals.
2. Get a minimum of 12GB of Ram. Ram matters. If you are looking at a 4 yr machine I would really recommend as close to 32GB as you can get.
3. Video card matters. Try to get an upgraded video card if possible.
4. Ram is the first thing I upgrade, video card 2nd, processor 3rd. In that order. I don’t worry about hard drive space at all as I use the cloud to store my files. I don’t worry about other features either except for making sure they have enough ports and an HDMI port.
5. I would get a PC over a Mac. Macs are great and work really well but there is one piece of software instructional designers use and there still isn’t a mac version, this is called articulate. But if you like Macs they are fine I just prefer PCs for many reasons. Chromebook, ipads, etc won’t cut it, you need a real machine.
6. As far as brands, they are all fine for the most part. I prefer Alienware and Dell since that is what I have used over the last few years. I currently have an alienware R17 with max upgrades. I like alienware because they already come with upgraded video cards that you won’t even have an option for with a standard machine. A lot of them are VR Ready.In fact, the only machine in the college of education that runs VR is mine. None of the others will do it.
7. Get a warranty. Get a warranty for as long as you want to keep the machine. Its worth it. I cannot tell you how many machines I have went through. I have had Macs die. I have had PC die. Many times. Just get the warranty. I think I have a 4 yr warranty on my current machine.
If you have other questions, please feel free to ask. – Dr. Pastore