The effect of perceptual interference on prioritization of feature dimensions in visual working memory

Magnetoencephalography Responses to Unpredictable and Predictable Rare Somatosensory Stimuli in Healthy Adult Humans

Mismatch brain responses to unpredicted rare stimuli are suggested to be a neural indicator of prediction error, but this has rarely been studied in the somatosensory modality. Here, we investigated how the brain responds to unpredictable and predictable rare events. Magnetoencephalography responses were measured in adults frequently presented with somatosensory stimuli (FRE) that were occasionally replaced by two consecutively presented rare stimuli [unpredictable rare stimulus (UR) and predictable rare stimulus (PR); p = 0.1 for each]. The FRE and PR were electrical stimulations administered to either the little finger or the forefinger in a counterbalanced manner between the two conditio…

The Bandwidth of VWM Consolidation Varies With the Stimulus Feature: Evidence From Event-Related Potentials

Our previous work suggests that 2 colors can be consolidated into visual short-term memory (VSTM) in parallel without a loss of memory precision, whereas consolidation of 2 orientations is performed in a strictly serial manner. Those experiments compared VSTM performance for simultaneously and sequentially presented stimuli. However, there is still controversy about whether the bandwidth for consolidation is determined by the type of information. To further investigate this issue, here we measured electroencephalography while participants attempted to consolidate 1, 2 or 4 simultaneously presented colors (Experiment 1) or orientations (Experiment 2) under limited presentation times. We used…

视觉工作记忆中回溯线索效应的影响因素 [The Influencing Factors of Retro-Cue Effect in Visual Working Memory]

The visual working memory is a temporary storage system, which encodes, maintains and retrieves visual information. The researchers have found that adding retro-cues to the maintenance phase of memory leads to changes in participants’ memory performance, which is the retro-cue effect. The magnitude of the retro-cue effect is not set in stone, but changes with the changes of its influencing factors. However, there is no study to summarize the influencing factors of the retro-clue effect. This paper looked into the articles related to the study of the retro-cue effect and summarized the influencing factors of the retro-cue effect: memory items, maintenance interval time, interference in maint…

Strategic inhibition of distractors with visual working memory contents after involuntary attention capture

AbstractPrevious research has suggested that visual working memory (VWM) contents had a guiding effect on selective attention, and once participants realized that the distractors shared the same information with VWM contents in the search task, they would strategically inhibit the potential distractors with VWM contents. However, previous behavioral studies could not reveal the way how distractors with VWM contents are inhibited strategically. By employing the eye-tracking technique and a dual-task paradigm, we manipulated the probability of memory items occurring as distractors to explore this issue. Consistent with previous behavioral studies, the results showed that the inhibitory effect…

Negative emotional state modulates visual working memory in the late consolidation phase

Although a considerable literature has grown up around the interactions between emotional state and visual working memory (VWM) performance, the mechanism underlying the impact of the negative emotional state on VWM remains unclear. The present study aimed to test whether the influence of emotional state is related to the early phase or late phase of VWM consolidation process. Across three experiments, we found that the negative emotional state did not affect VWM performance when the presentation time of stimuli was short. However, when the presentation time was long, the negative emotional state increased the VWM precision and reduced the VWM number. According to the two-phase model propos…

Encoding specificity instead of online integration of real-world spatial regularities for objects in working memory

Most objects show high degrees of spatial regularity (e.g. beach umbrellas appear above, not under, beach chairs). The spatial regularities of real-world objects benefit visual working memory (VWM), but the mechanisms behind this spatial regularity effect remain unclear. The "encoding specificity" hypothesis suggests that spatial regularity will enhance the visual encoding process but will not facilitate the integration of information online during VWM maintenance. The "perception-alike" hypothesis suggests that spatial regularity will function in both visual encoding and online integration during VWM maintenance. We investigated whether VWM integrates sequentially presented real-world obje…

Retro-dimension-cue benefit in visual working memory

AbstractIn visual working memory (VWM) tasks, participants’ performance can be improved by a retro-object-cue. However, previous studies have not investigated whether participants’ performance can also be improved by a retro-dimension-cue. Three experiments investigated this issue. We used a recall task with a retro-dimension-cue in all experiments. In Experiment 1, we found benefits from retro-dimension-cues compared to neutral cues. This retro-dimension-cue benefit is reflected in an increased probability of reporting the target, but not in the probability of reporting the non-target, as well as increased precision with which this item is remembered. Experiment 2 replicated the retro-dime…

不同情绪面孔的视觉工作记忆表现差异 [The Performance Difference of Visual Working Memory between Various Emotional Faces]

Among social-emotional stimuli, emotional faces occupy an important position, which specifically refer to human faces with certain facial expressions. The visual working memory is a limited workspace where information can be saved online and can be accessed and operated by advanced cognitive function during the maintenance period. A large number of behavioral and electrophysiological studies have shown that there are differences in visual working memory performance of different emotional faces. Specifically, angry faces can enhance the visual working memory performance; fearful faces may cause some damage to visual working memory; sad faces will impair face recognition encoding in visual wo…

The bilateral field advantage effect in memory precision.

Previous research has demonstrated that visual working memory performance is better when visual items are allocated in both left and right visual fields than within only one hemifield. This phenomenon is called the bilateral field advantage (BFA). The BFA is thought to be driven by an enhanced probability of storage, rather than by greater precision. In the present experiments, we sought to test whether the BFA can also extend to precision when the parameters of the task are modified. Using a moderate number of to-be-remembered items and 400 ms presentation time, we found better precision in the bilateral condition than in the unilateral condition. The classic BFA was still found in the for…

The inhibitory effect of long-term associative representation on working memory

Studies on how long-term memory affects working memory (WM) have found that long-term memory can enhance WM processing. However, these studies only use item memory as the representation of long-term memory. In addition to item memory, associative memory is also an essential part of long-term memory. The associative memory and item memory involve different cognitive mechanisms and brain areas. The purpose of the present study was to investigate how associative memory affects WM processing. Before the WM task, participants were asked to store 16 pairs of dissimilar pictures into long-term memory. The participants would obtain the associative memory of these pairs of pictures in the long-term …

Electrophysiological evidence supports the role of sustained visuospatial attention in maintaining visual WM contents

Recent empirical and theoretical work suggests that there is a close relationship between visual working memory (WM) and visuospatial attention. Here, we investigated whether visuospatial attention was involved in maintaining object representations in visual WM. To this end, the alpha lateralization and contralateral delay activity (CDA) were analyzed as neural markers for visuospatial attention and visual WM storage, respectively. In the single-task condition, participants performed a grating change-detection task. To probe the role of visuospatial attention in maintaining WM contents, two color squares were presented above and below the fixation point during the retention interval, which …

Interval between two sequential arrays determines their storage state in visual working memory.

AbstractThe visual information can be stored as either “active” representations in the active state or “activity-silent” representations in the passive state during the retention period in visual working memory (VWM). Catering to the dynamic nature of visual world, we explored how the temporally dynamic visual input was stored in VWM. In the current study, the memory arrays were presented sequentially, and the contralateral delay activity (CDA), an electrophysiological measure, was used to identify whether the memory representations were transferred into the passive state. Participants were instructed to encode two sequential arrays and retrieve them respectively, with two conditions of int…

Negative emotional state modulates visual working memory in the late consolidation phase

Although a considerable literature has grown up around the interactions between emotional state and visual working memory (VWM) performance, the mechanism underlying the impact of the negative emotional state on VWM remains unclear. The present study aimed to test whether the influence of emotional state is related to the early phase or late phase of VWM consolidation process. Across three experiments, we found that the negative emotional state did not affect VWM performance when the presentation time of stimuli was short. However, when the presentation time was long, the negative emotional state increased the VWM precision and reduced the VWM number. According to the two-phase model propos…

Individual differences in working memory capacity are unrelated to the magnitudes of retrocue benefits

AbstractPrevious studies have associated visual working memory (VWM) capacity with the use of internal attention. Retrocues, which direct internal attention to a particular object or feature dimension, can improve VWM performance (i.e., retrocue benefit, RCB). However, so far, no study has investigated the relationship between VWM capacity and the magnitudes of RCBs obtained from object-based and dimension-based retrocues. The present study explored individual differences in the magnitudes of object- and dimension-based RCBs and their relationships with VWM capacity. Participants completed a VWM capacity measurement, an object-based cue task, and a dimension-based cue task. We confirmed tha…

Pain modulates early sensory brain responses to task‐irrelevant emotional faces

Background Pain can have a significant impact on an individual's life, as it has both cognitive and affective consequences. However, our understanding of how pain affects social cognition is limited. Previous studies have shown that pain, as an alarm stimulus, can disrupt cognitive processing when focal attention is required, but whether pain also affects task-irrelevant perceptual processing is unclear. Methods We examined the effect of laboratory-induced pain on event-related potentials (ERPs) to neutral, sad, and happy faces before, during, and after a cold pressor pain. ERPs reflecting different stages of visual processing (P1, N170, and P2) were analyzed. Results Pain decreased the P1 …

内部注意在维度层面对视觉工作记忆的影响

Visual working memory is a memory system with limited capacity, thus internal attention plays a crucial role in selecting, controlling, and maintaining its stored content. Retro-cues are an important tool to study the influence of internal attention on visual working memory. Retro-cues are an important paradigm for studying the influence of internal attention on visual working memory. Depending on the different content of the cue, it can be divided into object-based retro-cue and dimension-based retro-cue and there are significant differences between them. The emergence of dimension-based retro-cue in recent years has become one of the hot topics of research. There are articles summarizing …

Event-Related Potentials to Changes in Sound Intensity Demonstrate Alterations in Brain Function Related to Depression and Aging

Measures of the brain’s automatic electrophysiological responses to sounds represent a potential tool for identifying age- and depression-related neural markers. However, these markers have rarely been studied related to aging and depression within one study. Here, we investigated auditory event-related potentials (ERPs) in the brain that may show different alterations related to aging and depression. We used an oddball condition employing changes in sound intensity to investigate: (i) sound intensity dependence; (ii) sensory gating; and (iii) change detection, all within a single paradigm. The ERPs of younger (18–40 years) and older (62–80 years) depressed female participants and age-match…

视觉工作记忆存储的表征单位 [The Representation Unit of Visual Working Memory]

The visual working memory is a limited storage system in which people could flexibly process the representations to complete the task. Among studies on the capacity of visual working memory, the representation unit is a prior subject. Previous research employs the change-detection paradigm and the recall paradigm to explore the nature of representations when features of diverse dimensions and different-level features of the same dimension are stored in the visual working memory. These studies elicit two binary hypotheses: the object-based representation hypothesis backs that those diverse features are bound on the object and form a whole, while the feature-based representation hypothesis su…

Visual working memory resource allocation mechanism in consolidation and maintenance phase

Visual working memory (VWM) is a system for actively maintaining visual information to meet the needs of an ongoing task. It allows individuals to store visual input information from a complex outside environment and provides storage space as an information buffer platform to help integrate information into a continuous visual experience. This research examined the consolidation and maintenance phase of the VWM resource allocation mechanism. Four aspects of this issue were investigated. First, resource allocation in VWM consolidation was investigated for different materials, and it was determined whether VWM resources were allocated in a serial manner for orientation materials but in a limi…

The impact of visual working memory capacity on the filtering efficiency of emotional face distractors.

Emotional faces can serve as distractors for visual working memory (VWM) tasks. An event-related potential called contralateral delay activity (CDA) can measure the filtering efficiency of face distractors. Previous studies have investigated the influence of VWM capacity on filtering efficiency of simple neutral distractors but not of face distractors. We measured the CDA indicative of emotional face filtering during a VWM task related to facial identity. VWM capacity was measured in a separate colour change detection task, and participants were divided to high- and low-capacity groups. The high-capacity group was able to filter out distractors similarly irrespective of its facial emotion. …

The passive state: A protective mechanism for information in working memory tasks.

Memory representations can be stored in a passive state in a visual working memory (VWM) task. However, it remains unclear whether the representations stored in the passive state are prone to interference and decay. To explore this issue, we asked participants to successively remember two sets of memory items (M1 and M2) in three test manners: a combined test (both M1 and M2 are probed simultaneously), a backward test (probe M2 first and M1 second), or a forward test (probe M1 first and M2 second). We found that the contralateral delay activity (CDA) amplitude after the onset of M2 only tracked M2 independently of M1 in the two separate tests (Experiments 1-3), and the accuracy of M1 was we…

Perceptual boost of stimulus memorability on visual short-term memory formation

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms.

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect…

Negative and Positive Bias for Emotional Faces: Evidence from the Attention and Working Memory Paradigms

Visual attention and visual working memory (VWM) are two major cognitive functions in humans, and they have much in common. A growing body of research has investigated the effect of emotional information on visual attention and VWM. Interestingly, contradictory findings have supported both a negative bias and a positive bias toward emotional faces (e.g., angry faces or happy faces) in the attention and VWM fields. We found that the classical paradigms—that is, the visual search paradigm in attention and the change detection paradigm in VWM—are considerably similar. The settings of these paradigms could therefore be responsible for the contradictory results. In this paper, we compare previou…

Discovering dynamic task-modulated functional networks with specific spectral modes using MEG.

Efficient neuronal communication between brain regions through oscillatory synchronization at certain frequencies is necessary for cognition. Such synchronized networks are transient and dynamic, established on the timescale of milliseconds in order to support ongoing cognitive operations. However, few studies characterizing dynamic electrophysiological brain networks have simultaneously accounted for temporal non-stationarity, spectral structure, and spatial properties. Here, we propose an analysis framework for characterizing the large-scale phase-coupling network dynamics during task performance using magnetoencephalography (MEG). We exploit the high spatiotemporal resolution of MEG to m…

Alterations in working memory maintenance of fearful face distractors in depressed participants : An ERP study

Task-irrelevant threatening faces (e.g., fearful) are difficult to filter from visual working memory (VWM), but the difficulty in filtering non-threatening negative faces (e.g., sad) is not known. Depressive symptoms could also potentially affect the ability to filter different emotional faces. We tested the filtering of task-irrelevant sad and fearful faces by depressed and control participants performing a color-change detection task. The VWM storage of distractors was indicated by contralateral delay activity, a specific event-related potential index for the number of objects stored in VWM during the maintenance phase. The control group did not store sad face distractors, but they automa…

Limitations of concurrently representing objects within view and in visual working memory

AbstractRepresenting visibly present stimuli is as limited in capacity as representing invisible stimuli in visual working memory (WM). In this study, we explored whether concurrently representing stimuli within view affects representing objects in visual WM, and if so, whether this effect is modulated by the storage states (active and silent state) of memory contents? In experiment 1, participants were asked to perform the change-detect task in a simultaneous-representing condition in which WM content and the continuously-visible stimuli in view were simultaneously represented, as well as a baseline condition in which only the representations of visual WM content were maintained. The resul…

The two-stage process in visual working memory consolidation

AbstractTwo hypotheses have been proposed to explain the formation manner for visual working memory (VWM) representations during the consolidation process: an all-or-none process hypothesis and a coarse-to-fine process hypothesis. However, neither the all-or-none process hypothesis nor the coarse-to-fine process hypothesis can stipulate clearly how VWM representations are formed during the consolidation process. In the current study, we propose a two-stage process hypothesis to reconcile these hypotheses. The two-stage process hypothesis suggests that the consolidation of coarse information is an all-or-none process in the early consolidation stage, while the consolidation of detailed infor…

A Two-Phase Model of Resource Allocation in Visual Working Memory

Two broad theories of visual working memory (VWM) storage have emerged from current research, a discrete slot-based theory and a continuous resource theory. However, neither the discrete slot-based theory or continuous resource theory clearly stipulates how the mental commodity for VWM (discrete slot or continuous resource) is allocated. Allocation may be based on the number of items via stimulus-driven factors, or it may be based on task demands via voluntary control. Previous studies have obtained conflicting results regarding the automaticity versus controllability of such allocation. In the current study, we propose a two-phase allocation model, in which the mental commodity could be al…

Sustained attention required for effective dimension-based retro-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants’ performances can be improved through the use of dimension-based retro-cues, which direct internal attention to prioritize a particular dimension (e.g., color or orientation) of VWM representations even after the stimuli disappear. This phenomenon is known as the dimension-based retro-cue benefit (RCB). The present study investigates whether sustained attention is required for the dimension-based RCB by inserting interference or interruption between the retro-cue and the test array to distract attention. We tested the effects of perceptual interference or cognitive interruption on dimension-based RCB when the interference (Experiments 1 and…

Sad and fearful face distractors do not consume working memory resources in depressed adults

Previous studies have shown that task-irrelevant threatening faces (e.g., fearful faces) are difficult to filter from visual working memory (VWM; Stout et al., 2013). What is not known, however, is whether non-threatening negative faces (e.g., sad faces) are also difficult to filter and whether depressive symptoms affect filtering ability. We used a color-change detection task to test whether task-irrelevant sad and fearful face distractors could be filtered by healthy participants and by depressed participants. The groups differed in their filtering ability, as indicated by the contralateral delay activity, a specific ERP index for the number of objects stored in the VWM during the mainten…

Negative emotion reduces visual working memory recall variability: A meta-analytical review.

Negative emotion is often hypothesized to trigger a more deliberate processing mode. This effect can manifest as increased precision of information maintained in working memory (WM) captured by reduced WM recall variability under an induced negative emotional state. However, some recent evidence shows that WM representations are immune to any emotional influences. Here, we meta-analyze existing evidence based on data from 13 experiments across 491 participants who performed a delay-estimation WM task under negative and neutral emotional states. We find that induced negative emotional state modestly reduces WM recall variability and increases recall failures relative to the neutral condition…

Decreased intersubject synchrony in dynamic valence ratings of sad movie contents in dysphoric individuals

Emotional reactions to movies are typically similar between people. However, depressive symptoms decrease synchrony in brain responses. Less is known about the effect of depressive symptoms on intersubject synchrony in conscious stimulus-related processing. In this study, we presented amusing, sad and fearful movie clips to dysphoric individuals (those with elevated depressive symptoms) and control participants to dynamically rate the clips’ valences (positive vs. negative). We analysed both the valence ratings’ mean values and intersubject correlation (ISC). We used electrodermal activity (EDA) to complement the measurement in a separate session. There were no group differences in either t…

Individual Differences in Working Memory Capacity Are Unrelated to the Magnitude of Benefits from Object- and Dimension-Based Retro-Cues

Automatic Processing of Changes in Facial Emotions in Dysphoria: A Magnetoencephalography Study

It is not known to what extent the automatic encoding and change detection of peripherally presented facial emotion is altered in dysphoria. The negative bias in automatic face processing in particular has rarely been studied. We used magnetoencephalography (MEG) to record automatic brain responses to happy and sad faces in dysphoric (Beck’s Depression Inventory ≥ 13) and control participants. Stimuli were presented in a passive oddball condition, which allowed potential negative bias in dysphoria at different stages of face processing (M100, M170, and M300) and alterations of change detection (visual mismatch negativity, vMMN) to be investigated. The magnetic counterpart of the vMMN was el…

The mechanism of retro-cue effect in visual working memory : Cognitive phase separation

Retro-cue effect (RCE) refers to the phenomenon that individuals can use retro-cues to improve their visual working memory (VWM) performance of target items after memory stimuli disappear. To explain the mechanism of RCE in VWM, five different hypotheses have been proposed by previous studies: the hypothesis of enhancing target representations, the hypothesis of forgetting non-target representations, the hypothesis of preventing memory degradation, the hypothesis of preventing interference from probe array and the hypothesis of cognitive phase separation. Although RCE has been repeatedly observed in previous studies, the mechanism of RCE remains unclear. In this study, we conducted three ex…

Electrophysiological Correlates of Change Detection during Delayed Matching Task: A Comparison of Different References

Detecting the changed information between memory representation and incoming sensory inputs is a fundamental cognitive ability. By offering the promise of excellent temporal resolution, event-related potential (ERP) technique has served as a primary tool for studying this process with reference of the linked mastoid (LM). However, given that LM may distort the ERP signals, it is still undetermined whether LM is the best reference choice. The goal of the current study was to systematically compare LM, reference electrode standardization technique (REST) and average reference (AR) for assessing the ERP correlates of change detection during a delayed matching task. Colored shapes were adopted …

Working memory capacity affects trade-off between quality and quantity only when stimulus exposure duration is sufficient : Evidence for the two-phase model

AbstractThe relation between visual working memory (VWM) capacity and attention has attracted much interest. In this study, we investigated the correlation between the participants’ VWM capacity and their ability to voluntarily trade off the precision and number of items remembered. The two-phase resource allocation model proposed by Ye et al. (2017) suggests that for a given set size, it takes a certain amount of consolidation time for an individual to control attention to adjust the VWM resources to trade off the precision and number. To verify whether trade-off ability varies across VWM capacity, we measured each individual’s VWM capacity and then conducted a colour recall task to examin…

视觉工作记忆中数量和精度的权衡关系是否受个体自发控制

There is a negative correlation between the quality and quantity of memory representations in visual working memory, and this negative correlation is seen as a trade-off between quantity and quality. However, it is unclear whether this trade-off is entirely stimulus-driven or can be controlled voluntarily by individuals according to task demands, which has led to a debate on the mechanism of memory resource allocation. This paper systematically reviews the development of research on whether the trade-off between quantity and quality is subject to individual voluntary control, and point out this voluntary control is influenced by the exposure duration and working memory capacity, and some su…

Individual Differences in Working Memory Capacity Are Unrelated to the Magnitude of Benefits from Object- and Dimension-Based Retro-Cues