Deep brain stimulation (DBS) of the subcallosal cingulate (SCC) can provide long-term symptom relief for treatment-resistant depression (TRD). However, achieving stable recovery is unpredictable, typically requiring trial-and-error stimulation adjustments due to individual recovery trajectories and subjective symptom reporting. We currently lack objective brain-based biomarkers to guide clinical decisions by distinguishing natural transient mood fluctuations from situations requiring intervention. To address this gap, we used a new device enabling electrophysiology recording to deliver SCC DBS to ten TRD participants (ClinicalTrials.gov identifier NCT01984710). At the study endpoint of 24 weeks, 90% of participants demonstrated robust clinical response, and 70% achieved remission. Using SCC local field potentials available from six participants, we deployed an explainable artificial intelligence approach to identify SCC local field potential changes indicating the patient's current clinical state. This biomarker is distinct from transient stimulation effects, sensitive to therapeutic adjustments and accurate at capturing individual recovery states. Variable recovery trajectories are predicted by the degree of preoperative damage to the structural integrity and functional connectivity within the targeted white matter treatment network, and are matched by objective facial expression changes detected using data-driven video analysis. Our results demonstrate the utility of objective biomarkers in the management of personalized SCC DBS and provide new insight into the relationship between multifaceted (functional, anatomical and behavioural) features of TRD pathology, motivating further research into causes of variability in depression treatment. <<<

Human social networks are overwhelmingly homophilous: individuals tend to befriend others who are similar to them in terms of a range of physical attributes (e.g., age, gender). Do similarities among friends reflect deeper similarities in how we perceive, interpret, and respond to the world? To test whether friendship, and more generally, social network proximity, is associated with increased similarity of real-time mental responding, we used functional magnetic resonance imaging to scan subjects' brains during free viewing of naturalistic movies. Here we show evidence for neural homophily: neural responses when viewing audiovisual movies are exceptionally similar among friends, and that similarity decreases with increasing distance in a real-world social network. These results suggest that we are exceptionally similar to our friends in how we perceive and respond to the world around us, which has implications for interpersonal influence and attraction. <<<

Experiences need to be tagged during learning for further consolidation. However, neurophysiological mechanisms that select experiences for lasting memory are not known. By combining large-scale neural recordings in mice with dimensionality reduction techniques, we observed that successive maze traversals were tracked by continuously drifting populations of neurons, providing neuronal signatures of both places visited and events encountered. When the brain state changed during reward consumption, sharp wave ripples (SPW-Rs) occurred on some trials, and their specific spike content decoded the trial blocks that surrounded them. During postexperience sleep, SPW-Rs continued to replay those trial blocks that were reactivated most frequently during waking SPW-Rs. Replay content of awake SPW-Rs may thus provide a neurophysiological tagging mechanism to select aspects of experience that are preserved and consolidated for future use. <<<

<p>A defining characteristic of social complexity in Homo sapiens is the diversity of our relationships. We build various types of connections with people in families, schools, workplaces, neighborhoods, and online communities. How do we make sense of such complex systems of human relationships? By using natural language processing, online surveys, laboratory cognitive tasks, and computational modelling on diverse modern cultures across the world (n = 20,425) and ancient cultures across 3,000 years of history, we discovered a universal representational space of relationship concepts, comprised of five principal dimensions (formality, activeness, valence, exchange, equality) and three core categories (hostile, public and private relationships). Our work reveals the fundamental cognitive constructs and cultural principles of relationship knowledge and advances our understanding of human sociality.</p> <<<

Recent studies found that the deep convolutional neural networks (DCNNs) trained to recognize facial identities spontaneously learned features that support facial expression recognition, and vice versa. Here, we showed that the self-emerged expression-selective units in a VGG-Face trained for facial identification were tuned to distinct basic expressions and, importantly, exhibited hallmarks of human expression recognition (i.e., facial expression confusion and categorical perception). We then investigated whether the emergence of expression-selective units is attributed to either face-specific experience or domain-general processing by conducting the same analysis on a VGG-16 trained for object classification and an untrained VGG-Face without any visual experience, both having the identical architecture with the pretrained VGG-Face. Although similar expression-selective units were found in both DCNNs, they did not exhibit reliable human-like characteristics of facial expression perception. Together, these findings revealed the necessity of domain-specific visual experience of face identity for the development of facial expression perception, highlighting the contribution of nurture to form human-like facial expression perception. <<<

Episodic memory arises as a function of dynamic interactions between the hippocampus and the neocortex, yet the mechanisms have remained elusive. Here, using human intracranial recordings during a mnemonic discrimination task, we report that 4-5 Hz (theta) power is differentially recruited during discrimination vs. overgeneralization, and its phase supports hippocampal-neocortical when memories are being formed and correctly retrieved. Interactions were largely bidirectional, with small but significant net directional biases; a hippocampus-to-neocortex bias during acquisition of new information that was subsequently correctly discriminated, and a neocortex-to-hippocampus bias during accurate discrimination of new stimuli from similar previously learned stimuli. The 4-5 Hz rhythm may facilitate the initial stages of information acquisition by neocortex during learning and the recall of stored information from cortex during retrieval. Future work should further probe these dynamics across different types of tasks and stimuli and computational models may need to be expanded accordingly to accommodate these findings. <<<

Time and space are primary dimensions of human experience. Separate lines of investigation have identified neural correlates of time and space, yet little is known about how these representations converge during self-guided experience. Here, 10 subjects with intracranially implanted microelectrodes play a timed, virtual navigation game featuring object search and retrieval tasks separated by fixed delays. Time cells and place cells activate in parallel during timed navigation intervals, whereas a separate time cell sequence spans inter-task delays. The prevalence, firing rates, and behavioral coding strengths of time cells and place cells are indistinguishable-yet time cells selectively remap between search and retrieval tasks, while place cell responses remain stable. Thus, the brain can represent time and space as overlapping but dissociable dimensions. Time cells and place cells may constitute a biological basis for the cognitive map of spatiotemporal context onto which memories are written. <<<

Deep convolutional neural networks (DCNNs) trained for face identification can rival and even exceed human-level performance. The ways in which the internal face representations in DCNNs relate to human cognitive representations and brain activity are not well understood. Nearly all previous studies focused on static face image processing with rapid display times and ignored the processing of naturalistic, dynamic information. To address this gap, we developed the largest naturalistic dynamic face stimulus set in human neuroimaging research (700+ naturalistic video clips of unfamiliar faces). We used this naturalistic dataset to compare representational geometries estimated from DCNNs, behavioral responses, and brain responses. We found that DCNN representational geometries were consistent across architectures, cognitive representational geometries were consistent across raters in a behavioral arrangement task, and neural representational geometries in face areas were consistent across brains. Representational geometries in late, fully connected DCNN layers, which are optimized for individuation, were much more weakly correlated with cognitive and neural geometries than were geometries in late-intermediate layers. The late-intermediate face-DCNN layers successfully matched cognitive representational geometries, as measured with a behavioral arrangement task that primarily reflected categorical attributes, and correlated with neural representational geometries in known face-selective topographies. Our study suggests that current DCNNs successfully capture neural cognitive processes for categorical attributes of faces but less accurately capture individuation and dynamic features. <<<

Episodic memory, the ability to consciously recollect information and its context, varies substantially among individuals. While prior fMRI studies have identified certain brain regions linked to successful memory encoding at a group level, their role in explaining individual memory differences remains largely unexplored. Here, we analyze fMRI data of 1,498 adults participating in a picture encoding task in a single MRI scanner. We find that individual differences in responsivity of the hippocampus, orbitofrontal cortex, and posterior cingulate cortex account for individual variability in episodic memory performance. While these regions also emerge in our group-level analysis, other regions, predominantly within the lateral occipital cortex, are related to successful memory encoding but not to individual memory variation. Furthermore, our network-based approach reveals a link between the responsivity of nine functional connectivity networks and individual memory variability. Our work provides insights into the neurofunctional correlates of individual differences in visual episodic memory performance. <<<

Events associated with aversive or rewarding outcomes are prioritized in memory. This memory boost is commonly attributed to the elicited affective response, closely linked to noradrenergic and dopaminergic modulation of hippocampal plasticity. Herein we review and compare this 'affect' mechanism to an additional, recently discovered, 'prediction' mechanism whereby memories are strengthened by the extent to which outcomes deviate from expectations, that is, by prediction errors (PEs). The mnemonic impact of PEs is separate from the affective outcome itself and has a distinct neural signature. While both routes enhance memory, these mechanisms are linked to different - and sometimes opposing - predictions for memory integration. We discuss new findings that highlight mechanisms by which emotional events strengthen, integrate, and segment memory. <<<

Stress influences episodic memory formation via noradrenaline and glucocorticoid effects on amygdala and hippocampus. A common finding is the improvement of memory for central aspects of a stressful episode. This is putatively related to changes in the neural representations of specific experiences, i.e., their memory traces. Here we show that the memory improvement for objects that were encountered in a stressful episode relates to differences in the neural representations of these objects in the amygdala. Using functional magnetic resonance imaging, we found that stress specifically altered the representations of central objects: compared to control objects, they became more similar to one another and more distinct from objects that were not part of this episode. Furthermore, higher similarity of central objects to the main stressor-the faces of the stress-inducing committee members-predicted better memory. This suggests that the central objects were closely integrated into a stressor-centered memory representation. Our findings provide mechanistic insights into how stress shapes the memory trace and have profound implications for neurocognitive models of stressful and emotional memory. <<<

Grid cells in the entorhinal cortex of freely moving rats provide a strikingly periodic representation of self-location which is indicative of very specific computational mechanisms. However, the existence of grid cells in humans and their distribution throughout the brain are unknown. Here we show that the preferred firing directions of directionally modulated grid cells in rat entorhinal cortex are aligned with the grids, and that the spatial organization of grid-cell firing is more strongly apparent at faster than slower running speeds. Because the grids are also aligned with each other, we predicted a macroscopic signal visible to functional magnetic resonance imaging (fMRI) in humans. We then looked for this signal as participants explored a virtual reality environment, mimicking the rats' foraging task: fMRI activation and adaptation showing a speed-modulated six-fold rotational symmetry in running direction. The signal was found in a network of entorhinal/subicular, posterior and medial parietal, lateral temporal and medial prefrontal areas. The effect was strongest in right entorhinal cortex, and the coherence of the directional signal across entorhinal cortex correlated with spatial memory performance. Our study illustrates the potential power of combining single-unit electrophysiology with fMRI in systems neuroscience. Our results provide evidence for grid-cell-like representations in humans, and implicate a specific type of neural representation in a network of regions which supports spatial cognition and also autobiographical memory. <<<

Recent neuroimaging evidence challenges the classical view that face identity and facial expression are processed by segregated neural pathways, showing that information about identity and expression are encoded within common brain regions. This article tests the hypothesis that integrated representations of identity and expression arise spontaneously within deep neural networks. A subset of the CelebA dataset is used to train a deep convolutional neural network (DCNN) to label face identity (chance = 0.06%, accuracy = 26.5%), and the FER2013 dataset is used to train a DCNN to label facial expression (chance = 14.2%, accuracy = 63.5%). The identity-trained and expression-trained networks each successfully transfer to labeling both face identity and facial expression on the Karolinska Directed Emotional Faces dataset. This study demonstrates that DCNNs trained to recognize face identity and DCNNs trained to recognize facial expression spontaneously develop representations of facial expression and face identity, respectively. Furthermore, a congruence coefficient analysis reveals that features distinguishing between identities and features distinguishing between expressions become increasingly orthogonal from layer to layer, suggesting that deep neural networks disentangle representational subspaces corresponding to different sources. <<<

The amygdala is assumed to contribute to a bottom-up attentional bias during visual processing of emotional faces. Still, how its response to emotion interacts with top-down attention is not fully understood. It is also unclear if amygdala activity and scalp EEG respond to emotion and attention in a similar way. Therefore, we studied the interaction of emotion and attention during face processing in oscillatory gamma-band activity (GBA) in the amygdala and on the scalp. Amygdala signals were recorded via intracranial EEG (iEEG) in 9 patients with epilepsy. Scalp recordings were collected from 19 healthy participants. Three randomized blocks of angry, neutral, and happy faces were presented, and either negative, neutral, or positive expressions were denoted as targets. Both groups detected happy faces fastest and most accurately. In the amygdala, the earliest effect was observed around 170 ms in high GBA (105-117.5 Hz) when neutral faces served as targets. Here, GBA was higher for emotional than neutral faces. During attention to negative faces, low GBA (< 90 Hz) increased specifically for angry faces both in the amygdala and over posterior scalp regions, albeit earlier on the scalp (60 ms) than in the amygdala (210 ms). From 570 ms, amygdala high GBA (117.5-145 Hz) was also increased for both angry and neutral, compared to happy, faces. When positive faces were the targets, GBA did not differentiate between expressions. The present data reveal that attention-independent emotion detection in amygdala high GBA may only occur during a neutral focus of attention. Top-down threat vigilance coordinates widespread low GBA, biasing stimulus processing in favor of negative faces. These results are in line with a multi-pathway model of emotion processing and help specify the role of GBA in this process by revealing how attentional focus can tune timing and amplitude of emotional GBA responses. <<<

Pattern separation, or the process by which highly similar stimuli or experiences in memory are represented by non-overlapping neural ensembles, has typically been ascribed to processes supported by the hippocampus. Converging evidence from a wide range of studies, however, suggests that pattern separation is a multistage process supported by a network of brain regions. Based on this evidence, considered together with related findings from the interference resolution literature, we propose the 'cortico-hippocampal pattern separation' (CHiPS) framework, which asserts that brain regions involved in cognitive control play a significant role in pattern separation. Particularly, these regions may contribute to pattern separation by (1) resolving interference in sensory regions that project to the hippocampus, thus regulating its cortical input, or (2) directly modulating hippocampal processes in accordance with task demands. Considering recent interest in how hippocampal operations are modulated by goal states likely represented and regulated by extra-hippocampal regions, we argue that pattern separation is similarly supported by neocortical-hippocampal interactions. <<<

Memories benefit from sleep, and sleep loss immediately following learning has a negative impact on subsequent memory storage. Several prominent hypotheses ascribe a central role to hippocampal sharp-wave ripples (SWRs), and the concurrent reactivation and replay of neuronal patterns from waking experience, in the offline memory consolidation process that occurs during sleep. However, little is known about how SWRs, reactivation, and replay are affected when animals are subjected to sleep deprivation. We performed long duration (~12 h), high-density silicon probe recordings from rat hippocampal CA1 neurons, in animals that were either sleeping or sleep deprived following exposure to a novel maze environment. We found that SWRs showed a sustained rate of activity during sleep deprivation, similar to or higher than in natural sleep, but with decreased amplitudes for the sharp-waves combined with higher frequencies for the ripples. Furthermore, while hippocampal pyramidal cells showed a log-normal distribution of firing rates during sleep, these distributions were negatively skewed with a higher mean firing rate in both pyramidal cells and interneurons during sleep deprivation. During SWRs, however, firing rates were remarkably similar between both groups. Despite the abundant quantity of SWRs and the robust firing activity during these events in both groups, we found that reactivation of neurons was either completely abolished or significantly diminished during sleep deprivation compared to sleep. Interestingly, reactivation partially rebounded upon recovery sleep, but failed to reach the levels characteristic of natural sleep. Similarly, the number of replays were significantly lower during sleep deprivation and recovery sleep compared to natural sleep. These results provide a network-level account for the negative impact of sleep loss on hippocampal function and demonstrate that sleep loss impacts memory storage by causing a dissociation between the amount of SWRs and the replays and reactivations that take place during these events. <<<

<jats:title>Abstract</jats:title><jats:p>No sooner is an experience over than its neural memory representation begins to be strengthened and transformed through the process of memory replay. Using fMRI, we examined how memory strength manipulated through repetition during encoding modulates post-encoding replay in humans. Results revealed that repetition did not increase replay frequency in the hippocampus. However, replay in cortical regions and hippocampal-cortical coordinated replay were significantly enhanced for repeated events, suggesting that repetition accelerates the consolidation process. Interestingly, we found that replay frequency in both hippocampus and cortex modulated behavioral success on an immediate associative recognition test for the weakly encoded information, indicating a significant role for post-encoding replay in rescuing once-presented events. Together, our findings highlight the relationships of replay to stabilizing weak memories and accelerating cortical consolidation for strong memories.</jats:p> <<<

<jats:title>Abstract</jats:title><jats:p>Recent human electrophysiology work has uncovered the presence of high frequency oscillatory events, termed ripples, during awake behavior. This prior work focuses on ripples in the medial temporal lobe (MTL) during memory retrieval. Few studies, however, investigate ripples during item encoding. Many studies have found neural activity during encoding that predicts later recall, termed subsequent memory effects (SMEs), but it is unclear if ripples during encoding also predict subsequent recall. Detecting ripples in 124 neurosurgical participants performing an episodic memory task, we find insignificant ripple SMEs in any MTL region, even as these regions exhibit robust high frequency activity (HFA) SMEs. Instead, hippocampal ripples increase during encoding of items leading to recall of temporally or semantically associated items, a phenomenon known as clustering. This subsequent clustering effect (SCE) arises specifically when hippocampal ripples occur during both encoding and retrieval, suggesting that ripples mediate the encoding and future reinstatement of episodic memories.</jats:p> <<<

Episodic memory enables humans to encode and later vividly retrieve information about our rich experiences, yet the neural representations that support this mental capacity are poorly understood. Using a large fMRI dataset ( = 468) of face-name associative memory tasks and principal component analysis to examine neural representational dimensionality (RD), we found that the human brain maintained a high-dimensional representation of faces through hierarchical representation within and beyond the face-selective regions. Critically, greater RD was associated with better subsequent memory performance both within and across participants, and this association was specific to episodic memory but not general cognitive abilities. Furthermore, the frontoparietal activities could suppress the shared low-dimensional fluctuations and reduce the correlations of local neural responses, resulting in greater RD. RD was not associated with the degree of item-specific pattern similarity, and it made complementary contributions to episodic memory. These results provide a mechanistic understanding of the role of RD in supporting accurate episodic memory. <<<