Search results
Found 12130 matches for
Crossmodal interactions in the perception of expressivity in musical performance.
In musical performance, bodily gestures play an important role in communicating expressive intentions to audiences. Although previous studies have demonstrated that visual information can have an effect on the perceived expressivity of musical performances, the investigation of audiovisual interactions has been held back by the technical difficulties associated with the generation of controlled, mismatching stimuli.With the present study, we aimed to address this issue by utilizing a novel method in order to generate controlled, balanced stimuli that comprised both matching and mismatching bimodal combinations of different expressive intentions. The aim of Experiment 1 was to investigate the relative contributions of auditory and visual kinematic cues in the perceived expressivity of piano performances, and in Experiment 2 we explored possible crossmodal interactions in the perception of auditory and visual expressivity. The results revealed that although both auditory and visual kinematic cues contribute significantly to the perception of overall expressivity, the effect of visual kinematic cues appears to be somewhat stronger. These results also provide preliminary evidence of crossmodal interactions in the perception of auditory and visual expressivity. In certain performance conditions, visual cues had an effect on the ratings of auditory expressivity, and auditory cues had a small effect on the ratings of visual expressivity.
Goal neglect and knowledge chunking in the construction of novel behaviour.
Task complexity is critical in cognitive efficiency and fluid intelligence. To examine functional limits in task complexity, we examine the phenomenon of goal neglect, where participants with low fluid intelligence fail to follow task rules that they otherwise understand. Though neglect is known to increase with task complexity, here we show that - in contrast to previous accounts - the critical factor is not the total complexity of all task rules. Instead, when the space of task requirements can be divided into separate sub-parts, neglect is controlled by the complexity of each component part. The data also show that neglect develops and stabilizes over the first few performance trials, i.e. as instructions are first used to generate behaviour. In all complex behaviour, a critical process is combination of task events with retrieved task requirements to create focused attentional episodes dealing with each decision in turn. In large part, we suggest, fluid intelligence may reflect this process of converting complex requirements into effective attentional episodes.
Attention sharpens the distinction between expected and unexpected percepts in the visual brain.
Attention, the prioritization of goal-relevant stimuli, and expectation, the modulation of stimulus processing by probabilistic context, represent the two main endogenous determinants of visual cognition. Neural selectivity in visual cortex is enhanced for both attended and expected stimuli, but the functional relationship between these mechanisms is poorly understood. Here, we adjudicated between two current hypotheses of how attention relates to predictive processing, namely, that attention either enhances or filters out perceptual prediction errors (PEs), the PE-promotion model versus the PE-suppression model. We acquired fMRI data from category-selective visual regions while human subjects viewed expected and unexpected stimuli that were either attended or unattended. Then, we trained multivariate neural pattern classifiers to discriminate expected from unexpected stimuli, depending on whether these stimuli had been attended or unattended. If attention promotes PEs, then this should increase the disparity of neural patterns associated with expected and unexpected stimuli, thus enhancing the classifier's ability to distinguish between the two. In contrast, if attention suppresses PEs, then this should reduce the disparity between neural signals for expected and unexpected percepts, thus impairing classifier performance. We demonstrate that attention greatly enhances a neural pattern classifier's ability to discriminate between expected and unexpected stimuli in a region- and stimulus category-specific fashion. These findings are incompatible with the PE-suppression model, but they strongly support the PE-promotion model, whereby attention increases the precision of prediction errors. Our results clarify the relationship between attention and expectation, casting attention as a mechanism for accelerating online error correction in predicting task-relevant visual inputs.
Neural Network Modelling of Hierarchical Motor Function in the Brain
This chapter discusses computer modelling of hierarchical motor function in the brain. The focus is on dynamical models that utilise biologically plausible neural network architectures with local associative synaptic learning rules. The chapter begins with a review of our own laboratory’s work in this area. We present a series of hierarchical motor models and relate these to various areas of brain function. This is followed by a discussion of the limitations of these models and directions for future research.
Crossmodal correspondences between odors and contingent features: odors, musical notes, and geometrical shapes.
Olfactory experiences represent a domain that is particularly rich in crossmodal associations. Whereas associations between odors and tastes, or other properties of their typical sources such as color or temperature, can be straightforwardly explained by associative learning, other matchings are much harder to explain in these terms, yet surprisingly are shared across individuals: The majority of people, for instance, associate certain odors and auditory features, such as pitch (Belkin, Martin, Kemp, & Gilbert, Psychological Science 8:340-342, 1997; Crisinel & Spence, Chemical Senses 37:151-158, 2012b) or geometrical shapes (Hanson-Vaux, Crisinel, & Spence, Chemical Senses 38:161-166, 2013; Seo, Arshamian, et al., Neuroscience Letters 478:175-178, 2010). If certain odors might indeed have been encountered while listening to certain pieces of music or seeing certain geometrical shapes, these encounters are very unlikely to have been statistically more relevant than others; for this reason, associative learning from regular exposure is ruled out, and thus alternative explanations in terms of metaphorical mappings are usually defended. Here we argue that these associations are not primarily conceptual or linguistic, but are grounded in structural perceptual or neurological determinants. These cases of crossmodal correspondences established between contingent environmental features can be explained as amodal, indirect, and transitive mappings across modalities. Surprising associations between odors and contingent sensory features can be investigated as genuine cases of crossmodal correspondences, akin to other widespread cases of functional correspondences that hold, for instance, between auditory and visual features, and can help reveal the structural determinants weighing on the acquisition of these crossmodal associations.
Social elites can emerge naturally when interaction in networks is restricted
Animal (and human) societies characterized by dominance hierarchies invariably suffer from inequality. The rise of inequality has 3 main prerequisites: 1) a group in which inequality can emerge, 2) the existence of differences in payoff, and 3) a mechanism that initiates, accumulates, and propagates the differences. Hitherto, 2 kinds of models have been used to study the processes involved. In winner-loser models of inequality (typical in zoology), the 3 elements are independent. In division-of-labor models of inequality, the first 2 elements are linked, whereas the third is independent. In this article, we propose a new model, that of synchronized group action, in which all 3 elements are linked. Under these conditions, agent-based simulations of communal action in multilayered communities naturally give rise to endogenous status, emergent social stratification, and the rise of elite cliques. We show that our 3 emergent social phenomena (status, stratification, and elite formation) react to natural variations in merit (the capacity to influence others' decisions). We also show that the group-level efficiency and inequality consequences of these emergent phenomena define a space for social institutions that optimize efficiency gain in some fitness-related respect, while controlling the loss of efficiency and equality in other respects. © The Author 2013.
Dynamics of personal social relationships in online social networks: A study on Twitter
The growing popularity of Online Social Networks (OSN) is generating a large amount of communication records that can be easily accessed and analysed to study human social behaviour. This represents a unique opportunity to understand properties of social networks that were impossible to assess in the past. Although analyses on OSN conducted hitherto revealed some important global properties of the networks, there is still a lack of understanding of the mechanisms underpinning these properties, their relation to human behaviour, and their dynamic evolution over time. These aspects are clearly important to understand and characterise OSN and to identify the evolutionary strategy that favoured the diffusion of the use of online communications in our society. In this paper we analyse a data set of Twitter communication records, studying the dynamic processes that govern the maintenance of online social relationships. The results reveal that people in Twitter have highly dynamic social networks, with a large percentage of weak ties and high turnover. This suggests that this behaviour can be the product of an evolutionary strategy aimed at coping with the extremely challenging conditions imposed by our society, where dynamism seems to be the key to success. © 2013 ACM.
Big brains, meat, tuberculosis, and the nicotinamide switches: co-evolutionary relationships with modern repercussions?
Meat-eating was a game changer for human evolution. We suggest that the limiting factors for expanding brains earlier were scarcities of nicotinamide and tryptophan. In humans and some other omnivores, lack of meat causes these deficiencies. Nicotinamide adenine dinucleotide (NADH) is necessary to synthesize adenosine triphosphate (ATP) via either glycolysis or via the mitochondrial respiratory chain. NAD consumption is also necessary for developmental and repair circuits. Inadequate supplies result in "de-evolutionary" brain atrophy, as seen with pellagra. If trophic nicotinamide/tryptophan was a "prime mover" in building bigger brains, back-up mechanisms should have evolved. One strategy may be to recruit extra gut symbionts that produce NADH precursors or export nicotinamide (though this may cause diarrhea). We propose a novel supplier TB that co-evolved early, which did not originally and does not now inevitably cause disease. TB has highly paradoxical immunology for a pathogen, and secretes and is inhibited by nicotinamide and its analogue, isoniazid. Sharp declines in TB and diarrhea correlated with increased meat intake in the past, suggesting that dietary vitamin B3 and tryptophan deficiencies (also associated with poor cognition and decreased lifespans) are still common where meat is unaffordable.
Hippocampal NMDA receptors are important for behavioural inhibition but not for encoding associative spatial memories.
The idea that an NMDA receptor (NMDAR)-dependent long-term potentiation-like process in the hippocampus is the neural substrate for associative spatial learning and memory has proved to be extremely popular and influential. However, we recently reported that mice lacking NMDARs in dentate gyrus and CA1 hippocampal subfields (GluN1(ΔDGCA1) mice) acquired the open field, spatial reference memory watermaze task as well as controls, a result that directly challenges this view. Here, we show that GluN1(ΔDGCA1) mice were not impaired during acquisition of a spatial discrimination watermaze task, during which mice had to choose between two visually identical beacons, based on extramaze spatial cues, when all trials started at locations equidistant between the two beacons. They were subsequently impaired on test trials starting from close to the decoy beacon, conducted post-acquisition. GluN1(ΔDGCA1) mice were also impaired during reversal of this spatial discrimination. Thus, contrary to the widely held belief, hippocampal NMDARs are not required for encoding associative, long-term spatial memories. Instead, hippocampal NMDARs, particularly in CA1, act as part of a comparator system to detect and resolve conflicts arising when two competing, behavioural response options are evoked concurrently, through activation of a behavioural inhibition system. These results have important implications for current theories of hippocampal function.
Lexical learning and lexical processing in children with developmental language impairments.
Lexical skills are a crucial component of language comprehension and production. This paper reviews evidence for lexical-level deficits in children and young people with developmental language impairment (LI). Across a range of tasks, LI is associated with reduced vocabulary knowledge in terms of both breadth and depth and difficulty with learning and retaining new words; evidence is emerging from on-line tasks to suggest that low levels of language skill are associated with differences in lexical competition in spoken word recognition. The role of lexical deficits in understanding the nature of LI is also discussed.
When words fail us: insights into language processing from developmental and acquired disorders.
Acquired disorders of language represent loss of previously acquired skills, usually with relatively specific impairments. In children with developmental disorders of language, we may also see selective impairment in some skills; but in this case, the acquisition of language or literacy is affected from the outset. Because systems for processing spoken and written language change as they develop, we should beware of drawing too close a parallel between developmental and acquired disorders. Nevertheless, comparisons between the two may yield new insights. A key feature of connectionist models simulating acquired disorders is the interaction of components of language processing with each other and with other cognitive domains. This kind of model might help make sense of patterns of comorbidity in developmental disorders. Meanwhile, the study of developmental disorders emphasizes learning and change in underlying representations, allowing us to study how heterogeneity in cognitive profile may relate not just to neurobiology but also to experience. Children with persistent language difficulties pose challenges both to our efforts at intervention and to theories of learning of written and spoken language. Future attention to learning in individuals with developmental and acquired disorders could be of both theoretical and applied value.
Children with specific language impairment are not impaired in the acquisition and retention of Pavlovian delay and trace conditioning of the eyeblink response.
Three converging lines of evidence have suggested that cerebellar abnormality is implicated in developmental language and literacy problems. First, some brain imaging studies have linked abnormalities in cerebellar grey matter to dyslexia and specific language impairment (SLI). Second, theoretical accounts of both dyslexia and SLI have postulated impairments of procedural learning and automatisation of skills, functions that are known to be mediated by the cerebellum. Third, motor learning has been shown to be abnormal in some studies of both disorders. We assessed the integrity of face related regions of the cerebellum using Pavlovian eyeblink conditioning in 7-11year-old children with SLI. We found no relationship between oral language skills or literacy skills with either delay or trace conditioning in the children. We conclude that this elementary form of associative learning is intact in children with impaired language or literacy development.
Context-dependent changes in tactile perception during movement execution.
Tactile perception is inhibited during movement execution, a phenomenon known as tactile suppression. Here, we investigated whether the type of movement determines whether or not this form of sensory suppression occurs. Participants performed simple reaching or exploratory movements. Tactile discrimination thresholds were calculated for vibratory stimuli delivered to participants' wrists while executing the movement, and while at rest (a tactile discrimination task, TD). We also measured discrimination performance in a same vs. different task for the explored materials during the execution of the different movements (a surface discrimination task, SD). The TD and SD tasks could either be performed singly or together, both under active movement and passive conditions. Consistent with previous results, tactile thresholds measured at rest were significantly lower than those measured during both active movement and passive touch (that is, tactile suppression was observed). Moreover, SD performance was significantly better under conditions of single-tasking, active movements, as well as exploratory movements, as compared to conditions of dual-tasking, passive movements, and reaching movements, respectively. Therefore, the present results demonstrate that when active hand movements are made with the purpose of gaining information about the surface properties of different materials an enhanced perceptual performance is observed. As such, it would appear that tactile suppression occurs for irrelevant tactual features during both reaching and exploratory movements, but not for those task-relevant features that result from action execution during tactile exploration. Taken together, then, these results support a context-dependent modulation of tactile suppression during movement execution.
Assessing the benefits of multisensory audiotactile stimulation for overweight individuals.
We report an experiment designed to examine whether individuals who are overweight would perform differently when trying to detect and/or discriminate auditory, vibrotactile, and audiotactile targets. The vibrotactile stimuli were delivered either to the participant's abdomen or to his hand. Thirty-six young male participants were classified into normal, underweight, or overweight groups based on their body mass index. All three groups exhibited a significant benefit of multisensory (over the best of the unisensory) stimulation, but the magnitude of this benefit was modulated by the weight of the participant, the task, and the location from which the vibrotactile stimuli happened to be presented. For the detection task, the overweight group exhibited a significantly smaller benefit than the underweight group. In the discrimination task, the overweight group showed significantly more benefits than the other two groups when the vibrotactile stimuli were delivered to their hands, but not when the stimuli were delivered to their abdomens. These results might raise some interesting questions regarding the mechanisms underlying audiotactile information processing and have applied relevance for the design of the most effective warning signal (e.g., for drivers).
Can transcranial electrical stimulation improve learning difficulties in atypical brain development? A future possibility for cognitive training
Learning difficulties in atypical brain development represent serious obstacles to an individual's future achievements and can have broad societal consequences. Cognitive training can improve learning impairments only to a certain degree. Recent evidence from normal and clinical adult populations suggests that transcranial electrical stimulation (TES), a portable, painless, inexpensive, and relatively safe neuroenhancement tool, applied in conjunction with cognitive training can enhance cognitive intervention outcomes. This includes, for instance, numerical processing, language skills and response inhibition deficits commonly associated with profound learning difficulties and attention-deficit hyperactivity disorder (ADHD). The current review introduces the functional principles, current applications and promising results, and potential pitfalls of TES. Unfortunately, research in child populations is limited at present. We suggest that TES has considerable promise as a tool for increasing neuroplasticity in atypically developing children and may be an effective adjunct to cognitive training in clinical settings if it proves safe. The efficacy and both short- and long-term effects of TES on the developing brain need to be critically assessed before it can be recommended for clinical settings. © 2012 Elsevier Ltd. All rights reserved.