Behavior analysis across species represents a fundamental challenge in neuroscience, psychology, and ethology, typically requiring extensive expert knowledge and labor-intensive processes that limit research scalability and accessibility. We introduce BehaveAgent, an autonomous multimodal AI agent designed to automate behavior analysis from video input without retraining or manual intervention. Unlike conventional methods that require manual behavior annotation, video segmentation, task-specific model training, BehaveAgent leverages the reasoning capabilities of multimodal large language models (LLM) to generalize across novel behavioral domains without need for additional training. It integrates LLMs, vision-language models (VLMs), and large-scale visual grounding modules, orchestrated through a multimodal context memory and goal-directed attention mechanism, to enable robust zero-shot visual reasoning across species and experimental paradigms, including plants, insects, rodents, primates, and humans. Upon receiving a video input, BehaveAgent autonomously identifies the correct analysis strategy and performs end-to-end behavior analysis and interpretation without human supervision. Leveraging vision-language representations, it performs general-purpose tracking, pose estimation and segmentation. We demonstrate BehaveAgent’s universal applicability to autonomously (1) identify the behavioral paradigm and develop an action plan specialized for the identified paradigm, (2) identify relevant subjects and objects, (3) track those features, (4) identify behavioral sequences with explicit reasoning, (5) generate and execute code for targeted analysis and (6) generate comprehensive research reports that integrate behavioral findings with relevant scientific literature. Through interpretable agentic reasoning, BehaveAgent makes its internal decision-making process transparent, clarifying why particular features are tracked or behaviors inferred. By reducing the time and expertise required for behavior analysis, BehaveAgent introduces a scalable, generalizable, and explainable paradigm for advancing biological and behavioral research.
Spatial transcriptomics has revolutionized our understanding of tissue organization by simultaneously capturing gene expression and spatial localization within intact tissues. However, analyzing these increasingly complex datasets requires specialized expertise across computational biology, statistics, and biological context. To address this challenge, we introduce the Spatial Transcriptomics AI Agent (STAgent), an autonomous multimodal agentic AI that integrates multimodal large language models (LLMs) with specialized computational tools to transform weeks-long analysis tasks into minutes of automated processing. Unlike conventional machine learning approaches that are limited to narrow, predefined tasks, STAgent leverages the emergent capabilities of multimodal LLMs – such as flexible reasoning, contextual understanding, and cross-modal integration – which allow it to adapt to novel data, execute multi-step analyses, and generate biologically meaningful insights with minimal human input. STAgent enables autonomous deep research through integrated capabilities, including dynamic code generation for complex analytical workflows, visual reasoning for interpreting spatial patterns, real-time retrieval of relevant peer-reviewd scientific literature, and synthesis of comprehensive, actionable reports. We applied STAgent to investigate the in vivo maturation of human stem cell-derived pancreatic cells (SC-pancreas) transplanted into immunodeficient mice. We generated single-cell spatial transcriptomics data spanning multiple developmental timepoints. STAgent autonomously (1) identified the maturation of initially scattered endocrine cells into well-defined islet-like structures, with predominantly peripheral α-cells surrounding β-cell cores supported by an expanding mesenchymal network; (2) revealed strengthening endocrine-endocrine cell interactions over time and, through context-aware gene set analysis, uncovered spatially resolved biological processes driving maturation; (3) unlike traditional analytical approaches, STAgent offers mechanistic explanations of spatial patterns, contextualizing findings with relevant literatures and developing cohesive insights into human pancreatic development. This agentic approach establishes a new paradigm in spatial transcriptomics analysis by substantially lowering the expertise barrier and reducing analysis time, accelerating biological and biomedical discovery.
Inflammation in the central nervous system (CNS) can impair the function of neuronal mitochondria and contributes to axon degeneration in the common neuroinflammatory disease multiple sclerosis (MS). Here we combine cell type-specific mitochondrial proteomics with in vivo biosensor imaging to dissect how inflammation alters the molecular composition and functional capacity of neuronal mitochondria. We show that neuroinflammatory lesions in the mouse spinal cord cause widespread and persisting axonal ATP deficiency, which precedes mitochondrial oxidation and calcium overload. This axonal energy deficiency is associated with impaired electron transport chain function, but also an upstream imbalance of tricarboxylic acid (TCA) cycle enzymes, with several, including key rate-limiting, enzymes being depleted in neuronal mitochondria in experimental models and in MS lesions. Notably, viral overexpression of individual TCA enzymes can ameliorate the axonal energy deficits in neuroinflammatory lesions, suggesting that TCA cycle dysfunction in MS may be amendable to therapy.
Functional recovery following incomplete spinal cord injury (SCI) depends on the rewiring of motor circuits during which supraspinal connections form new contacts onto spinal relay neurons. We have recently identified a critical role of the presynaptic organizer FGF22 for the formation of new synapses in the remodeling spinal cord. Here, we now explore whether and how targeted overexpression of FGF22 can be used to mitigate the severe functional consequences of SCI. By targeting FGF22 expression to either long propriospinal neurons, excitatory interneurons, or a broader population of interneurons, we establish that FGF22 can enhance neuronal rewiring both in a circuit‐specific and comprehensive way. We can further demonstrate that the latter approach can restore functional recovery when applied either on the day of the lesion or within 24 h. Our study thus establishes viral gene transfer of FGF22 as a new synaptogenic treatment for SCI and defines a critical therapeutic window for its application.
Functional recovery after spinal cord injury is guided by the formation of new spinal detour circuits. The authors show that the formation of these circuits is enhanced by targeted chemogenetic stimulation of supraspinal and spinal neuron populations. Supraspinal and spinal coordinated stimulation potentiated behavioral recovery.
In neuroscience research, the refined analysis of rodent locomotion is complex and cumbersome, and access to the technique is limited because of the necessity for expensive equipment. In this study, we implemented a new deep learning-based open-source toolbox for Automated Limb Motion Analysis (ALMA) that requires only basic behavioral equipment and an inexpensive camera. The ALMA toolbox enables the consistent and comprehensive analyses of locomotor kinematics and paw placement and can be applied to neurological conditions affecting the brain and spinal cord. We demonstrated that the ALMA toolbox can (1) robustly track the evolution of locomotor deficits after spinal cord injury, (2) sensitively detect locomotor abnormalities after traumatic brain injury, and (3) correctly predict disease onset in a multiple sclerosis model. We, therefore, established a broadly applicable automated and standardized approach that requires minimal financial and time commitments to facilitate the comprehensive analysis of locomotion in rodent disease models. Presenting ALMA toolbox, an open source Python repository for automatic analysis of mouse locomotion using bodypart coordinates from markerless pose estimation tools. ALMA is capable of analyzing both healthy and CNS-injured mice. ALMA is also capable of predicting onset of disease in a multiple sclerosis model.
This study investigates the principles of target selection during the remodeling of neuronal circuits following spinal cord injury. It demonstrates that remodeling axons select their postsynaptic partners in an activity-dependent competitive process that is critical for functional recovery after injury.
Ova stranica koristi kolačiće da bi vam pružila najbolje iskustvo
Saznaj više