Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework

	Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework
	Han, YN; Chen, K; Wang, YK; Liu, WH; Wang, ZW; Wang, XJ; Han, CL; Liao, JH; Huang, K; Cai, SY; Huang, YT; Wang, N; Li, JX; Song, YWZ; Li, J; Wang, GD; Wang, LP; Zhang, YP; Wei, PF
	2024
发表期刊	NATURE MACHINE INTELLIGENCE
卷号	6 期号:1
摘要	The quantification of animal social behaviour is an essential step to reveal brain functions and psychiatric disorders during interaction phases. While deep learning-based approaches have enabled precise pose estimation, identification and behavioural classification of multi-animals, their application is challenged by the lack of well-annotated datasets. Here we show a computational framework, the Social Behavior Atlas (SBeA) used to overcome the problem caused by the limited datasets. SBeA uses a much smaller number of labelled frames for multi-animal three-dimensional pose estimation, achieves label-free identification recognition and successfully applies unsupervised dynamic learning to social behaviour classification. SBeA is validated to uncover previously overlooked social behaviour phenotypes of autism spectrum disorder knockout mice. Our results also demonstrate that the SBeA can achieve high performance across various species using existing customized datasets. These findings highlight the potential of SBeA for quantifying subtle social behaviours in the fields of neuroscience and ecology. Multi-animal behaviour quantification is pivotal for deciphering animal social behaviours and has broad applications in neuroscience and ecology. Han and colleagues develop a few-shot learning framework for multi-animal 3D pose estimation, identity recognition and social behaviour classification.
收录类别	sci
语种	英语
文献类型	期刊论文
条目标识符	http://ir.kiz.ac.cn/handle/152453/14248
专题	科研部门_行为遗传与进化（王国栋）
推荐引用方式 GB/T 7714	Han, YN,Chen, K,Wang, YK,et al. Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework[J]. NATURE MACHINE INTELLIGENCE,2024,6(1).
APA	Han, YN.,Chen, K.,Wang, YK.,Liu, WH.,Wang, ZW.,...&Wei, PF.(2024).Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework.NATURE MACHINE INTELLIGENCE,6(1).
MLA	Han, YN,et al."Multi-animal 3D social pose estimation, identification and behaviour embedding with a few-shot learning framework".NATURE MACHINE INTELLIGENCE 6.1(2024).

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
2024073148.pdf（10102KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	请求全文