Login / Signup

A three-dimensional virtual mouse generates synthetic training data for behavioral analysis.

Luis A BolañosDongsheng XiaoNancy L FordJeff M LeDuePankaj K GuptaCarlos DoebeliHao HuHelge RhodinTimothy H Murphy
Published in: Nature methods (2021)
We developed a three-dimensional (3D) synthetic animated mouse based on computed tomography scans that is actuated using animation and semirandom, joint-constrained movements to generate synthetic behavioral data with ground-truth label locations. Image-domain translation produced realistic synthetic videos used to train two-dimensional (2D) and 3D pose estimation models with accuracy similar to typical manual training datasets. The outputs from the 3D model-based pose estimation yielded better definition of behavioral clusters than 2D videos and may facilitate automated ethological classification.
Keyphrases
  • computed tomography
  • deep learning
  • machine learning
  • electronic health record
  • positron emission tomography
  • rna seq