UniData turns a simple requirement into multi-round, nine-modality instructions, beating Self-Instruct and VIGC on reasonableness, clarity, detail and relevance
The authors introduce UniData, a universal multimodal instruction generation pipeline that first expands user keywords into diverse events, then uses a LLaMA-3-backed multimodal instruction generator with image and music tokenizers to produce instructions round by round, correcting repetition and irrelevance at inference via inter-round correlation; they also build UniDataset with nine modalities, 20,000 entries and 17.5 rounds on average, and report that its data quality exceeds Self-Instruct and VIGC on all four GPT-guided metrics while fine-tuning on the generated data improves other multimodal models' understanding and generation.