unilm
Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
About this project
aka.ms/GeneralAI Hiring We are hiring at all levels (including FTE researchers and interns)! If you are interested in working with us on Foundation Models (aka large-scale pre-trained models) and General AI, NLP, MT, Speech, Document AI and Multimodal AI, please send your resume to fuwei@microsoft.com . Foundation Architecture TorchScale - A Library of Foundation Architectures (repo) Fundamental research to develop new architectures for foundation models and AI, focusing on modeling generality and capability, as well as training stability and efficiency. Stability - DeepNet: scaling Transformers to 1,000 Layers and beyond Generality - Foundation Transformers (Magneto): towards true…
Technologies
Project health
GitHub
Reviews
Built by
Maintain microsoft/unilm? Claiming verifies admin access through your GitHub account and gives you control of this listing.
