Research
Recent reporting and analysis on papers, benchmarks, methods, and the ideas shaping the field.
The ML Intern model from Hugging Face attempts a post-training internship test, showcasing Best-of-N weighted selection on MATH-500 problems, achieving a notable accuracy improvement.
Microsoft introduces AutoAdapt, an automated framework aiding prompt and repeatable adaptation of large language models in specialized domains, enhancing reliability and efficiency in sectors like healthcare and law.
The ARES framework targets systemic vulnerabilities in RLHF by using adaptive red-teaming to enhance both policy models and reward models.
Google DeepMind has broadened its partnership with the UK AI Security Institute to focus on AI safety and foundational research, emphasizing efforts to evaluate potential risks posed by advanced AI models.