Mengsay Loem

Mengsay Loem

Engineer at Preferred Networks · formerly Researcher at Sansan · Tokyo, Japan

I build and study language and vision-language models — with a focus on how we evaluate them, and how they hold up in low-resource settings.

LLM / VLMEvaluationLow-Resource NLP

News

Selected publications

All 26 →
COLM2024
Continual Pre-Training for Cross-Lingual LLM Adaptation: Enhancing Japanese Language Capabilities
Kazuki Fujii, Taishi Nakamura, Mengsay Loem, Hiroki Iida, Masanari Ohi, Kakeru Hattori, Hirai Shota, Sakae Mizuki, Rio Yokota, and Naoaki Okazaki
Conference on Language Modeling (COLM), Univ. of Pennsylvania, USA
Samdei Type
Open models that turn romanized Khmer, the Latin spelling many Cambodians use in chat, into Khmer script. Small enough for a phone keyboard, and released with all their training data and a new benchmark of everyday messages.
Released · Nov 2026

Recent notes

All notes →
A short note on romanized multilingual pretraining, why it improves cross-script transfer, and why the mechanism may be more complicated than lexical overlap alone.
A short note on translationese in multilingual LLM generation, and a question that may be more useful than asking whether a model "thinks in English."
A small kickoff for this new space — and a first test of how I want to keep and share research notes.