AI/ML Researcher at Kakao Corp., working on LLM pre-training. Personally diving deep into alignment (SFT, RLHF/RLVR) and modern architectures.
- M.S. in Artificial Intelligence, Seoul National University
- B.S. in Biology and Business Administration, Seoul National University
- LLM Pre-training @ Kakao Corp.
- Developing the Kanana model family β Kakao's bilingual LLMs
- Building large-scale pre-training pipelines on JAX/TPU and PyTorch/GPU
- Pre-training at scale β Β΅P, hyperparameter transfer, scaling laws
- Architectures β Mixture-of-Experts, Linear attention (DeltaNet, Gated DeltaNet), MLA
- Alignment β SFT, RLHF, RLVR, GRPO
- Kanana-2 μΈμ΄λͺ¨λΈ νμ΄λ³΄κΈ°
Instruct.KR 2025 Dec Meetup β Agents, Seoul, Dec 2025 Β· [event] β co-presented Pre-training of Kakao's MoE LLM - Featured in μμ¦IT
Speaker interview ahead of Instruct.KR Dec 2025 β on Kanana team's MoE development journey - λ°μ΄ν°λ μμ§λ§ LLMμ νμ΅νκ³ μΆμ΄ β Code, Math λ°μ΄ν° κ°λ°κΈ°
if(kakao) 25, Sep 2025 Β· [video] β data pipeline development for LLM pre-training (code & math corpora) - Kakao's journey with JAX and Cloud TPUs
Google Cloud Blog, Aug 2025 β co-authored technical deep-dive on Kakao's JAX/TPU adoption for Kanana pre-training - κ΅λ΄ μ΅μ΄ MoE λͺ¨λΈ 'Kanana-MoE' κ°λ°κΈ°
Kakao Tech Blog, Jul 2025 β co-authored development story of Korea's first open-source MoE LLM - Building and Serving the Next Generation AI Models with JAX
Google Cloud Next '25, Las Vegas, Apr 2025 Β· [session]
- Kanana: Compute-efficient Bilingual Language Models
Kanana LLM Team, arXiv preprint, 2025 - Clinical Note Owns its Hierarchy: Multi-Level Hypergraph Neural Networks for Patient-Level Representation Learning
Nayeon Kim et al., ACL 2023 (Oral)
- βοΈ lana.ny@kakaocorp.com

