🌟 OpenThaiGPT 1.6 72b

OpenThaiGPT 1.6 72b is a 72-billion-parameter Thai language model designed for general-purpose tasks with strong analytical thinking capabilities. Building on the foundation of OpenThaiGPT 1.5, this latest release demonstrates improved performance across a wide range of benchmarks, particularly in coding and general language tasks.

Download the model

OpenThaiGPT 1.6 72b — Hugging Facehuggingface.co

openthaigpt/openthaigpt-1.6-72b-instruct

Highlights

• Advanced Thai language model with 72 billion parameters
• Strong analytical thinking capabilities in both Thai and English
• Improved performance compared to previous OpenThaiGPT releases
• Balanced capabilities across mathematics, coding, and general language tasks
• Deep understanding of the Thai language and cultural context

Key improvements over 1.5

Compared to OpenThaiGPT 1.5 72b, version 1.6 demonstrates:

• Substantially improved coding performance in both Thai (LiveCodeBench-TH: 32.43 vs 12.61) and English (LiveCodeBench: 54.21 vs 46.38)
• Comparable general language understanding with language accuracy as high as 98.2%
• Better balanced capabilities between mathematics and coding tasks

Benchmark results

Benchmarks	OpenThaiGPT 1.6 72b	OpenThaiGPT 1.5 7b	OpenThaiGPT 1.5 14b	OpenThaiGPT 1.5 72b	Typhoon2 Qwen2.5 7b	Typhoon2 Llama3.1 8b	Typhoon2 Llama3.1 70b	NECTEC Pathumma LLM Text 1.0.0 7b
AIME24-TH	6.67	0	0	6.67	3.33	3.33	13.33	0
AIME24	23.33	6.67	10	23.33	6.67	3.33	10	0
MATH500-TH	43.2	24.2	26.2	62	51.8	31	55.8	21.8
MATH500	82	40.4	47.4	83.2	65.4	49.6	67.4	42.8
LiveCodeBench-TH	32.43	22.52	21.62	12.61	9.91	8.11	27.03	0
LiveCodeBench	54.21	31.12	37.96	46.38	0.98	5.87	37.38	0
OpenThaiEval	78.7	64.5	71.26	77.16	64.76	56.63	72.54	65.27
Language Accuracy	98.2	97.6	98.4	99.4	99.4	98.6	99.8	98.6
AVERAGE	52.34	35.88	39.11	51.34	37.78	32.06	47.91	28.56

Technical report

OpenThaiGPT 1.6 and R1 Technical Report — arXivarxiv.org

If OpenThaiGPT has been beneficial for your work, kindly consider citing it as follows:

@misc{yuenyong2025openthaigpt16r1thaicentric,
      title={OpenThaiGPT 1.6 and R1: Thai-Centric Open Source and Reasoning Large Language Models}, 
      author={Sumeth Yuenyong and Thodsaporn Chay-intr and Kobkrit Viriyayudhakorn},
      year={2025},
      eprint={2504.01789},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2504.01789}, 
}

How to use

Transformers

from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "openthaigpt/openthaigpt-1.6-72b"

model = AutoModelForCausalLM.from_pretrained(
    model_name,
    torch_dtype="auto",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained(model_name)

prompt = "กรุงเทพมหานครคืออะไร"
messages = [
    {"role": "user", "content": prompt}
]
text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)

generated_ids = model.generate(
    **model_inputs,
    max_new_tokens=8192,
    temperature=0.6
)
generated_ids = [
    output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
]

response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]

vLLM

1. Install vLLM (vllm-project/vllm)
2. Run server

vllm serve openthaigpt/openthaigpt-1.6-72b --tensor-parallel-size 2

• Note, change --tensor-parallel-size 2 to the amount of available GPU cards.

3. Run inference (CURL example)

curl -X POST 'http://127.0.0.1:8000/v1/chat/completions' \
-H 'Content-Type: application/json' \
-d '{
  "model": "openthaigpt/openthaigpt-1.6-72b",
  "messages": [
    {
      "role": "user",
      "content": "กรุงเทพมหานครคืออะไร"
    }
  ],
  "max_tokens": 4096,
  "temperature": 0.6,
  "top_p": 0.95,
  "top_k": 40
}'

GPU memory requirements

Number of Parameters	FP 16 bits	8 bits (Quantized)	4 bits (Quantized)
72b	144 GB	72 GB	36 GB

License

• This model is available for research and commercial use under the terms of the Qwen2.5 license agreement. Please refer to the LICENSE file for more information.

Support

• Official website: openthai.ai
• Facebook page: OpenThaiGPT Group
• Discord server for discussion and support: discord.gg/7KDdKkBGUs
• Email: kobkrit@iapp.co.th

Disclaimer: Provided responses are not guaranteed.