↻
Shachar Mirkin reposted
arxiv cs.CL
@arxiv-cs-cl.bsky.social
Joseph Marvin Imperial, Junhong Liang, Belal Shoer, Abdullah Barayan, Rodrigo Wilkens, Omar Mussa, Dawn Knight, Eug\'enio Ribeiro, Ekaterina Kochmar, ... ComplexityMT: Benchmarking the Interaction Between Text Complexity and Machine Translation https://arxiv.org/abs/2606.05421
AI Weekly's analysis
→
- ComplexityMT benchmarks machine translation across Arabic, Dutch, English, French, Hindi and Russian using CEFR as the measure of text complexity.
- Higher CEFR levels make texts more difficult to translate, and MT systems shift the CEFR level of the target versus the source for most languages.
- The study evaluates three open-weight models, one closed model and one commercial machine translation system on two CEFR-grounded tasks.
Read full analysis →
View on Bluesky →