Preprint

Chinese search correction system reports fewer misspellings

Preprint: GUIDE combines phonetic and visual clues to correct short Chinese queries, with tests on benchmarks and production search traffic.

A preprint on Chinese-language search technology reports that an unsupervised correction system called GUIDE was associated with a much lower misspelling rate in a 10-day production comparison. The experiment arm recorded 0.86% misspellings, compared with 2.58% in the base arm, alongside a reported +0.122% increase in overall search volume. The test covered 4.2% of production main-search traffic.

A model built around likely confusions

GUIDE targets a specific kind of typo: a length-preserving substitution in which one Chinese character is replaced by another. It first maps characters that are easy to confuse because they sound alike or look alike into shared IDs. An encoder-decoder model then reads the altered sequence and tries to reconstruct the original query. Its training objective gives more weight to query examples according to frequency and recency, a design aimed at keeping pace with changing query vocabularies.

The offline comparison favored GUIDE

Offline tests used QSpell 250K, with 200,000 training queries and 50,000 test queries, and KwaiSearch, with 180 million training queries and 30,000 test queries. QSpell's training and test sets contained 102,000 and 26,000 error queries; KwaiSearch's test set contained 15,000, while its training error count was unknown. Researchers compared query-level precision, recall and F1, a single summary score for correction quality. Because KwaiSearch had no ground-truth labels, supervised baselines were trained on QSpell 250K and evaluated on KwaiSearch.

The 6-layer GUIDE configuration was reported as the best overall on both datasets. On QSpell, it posted precision of 0.4367, recall of 0.5547 and F1 of 0.4887. On KwaiSearch, the corresponding figures were 0.6821, 0.8419 and 0.7536. The paper reports no uncertainty estimates or formal significance tests, so these are reported score differences rather than results accompanied by a measured margin of statistical certainty.

Phonetics did most of the work, but vision helped

The phonetic and visual parts did not contribute equally. The combined setting had F1 scores of 0.4730 on QSpell and 0.7508 on KwaiSearch, just above phonetic-only scores of 0.4628 and 0.7443. Visual-only scores were much lower, at 0.1470 and 0.2274. In these reported comparisons, visual information was weak on its own but part of the higher combined score.

Recency and frequency changed the reported scores

In a separate 3-layer KwaiSearch ablation, reported F1 was 0.5947 with uniform weighting, 0.7048 with frequency-only weighting and 0.7508 with the full time-decay plus frequency objective. The paper summarizes the differences as approximately 11 F1 points for frequency reweighting and a further 4.6 points for time decay. The selected time-decay coefficient was 0.0098, while alternatives of 0.0133 and 0.0043 were paired with F1 scores of 0.7451 and 0.7350.

The production result needs a careful reading

The study describes a bucketed online comparison with random query sampling followed by manual annotation, but it does not report the exact annotated sample size, arm allocation, confidence intervals or significance tests. The figures therefore do not establish that GUIDE caused the lower misspelling rate or the search-volume lift. The evidence is limited to the reported Kuaishou traffic and does not establish performance on other platforms, languages or error types.

Post-rollout tracking listed misspelling rates of 2.01%, 0.40%, 0.46% and 0.33% for the listed months 09-01, 10-01, 11-01 and 12-01. The authors describe the reduction as stable and sustained, but no denominator details or uncertainty estimates are reported.

A narrow tool, not a general proofreader

GUIDE's scope is narrow. It is built around length-preserving character substitutions within phonetic or visual confusion neighborhoods. The study therefore does not demonstrate performance on insertions, deletions, segmentation problems or phrase-level rewriting. The paper also notes that the constructed neighborhoods may omit realistic errors or contain noise, which can lead to missed corrections or over-correction.

What the paper discloses

The document is an arXiv version 2 preprint dated 30 Aug 2026; no journal venue or peer-review status is reported. Its acknowledgments say the work was conducted at Kuaishou Technology and thank the company for its support. The paper states that the dataset is available through the GUIDE GitHub repository, although access terms and the exact contents of the release are not reported.

Paper data and sources

Original title: GUIDE: Generative Unsupervised Chinese Query Correction via Phonetic and Visual Shared-ID Encoding
Authors: Lei Yang, Binbin Huang, Jiwei Tan et al.
Journal/Repository: arXiv
Status: Preprint, not yet peer-reviewed
First online: 2026-08-26
DOI: Not available
Original paper · Full text

Versions and corrections

  1. Published automatically after legal-source, freshness, evidence, and independent-verification gates passed.