In plain words: A new log parser reads messages character by character and turns each detail into 4-bit decimal codes, so it can pull out exact templates instead of loose patterns. It matched big AI parsers in accuracy while running faster than meaning-based ones.
Abstract · A Word is Worth 4-bit: Efficient Log Parsing with Binary Coded Decimal Recognition
System-generated logs are typically converted into categorical log templates through parsing. These templates are crucial for generating actionable insights in various downstream tasks. However, existing parsers often fail to capture fine-grained template details, leading to suboptimal accuracy and reduced utility in downstream tasks requiring precise pattern identification. We propose a character-level log parser utilizing a novel neural architecture that aggregates character embeddings. Our approach estimates a sequence of binary-coded decimals to achieve highly granular log templates extraction. Our low-resource character-level parser, tested on revised Loghub-2k and a manually annotated industrial dataset, matches LLM-based parsers in accuracy while outperforming semantic parsers in efficiency.
Prerak Srivastava, Giulio Corallo, Sergey Rybalko
arXiv:2506.01147 · cs.CL, cs.LG · submitted Jun 1, 2025
abstract · pdf · html · Pre-print of our accepted paper at IEEE International Conference on Web Services (ICWS 2025). 4 pages, 2 figures