
We are thrilled to announce that our journal paper entitled “Resolving the Classifier’s Gray Zone: A Tool-Augmented LLM Agent for Phishing Detection at Certificate-Issuance Time” has been accepted for publication in IEICE Transactions on Information and Systems, Special Section on Information and Communication System Security. Congratulations Asomura-san, and kudos to Iijima-san!
In this work, we tackle the gray zone of phishing detection: the domains that even a state-of-the-art supervised classifier cannot confidently assign to either class, where misses and false alarms concentrate. We propose a two-layer system in which high-confidence domains are decided automatically by machine learning and only the gray zone is handed to GrayLens, a tool-augmented LLM agent that reproduces an analyst’s investigation by combining Certificate Transparency issuance history, Wayback Machine archives, SubjectPublicKeyInfo (SPKI) sharing analysis, and brand impersonation detection, without fetching the target’s live page. On a gray-zone evaluation set of 24,633 domains, where XGBoost drops to F1 = 0.7334, the agent raises F1 to 0.9675 and cuts the miss rate from 36.4% to 2.5%. We also find that phishing domains share an SPKI hash with other domains 65.6% of the time, about 15 times the 4.4% rate of legitimate domains.
Ichiro Asomura, Ryo Iijima, and Tatsuya Mori. "Resolving the Classifier’s Gray Zone: A Tool-Augmented LLM Agent for Phishing Detection at Certificate-Issuance Time." IEICE Transactions on Information and Systems, Special Section on Information and Communication System Security, to appear (Jun 2027).