论文标题
第三次国际神经网络竞争验证（VNN-COMP 2022）：摘要和结果
The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Results
论文作者
论文摘要
该报告总结了第3次国际神经网络竞争验证（VNN-COMP 2022），该验证是第五届ML支持自治系统（FOMLAS）的第五次研讨会的一部分，该研讨会与第34届国际计算机辅助验证会议（CAV）并列（CAV）。每年举行VNN-COMP，以促进最先进的神经网络验证工具的公平和客观比较，鼓励工具接口的标准化并将神经网络验证社区汇总在一起。为此，定义了针对网络（ONNX）和规范（VNN-LIB）的标准化格式，对同等成本硬件进行了评估工具（使用基于AWS实例的自动评估管道使用），并且在最终测试集公开之前，参与者选择了工具参数。在2022年的迭代中，有11支球队参加了12个得分的基准。该报告总结了从这项竞争的迭代中汲取的规则，基准，参与工具，结果以及经验教训。
This report summarizes the 3rd International Verification of Neural Networks Competition (VNN-COMP 2022), held as a part of the 5th Workshop on Formal Methods for ML-Enabled Autonomous Systems (FoMLAS), which was collocated with the 34th International Conference on Computer-Aided Verification (CAV). VNN-COMP is held annually to facilitate the fair and objective comparison of state-of-the-art neural network verification tools, encourage the standardization of tool interfaces, and bring together the neural network verification community. To this end, standardized formats for networks (ONNX) and specification (VNN-LIB) were defined, tools were evaluated on equal-cost hardware (using an automatic evaluation pipeline based on AWS instances), and tool parameters were chosen by the participants before the final test sets were made public. In the 2022 iteration, 11 teams participated on a diverse set of 12 scored benchmarks. This report summarizes the rules, benchmarks, participating tools, results, and lessons learned from this iteration of this competition.
