论文标题
使用基于变压器的树解码器自动完成用户界面布局设计
Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders
论文作者
论文摘要
开发自动机器以促进设计过程的兴趣越来越多。在本文中，我们专注于协助图形用户界面（UI）布局设计，这是应用程序开发中的至关重要的任务。鉴于设计师已输入的部分布局，我们的模型通过预测具有正确位置和尺寸以及层次结构的其余UI元素来完成布局。这种自动化将大大减轻UI设计人员和开发人员的努力。尽管我们专注于接口布局预测，但我们的模型通常适用于涉及树结构和二维位置的其他布局预测问题。特别是，我们设计了两个基于变压器的树解码器的版本：指针和递归变压器，并在公共数据集中尝试这些模型。我们还提出了几个指标，以衡量树木预测的准确性，并将这些指标扎在用户体验领域中。这些为深度学习研究做出了新的任务和方法。
It has been of increasing interest in the field to develop automatic machineries to facilitate the design process. In this paper, we focus on assisting graphical user interface (UI) layout design, a crucial task in app development. Given a partial layout, which a designer has entered, our model learns to complete the layout by predicting the remaining UI elements with a correct position and dimension as well as the hierarchical structures. Such automation will significantly ease the effort of UI designers and developers. While we focus on interface layout prediction, our model can be generally applicable for other layout prediction problems that involve tree structures and 2-dimensional placements. Particularly, we design two versions of Transformer-based tree decoders: Pointer and Recursive Transformer, and experiment with these models on a public dataset. We also propose several metrics for measuring the accuracy of tree prediction and ground these metrics in the domain of user experience. These contribute a new task and methods to deep learning research.
