论文标题
离散时间模型中年龄和失真的最佳政策
Optimal Policies for Age and Distortion in a Discrete-Time Model
论文作者
论文摘要
我们研究一个离散的时间模型，每个数据包都有未发送的成本 - 此费用可能取决于数据包内容。我们研究了年龄与发件人仅限于基于数据包的策略的成本之间的权衡。最佳的权衡是通过将问题作为马尔可夫决策过程（MDP）的适当提出来找到的。我们表明，可以通过有限的内存政策来实现最佳权衡，并设计了一种有效的政策迭代算法来找到这些最佳政策。我们进一步研究了一个相关的问题，其中传输数据包被擦除。我们表明，解决我们问题的最佳策略对于这种新设置也是最佳的。允许跨数据包进行编码可显着扩展基于数据包的策略。我们表明，当数据包有效载荷很小时，可以通过编码来提高性能。
We study a discrete-time model where each packet has a cost of not being sent -- this cost might depend on the packet content. We study the tradeoff between the age and the cost where the sender is confined to packet-based strategies. The optimal tradeoff is found by an appropriate formulation of the problem as a Markov Decision Process (MDP). We show that the optimal tradeoff can be attained with finite-memory policies and we devise an efficient policy iteration algorithm to find these optimal policies. We further study a related problem where the transmitted packets are subject to erasures. We show that the optimal policies for our problem are also optimal for this new setup. Allowing coding across packets significantly extends the packet-based strategies. We show that when the packet payloads are small, the performance can be improved by coding.
