A Reinforcement Learning Based Network Scheduler For Deadline-Driven Data Transfers

Ghosal, Dipak and Shukla, Sambit and Sim, Alex and Thakur, Aditya V. and Kesheng, Wu
IEEE Global Communications Conference (GLOBECOM), 2019

We consider a science network that runs applications requiring data transfers to be completed within a given deadline. The underlying network is a software defined network (SDN) that supports fine grain real-time network telemetry. Deadline-aware data transfer requests are made to a centralized network controller that schedules the flows by setting pacing rates of the deadline flows. The goal of the scheduling algorithm is to maximize the number of flows that meet the deadline while maximizing the network utilization. In this paper, we develop a Reinforcement Learning (RL) agent based network controller and compare its performance with well-known heuristics. For a network consisting of a single bottleneck link, we show that the RL-agent based network controller performs as well as Earliest Deadline First (EDF) in the underloaded case and better in the overloaded case. We also show that the RL-agent performs significantly better than an idealized TCP protocol in which the bottleneck link capacity is equally shared among the competing flows. We also study the sensitivity of the RL-agent controller for some of the parameter settings.

PDF    

@inproceedings{globecom2019,
  author = {Ghosal, Dipak and Shukla, Sambit and Sim, Alex and Thakur, Aditya V. and Kesheng, Wu},
  title = {A Reinforcement Learning Based Network Scheduler For Deadline-Driven Data Transfers},
  booktitle = { IEEE Global Communications Conference {(GLOBECOM)}},
  year = {2019},
  publisher = {IEEE}
}