One of the key features of the fifth-generation (5G) cellular network is non-orthogonal multiple access (NOMA) which improves the spectrum efficiency and increases the network connectivity. A second key ingredient is device to device (D2D) communication which increases spectrum efficiency and off-loads the cellular network. A proper exploitation of both NOMA and D2D requires adequate resources allocation algorithms to manage the interference. Moreover, to support various quality of service (QoS) requirements, other key metrics beyond the rate should be taken into account, such as queue stability and head of line (HoL) packet delay. In this paper, we consider resource block (RB) allocation and power control for both uplink NOMA and D2D communications. An overlay spectrum sharing paradigm is adopted, where an RB is exclusively allocated to either the cellular or D2D communications. The solution uses the modified largest weighted delay first (MLWDF) scheduling discipline and reduces the HoL packet delay, with negligible reduction of the achieved sum rate with respect to the pure maximum-rate solution in typical cellular scenarios.