This paper defines a Quality of Experience (QoE) parameter for multi-view video streaming service over Wireless Broadband Internet, and proposes cross-layer optimization (CLO) algorithm to maximize the QoE. The proposed CLO algorithm interacts with all layers from PHY layer to video layer. Under the time-varying wireless channel condition, it guarantees service continuity to the user by selecting frames to be transmitted. The CLO technique takes inter-view and the temporal significance of the multi-view video frames into consideration when deciding the Transmission Frame Set (TFS) and its Levels of FEC (LOF). Through simulation of the proposed technique, it is shown that the optimal quality of the multi-view video can be achieved even during hand-over, using the minimum amount of resources. Visual quality of multi-view video streams is improved by about 15.3∼30.2%, especially up to 39.1∼65% during the hand-over. Moreover, continuity of the most important view has been increased by 20.1∼39.1% in comparison with conventional method.