Over the past few years there has been a steady increase in the number of videos being watched online on a mobile device. This is evident from the widespread popularity of streaming services like YouTube, Netflix, Hulu, etc. The underlying streaming technology is also gradually shifting from the classic non-adaptive form to a more adaptive one. In this paper, we simulate a real life video streaming environment using both the classical and the adaptive streaming approach in order to understand if really there is a perceivable difference in quality between the two techniques. Extensive subjective tests are carried out for this purpose where the users are allowed to watch and rate the videos they see on the YouTube application installed in a mobile device. The results that are reported will be beneficial not only to the video content providers; but also to the Internet Service Providers as they can better manage their resources and clearly understand the merits or demerits between the two different streaming technologies available.