Recent advances in mobile technologies have emerged new challenges for researchers. File management and retrieval on resource-limited devices has become a challenging problem as these devices are now equipped with larger storage capacities. This paper presents an overview about the possibilities of implementing Semantic Web Technologies in order to facilitate the file retrieval on resource-limited devices. We have proposed a semantic based file retrieval framework which utilizes a generic ontology in file search process. The search module is implemented in Java ME platforms as a case study. Performance of the proposed search module is evaluated through experimental tests along with probabilistic evaluations. The implemented module not only automates file retrieval process but also shows significant improvement in file retrieval efficiency by utilizing the knowledge of employed ontology in the search module.