With the rapid development of natural language processing technology in the past few years, the steganography by text synthesis has been greatly developed. These methods can analyze the statistical feature distribution of a large number of training samples, and then generate steganographic texts that conform to such statistical distribution. For these steganography methods, previous steganalysis methods show unsatisfactory detection performance, which remains an unsolved problem and poses a great threat to the security of cyberspace. In this letter, we proposed a fast and efficient text steganalysis method to solve this problem. We first analyzed the correlations between words in these generated steganographic texts. Then, we map each word to a semantic space and used a hidden layer to extract the correlations between these words. Finally, based on the extracted correlation features, we used the softmax classifier to classify the input text. Experimental results show that the proposed model can achieve a high detection accuracy, which shows a state-of-the-art performance.