RNA-binding proteins (RBPs) can regulate biological functions by interacting with specific RNAs, and play an important role in many life activities. Therefore, the rapid identification of RNA-protein binding sites is crucial for functional annotation and site-directed mutagenesis. In this work, a new parallel network that integrates the multi-head attention mechanism and the expectation pooling is proposed, named MAHyNet. The left-branch network of MAHyNet hybrids convolutional neural networks (CNNs) and gated recurrent neural network (GRU) to extract the features of one-hot. The right-branch network is a two-layer CNN network to analyze physicochemical properties of RNA base. Specifically, the multi-head attention mechanism is a computational collection of multiple independent layers of attention, which can extract feature information from multiple dimensions. The expectation pooling combines probabilistic thinking with global pooling. This approach helps to reduce model parameters and enhance the model performance. The combination of CNN and GRU enables further extraction of high-level features in sequences. In addition, the study shows that appropriate hyperparameters have a positive impact on the model performance. Physicochemical properties can be used to supplement characterization information to improving model performance. The experimental results show that MAHyNet has better performance than other models.