Predicting how pedestrians will move in the future is crucial for robot navigation, autonomous driving, and video surveillance. The complex interactions among pedestrians make it difficult to predict their future trajectory. Previous studies have primarily focused on modeling the interaction features of all pedestrians in the scene. However, this approach often results in an abundance of irrelevant interactions and overlooks the time-dependent characteristics. To address these issues, we propose a spatio-temporal adaptive graph pooling network (STAGP) for pedestrian trajectory prediction. STAGP adopts adaptive graph pooling to explicitly model interactions between pedestrians, redundant interactions and establishing directed interactions. In addition, we utilize spatio-temporal attention to extract temporal features of pedestrian interactions. For the prediction of future trajectories, we use a time-extrapolator convolutional neural network (TXP-CNN). ETH and UCY datasets were used to evaluate STAGP. Comparing STAGP to the values, the experimental results indicate that it is competitive in terms of ADE and FDE metrics.