Aphasia is an acquired communication disorder often resulting from stroke that can impact quality of life and may lead to high levels of stress and depression. Depression diagnosis in this population is often completed through subjective caregiver questionnaires. Stress diagnostic tests have not been modified for language difficulties. This work proposes to use speech analysis as an objective measure of stress and depression in patients with aphasia. Preliminary analysis used linear support vector regression models to predict depression scores and stress scores for a total of 19 and 18 participants respectively. Teager Energy Operator-Amplitude Modulation features performed the best in predicting the Perceived Stress Scale score based on various measures. The complications of speech in people with aphasia are examined and indicate the need for future work on this understudied population.