The main concern for not practicing yoga or physical activity in the first trimester is pregnancy loss. Pregnancy loss is fairly common and happens for a variety of reasons. Most pregnancy loss in the first trimester happen due a developmental reason that you do not have any control over.