Symptoms of a vitamin B-12 deficiency can include a swollen tongue, fatigue, weight loss, weakness, dizziness, shortness of breath, and a racing, fluttering or pounding heartbeat. These symptoms can happen when the deficiency causes a low level of red blood cells. This condition is called anemia.