Although sweet potatoes are often called yams, true yams have rougher, bark-like skin and aren't as sweet. Yams should be very firm with no soft spots.