The potato plant is a nightshade, closely related to the tomato. All nightshades contain poisonous alkaloids, including small amounts in tomato fruits and green potato skins.

The potato is still a vegetable though… Vegetable is a culinary term and can apply to any part of a plant, including roots and tubers.