Upright tombstones are called a die or tablet style grave tombstones, and are usually set to stand upright on a granite base which is set on a cement foundation. Common types are serpentine top shape with sides either polished smooth or balance rock pitched (rough).
The vertical tablet is tall, as the name implies, and can be set on a base or directly on the foundation, in which case it is called a “monolith.”