You can add a vertical menu from WordPress Administration (for dynamic sidebars) by going to Appearance -> Widgets -> Vertical menu.
After adding the menu you can select its source by pressing "Edit" and specifying the source as "Pages", or "Categories", or "Custom Menu".