You have to search for something or tap on one of the POI's (Points of Interest) before the Street View icon wills show up at the bottom right of the screen. If there is no Street View info at the selected location the icon will be a slightly lighter shade of blue.