iCloud Photo Library uploads everything in your Photo Library. There is no option to select individual albums. It's all, or nothing. It may, or may not preserve any albums you've created, but it will upload all the pictures whether they are in an album or not.
The exceptions would be photos in the Photo Stream, and albums that you've synced using iTunes. And maybe Shared iCloud Photos. I'm not sure how it handles those, but they would already be in iCloud anyway, separate from the main photo library.
If you can see the photo using the main Photos tab, then it will be synced to iCloud Photo Library when you that service on.