I don't think it'd be too hard, but it would definitely be fun!
I once began writing a story that went back and forth between AJ and Brian's point of views, so I guess that could have been a choose your own adventure, but you couldn't choose whose point of view you wanted to read from. I should try writing an actual choose your own adventure story sometime... dang, this should be fun! Thanks for the idea, lol.