The problem is the "degrees vertical" measurement will likely be different, not just front to back but also side to side. Both are critical to make a smooth look.
In other words, one set may "lay back" more than another, AND the "outer edge" may or may not be the same vertical angle.
Not crazy - Just creative!
I say go for it if it's what you want - I've seen things that make much less sense done successfully.
