Pavers on a slope?

in an effort to complete my backyard, I have to either pour concrete or use pavers for a funky L shaped patio. Part of the L has a downhill slop, nothing too steep drops about a foot over its 10 foot width. I want to avoid terracing or retaining walls if possible. At the base of the slope is a big solid 4 by 8 that the outer fence attaches to, the pavers would have that to hold it in place on the downhill side. Think the pavers will work?

Maybe I'm not picturing this quite right, but I wouldn't count on pavers to have any holding power. I live up in the SC mountains, and we've poured tons of concrete---lots of rebar and glass fibers and it seems to last forever without so much as a crack.