Creative Nonfiction, As I See It

Recently, at a gathering of writers, a fiction writer happened to comment that nonfiction writing doesn’t involve near the level of creativity that fiction writing does.  I wanted to respond in some way but I didn’t.  I kept quiet because he has four books published and a fifth on its way and I have, well, none.  And also because I wondered if maybe he was right.