Firstone,
Yes, that is the oven exhaust or chimney. Just like with a residential gas fired oven, you have to vent the combustion byproducts and moisture. You keep from losing all the heat because you're making more heat than is leaking out, unless the door is open. Try it, it really works.