We study the properties of an approximation of the Laplace operator with Neumann boundary conditions using volume penalization. For the one-dimensional Poisson equation we compute explicitly the exact solution of the penalized equation and quantify the penalization error. Numerical simulations using finite differences allow then to assess the discretization and penalization errors. The eigenvalue problem of the penalized Laplace operator with Neumann boundary conditions is also studied. As examples in two space dimensions, we consider a Poisson equation with Neumann boundary conditions in rectangular and circular domains.