This study focuses on grid refinement techniques for the direct simulation of aeroacoustics, when using weakly compressible lattice Boltzmann models, such as the D3Q19 athermal velocity set. When it comes to direct noise computation, very small errors on the density or pressure field may have great negative consequences. Even strong acoustic density fluctuations have indeed a clearly lower amplitude than the hydrodynamic ones. This work deals with such very weak spurious fluctuations that emerge when a vortical structure crosses a refinement interface, which may contaminate the resulting aeroacoustic field. We show through an extensive literature review that, within the framework described above, this issue has never been addressed before. To tackle this problem, we develop an alternative algorithm and compare its behavior to a classical one, which fits our in-house vertex-centered data structure. Our main idea relies on a directional splitting of the continuous discrete velocity Boltzmann equation, followed by an integration over specific characteristics. This method can be seen as a specific coupling between finite difference and lattice Boltzmann, locally on the interface between the two grids. The method is assessed considering two cases: an acoustic pulse and a convected vortex. We show how very small errors on the density field arise and propagate throughout the domain when a vortical flow crosses the refinement interface. We also show that an increased free stream Mach number (but still within the weakly compressible regime) strongly deteriorates the situation, although the magnitude of the errors may remain negligible for purely aerodynamic studies. A drastically reduced level of error for the near-field spurious noise is obtained with our approach, especially for under-resolved simulations, a situation that is crucial for industrial applications. Thus, the vortex case is proved useful for aeroacoustic validations of any grid refinement algorithm.