This note aims to reduce the conservatism of stability criteria for neural networks with time-varying delay. To this goal, on the one hand, we construct an augmented Lyapunov-Krasovskii functional (LKF), incorporating some delay-product terms that capture more information about neural states. On the other hand, when dealing with the derivative of the LKF, we introduce several parameter-dependent slack matrices into an affine integral inequality, zero equations, and the S-procedure. As a result, more relaxed stability criteria are obtained by employing the so-called Lyapunov-Krasovskii Theorem. Two numerical examples show that the proposed stability criteria are of less conservatism compared with some existing methods.