This is a good question and it refers to the difference between deflation and disinflation. Sometimes if inflation is at 2% and it decreases to 1.5% for example, there will still continue to be a general price level increase of 1.5% over the next month, but the rate of increase in prices has slowed down.
Disinflation is this slow down in the increase in prices but the prices do still increase. What you're thinking of is deflation which means that inflation is negative and the price level is decreasing. Deflation is quite rare in economics but disinflation happens all the time due to slowing of the increase in the price level.