I wouldn't worry about a couple of seasons hanging around outside the top four, 7th, 5th, and maybe 5th again is nothing to wrinkle your nose at considering the struggling squad you inherited. Considering that you're looking to oust Manchester City and Liverpool, Chelsea, a resurgent Arsenal, and other sides like Manchester United and Spurs who always aim for the top 6, two 5th placed finishes with Aston Villa is progress. Might be a few seasons before you make a genuine challenge for the league, but that's fine, just be patient and it will come.
1