As far as I can tell, nobody believes that we are suddenly going to go crashing down the table. We just get the odd cryptic hints from an individual will never go so far as to directly predict that we'll lose a game, but is never afraid to point out that we might do.
Stating the obvious, we can cope very well away - we have won 70% of our games, most of them quite comfortably. Each of the 3 defeats have been narrow, and they have usually been due to a late goal.
When we have won home games, it has been against form teams - Wycombe hadn't lost away in 8 months, plus Stevenage and Cambridge had started the season pretty well. Stating the obvious again, our record at home to out-of-form lower table drudge is appalling and is the reason why we are now outside of the playoffs.
If Flitcroft cannot quickly find a way to significantly improve our record in such games then he will deserve to come under pressure.