Poor weather and less spending on maintenance by recession-hit firms could be causing more debris to fall from Britain's buildings, according to an expert.