You may have a problem with one of the vacuum pipes which go to the relay valves, I had this problem and it turned out to be a broken connection on a vacuum chamber located behind the brake servo, I removed the chamber and sealed the broken connection then used one of the spare connections which had been plugged off, problem now gone. hope this helps you sort it out,