A herb extract for men with a prostate condition has no more effect on it than a dummy version, a study has found.