Phase stats sync assertion error

[William Law]

Hi all,
Running polygraph 4.9.0 on CentOS 6.8 (compiled from tarball).  While the
simple tests, etc seem to run ok, a more gung-ho configuration that ran ok
on an earlier version doesn't want to play ball with the new configuration.

I'm getting random assertion fails on both polygraph-client and
polygraph-server:

StatPhaseSync.cc:97: assertion failed: 'false'

Sometimes it may be after a single request of a robot to one of the servers,
or randomly on the servers.

Server ip ranges: 2.2.2-3.10-250/22 (40 nodes occupying that range)
Client ip ranges: 1.1.1-2.10-250/22 (70 nodes here)

I get less errors when using GET vs POST.

Test environment is pretty basic currently:

Client <-> router <-> Server

Please let me know if you want any further information and I'll see what I
can do.

TIA

Kind Regards,
William Law


Polygraph was built with the following versions:
gcc             4.4.7-18.el6
gcc-c++         4.4.7-18.el6
gnuplot         4.2.6-2.el6
gnuplot-common  4.2.6-2.el6
ldns-devel      1.6.16-7.el6.2
libgcc          4.4.7-18.el6
make            1:3.81-23.el6
ncurses-devel   5.7-4.20090207.el6
openssl-devel   1.0.1e-57.el6
patch           2.6-6.el6
zlib-devel      1.2.3-29.el6

Example client command:
polygraph-client --worker 61 --ports 3000:65535 --fake_hosts
1.1.2.185-191 --cfg_dirs /usr/local/share/polygraph/polytests --config
LargeUploads.pg --log /var/log/polygraph/clt.61.log --verb_lvl 10

Server command:
polygraph-server --worker 40 --fake_hosts 2.2.3.238-249 --cfg_dirs
/usr/local/share/polygraph/polytests --config "LargeUploads.pg" --log
/var/log/polygraph/srv.40.log --idle_tout 300sec
 >>/var/log/polygraph/pserver.log 2>&1

Test config:
Phase ph2 = {
        name = "MultiUser-Download";
        goal.duration = 5min;
        primary = true;
};

Content DownloadContent = {
        size = const (20MB);
        mime = {
                type = undef();
                prefixes = [ "page" ];
                extensions = [ ".dat" ];
        };

        cachable =0%;
};

Server S = {
        kind = "S101";
        contents = [DownloadContent];
        direct_access = contents;
        addresses = ['2.2.2-3.10-250:80/22' ];
};

Content cntSimple = {
    size = unif(50KB, 100KB);
};

Robot R = {
        kind = "R101";
        pop_model = { pop_distr = popUnif(); };
        //req_methods = ["POST":100% ];
        req_methods = ["GET":100% ];
        origins = S.addresses;
        addresses = ['1.1.1-2.10-250/22' ];
        interests = [ "public" ];
};

schedule(ph2);
use(S, R);