From unjc.email at gmail.com Thu Aug 8 21:43:57 2013 From: unjc.email at gmail.com (unjc email) Date: Thu, 8 Aug 2013 17:43:57 -0400 Subject: Realistic content simulation In-Reply-To: <87wr5komaa.fsf@gmail.com> References: <87wr5komaa.fsf@gmail.com> Message-ID: I want to know if the content size (i.e. exp(11KB) in the example below) is also effective in CSM. What if I have a cdb of jpg images, does webpolygraph server trim and extend the image files being served in order to achieve the size as specified? If so, will the serving contents still be authentic (image/zip/flash...) files? http://www.web-polygraph.org/docs/userman/csm/ *Content SimpleContent = { mime = { type = "text/html"; extensions = [ ".html" ]; }; size = exp(11KB); cachable = 80%; content_db = "pages.cdb"; // import content templates ... };* Thanks, Jacky On Thu, Apr 12, 2012 at 2:08 PM, Dmitry Kurochkin < dmitry.kurochkin at measurement-factory.com> wrote: > Hi Jacky. > > unjc email writes: > > > Hi there, > > > > I have followed the Realistic content simulation manual to try to > > create realistic image contents. Here are what I have done: > > > > 1. Created cdb file > > I have created cdb file that contains jpg image files only. > >> polygraph-4.3.1/src/csm/cdb --add wp.cdb media/*.jpg > > > > Question: Can I add different file types (.jpg, .gif, .png) and kinds > > (.flv, .html, .swf) into the cdb file? > > > > PGL ContentType uses all objects in the given cdb database. You can add > any files to a single cdb database but PGL ContentType would not > distinguish between them which is probably not what you want. > > > > > 2. add a PGL ContentType for images from that database > > > > Content ImageContent = { > > kind = "image"; > > mime = { type = "image/jpeg"; extensions = [ ".jpg" ]; }; > > //obj_life_cycle = olcImage; > > //size = const(13KB); > > cachable = 0%; > > checksum = 1%; > > content_db = "workloads/wp.cdb"; // import content templateS > > }; > > > > Server S = { > > kind = "S101"; > > contents = [ ImageContent ]; > > direct_access = contents; > > ... > > > > > > I download an image from one of the URLs and try to view it on a > > browser; but the image is shown broken. > > http://hostname:9090/w1925a4f2.210b3b17:00000008/t03/_00000003.jpg > > > > You should use "--format verbatim" option when adding images to cdb > database. This would > > Regards, > Dmitry > > > > > Please advise if I have missed any step in creating the realistic > > image contents. > > > > > > > > > > Thanks, > > Jacky > > _______________________________________________ > > Users mailing list > > Users at web-polygraph.org > > http://www.web-polygraph.org/mailman/listinfo/users > -------------- next part -------------- An HTML attachment was scrubbed... URL: From unjc.email at gmail.com Fri Aug 16 15:34:09 2013 From: unjc.email at gmail.com (unjc email) Date: Fri, 16 Aug 2013 11:34:09 -0400 Subject: Keep traffic distribution throughout ramp phase Message-ID: Hello there, Could someone please advise if there is a way to keep the traffic distribution throughout the ramp phase? Because the response time of each traffic are quite different, I setup one kind of robot for each traffic (GET, GET with query string, POST), instead of using robot of mixed types of requests. I started with populus_factor first; I found the webpolygraph client process did not start the robots with respect to the address distribution specified. For example, I found no GET requests in the first 5 to 10 minutes of the test, it seems to run the POST robots first. Next I tried load_factor and found GET requests dominate the whole channel in the first 10 minutes while there is no QUERY or POST requests. [ GET.addresses: 60%, QUERY.addresses: 30%, POST.addresses: 10%] = robotAddrs(authAddrScheme, theBench); Phase RampPhase = { name = "Ramping"; goal.duration = 60min; populus_factor_beg = smallFactor; //populus_factor_beg = 0; //populus_factor_end = 1.0; load_factor_beg = 0; load_factor_end = 1.0; }; Please help. Thanks, Jacky -------------- next part -------------- An HTML attachment was scrubbed... URL: From rousskov at measurement-factory.com Fri Aug 16 16:14:55 2013 From: rousskov at measurement-factory.com (Alex Rousskov) Date: Fri, 16 Aug 2013 10:14:55 -0600 Subject: Keep traffic distribution throughout ramp phase In-Reply-To: References: Message-ID: <520E4FFF.8070609@measurement-factory.com> On 08/16/2013 09:34 AM, unjc email wrote: > I started with populus_factor first; I found the webpolygraph client > process did not start the robots with respect to the address > distribution specified. For example, I found no GET requests in the > first 5 to 10 minutes of the test, it seems to run the POST robots first. When populus factor is used, the next robot to start is selected at random. The only way I can explain the above anomaly is if your total number of robots is so small that 60%*16% = 10% of them is still likely to be zero. 60% - proportion of GET ribits 16% - 10 minutes out of 60 minute ramp phase How many robots do you have total? > Next I tried load_factor and found GET requests dominate the whole > channel in the first 10 minutes while there is no QUERY or POST requests. With load factor, Polygraph starts all robots at the beginning of the test. If you see no QUERY requests during the first 10 minutes, then perhaps your peak load is so small that 30%*16% = 5% of that peak results in very infrequent requests? What is your peak request rate? Perhaps you can post the entire workload? Thank you, Alex. > [ GET.addresses: 60%, QUERY.addresses: 30%, POST.addresses: 10%] = > robotAddrs(authAddrScheme, theBench); > > Phase RampPhase = { > name = "Ramping"; > goal.duration = 60min; > populus_factor_beg = smallFactor; > //populus_factor_beg = 0; > //populus_factor_end = 1.0; > load_factor_beg = 0; > load_factor_end = 1.0; > };