From mathias.weiersmueller at credit-suisse.com Tue Dec 18 19:52:55 2007 From: mathias.weiersmueller at credit-suisse.com (=?iso-8859-1?Q?Weiersm=FCller_Mathias_=28KIPO_14=29?=) Date: Tue, 18 Dec 2007 20:52:55 +0100 Subject: maximum file descriptors not higher than 983 Message-ID: I am trying in vain to increase the number of file descriptors that web polygraph uses: when starting polyctl, I get the following message: == snip ==== 000.01| FDs: 65535 out of 65535 FDs can be used; safeguard limit: 983 == snip ==== => Why does the safeguard limit stay at such a low level? Additional information here: ============================ Limits: ------- ulimit -n => 8192 ulimit -Hn => 65535 cat /proc/sys/fs/file-max => 205300 System information: ------------------- OS: Ubuntu Linux, version: gutsy Kernel: 2.6.22-14-server g++ version: 4.1.3 CPU: Dual-Intel Xeon CPU 3.20GHz polygraph information: ---------------------- version: 3.0.6 configured: with option: --without_ssl => when running ./configure, these might (?) be the interesting lines: checking for set_new_handler... no checking Default FD_SETSIZE value... 1024 checking Maximum number of filedescriptors we can open... 65536 I am clueless. Are there other parameters to check/change? Thanks in advance for a hint! BTW: web polygraph really rocks! Although I had a quick look on the application before, I just realized how powerful the whole suite is! Regards Mathias From marek_lewkowicz at securecomputing.com Wed Dec 19 09:11:56 2007 From: marek_lewkowicz at securecomputing.com (Marek Lewkowicz) Date: Wed, 19 Dec 2007 10:11:56 +0100 Subject: maximum file descriptors not higher than 983 In-Reply-To: References: Message-ID: <4768E05C.9060906@securecomputing.com> Hello Mathias, I got the same problem when I played with Polygraph installed on Debian4. For older kernel version (2.4) there was some trick to modify kernel headers to convince Polygraph for more file descriptors. Unfortunately I've found nothing for 2.6 kernels. It seems that during compilation and runtime Polygraph is not taking these "ulimits" but some kernel headers. I decided to use FreeBSD because Polygraph was written on this platform. With FreeBSD of course problem is gone. On the other hand... it would be nice to use Polygraph with other platforms too... Alex? Marek Weiersm?ller Mathias (KIPO 14) wrote: > I am trying in vain to increase the number of file descriptors that web polygraph uses: > > when starting polyctl, I get the following message: > > == snip ==== > 000.01| FDs: 65535 out of 65535 FDs can be used; safeguard limit: 983 > == snip ==== > > => Why does the safeguard limit stay at such a low level? > > Additional information here: > ============================ > Limits: > ------- > ulimit -n => 8192 > ulimit -Hn => 65535 > cat /proc/sys/fs/file-max => 205300 > > System information: > ------------------- > OS: Ubuntu Linux, version: gutsy > Kernel: 2.6.22-14-server > g++ version: 4.1.3 > CPU: Dual-Intel Xeon CPU 3.20GHz > > polygraph information: > ---------------------- > version: 3.0.6 > configured: with option: --without_ssl > => when running ./configure, these might (?) be the interesting lines: > checking for set_new_handler... no > checking Default FD_SETSIZE value... 1024 > checking Maximum number of filedescriptors we can open... 65536 > > > I am clueless. Are there other parameters to check/change? > > Thanks in advance for a hint! > BTW: web polygraph really rocks! Although I had a quick look on the application before, I just realized how powerful the whole suite is! > > Regards > > Mathias -------------- next part -------------- An HTML attachment was scrubbed... URL: From rousskov at measurement-factory.com Wed Dec 19 17:49:00 2007 From: rousskov at measurement-factory.com (Alex Rousskov) Date: Wed, 19 Dec 2007 10:49:00 -0700 Subject: maximum file descriptors not higher than 983 In-Reply-To: <4768E05C.9060906@securecomputing.com> References: <4768E05C.9060906@securecomputing.com> Message-ID: <1198086540.42755.212.camel@pail.measurement-factory.com> On Wed, 2007-12-19 at 10:11 +0100, Marek Lewkowicz wrote: > Hello Mathias, > > I got the same problem when I played with Polygraph installed on > Debian4. For older kernel version (2.4) there was some trick to modify > kernel headers to convince Polygraph for more file descriptors. > Unfortunately I've found nothing for 2.6 kernels. Here is what I do for Ubuntu 2.6.15-26-server: 1) Edit /etc/security/limits.conf: * soft nofile 16384 * hard nofile 16384 2) If you compile Polygraph on this box, then edit /usr/include/linux/posix_types.h and /usr/include/bits/typesizes.h to #define __FD_SETSIZE as 16384 The above two steps were sufficient for me. I am not a Linux guru though and YMMV. More information can be found at http://bcr2.uwaterloo.ca/~brecht/servers/openfiles.html but it may be outdated in places. HTH, Alex. > Weiersm?ller Mathias (KIPO 14) wrote: > > I am trying in vain to increase the number of file descriptors that web polygraph uses: > > > > when starting polyctl, I get the following message: > > > > == snip ==== > > 000.01| FDs: 65535 out of 65535 FDs can be used; safeguard limit: 983 > > == snip ==== > > > > => Why does the safeguard limit stay at such a low level? > > > > Additional information here: > > ============================ > > Limits: > > ------- > > ulimit -n => 8192 > > ulimit -Hn => 65535 > > cat /proc/sys/fs/file-max => 205300 > > > > System information: > > ------------------- > > OS: Ubuntu Linux, version: gutsy > > Kernel: 2.6.22-14-server > > g++ version: 4.1.3 > > CPU: Dual-Intel Xeon CPU 3.20GHz > > > > polygraph information: > > ---------------------- > > version: 3.0.6 > > configured: with option: --without_ssl > > => when running ./configure, these might (?) be the interesting lines: > > checking for set_new_handler... no > > checking Default FD_SETSIZE value... 1024 > > checking Maximum number of filedescriptors we can open... 65536 > > > > > > I am clueless. Are there other parameters to check/change? > > > > Thanks in advance for a hint! > > BTW: web polygraph really rocks! Although I had a quick look on the application before, I just realized how powerful the whole suite is! > > > > Regards > > > > Mathias > _______________________________________________ > Users mailing list > Users at web-polygraph.org > http://www.web-polygraph.org/mailman/listinfo/users From mathias.weiersmueller at credit-suisse.com Thu Dec 20 12:14:56 2007 From: mathias.weiersmueller at credit-suisse.com (=?iso-8859-1?Q?Weiersm=FCller_Mathias_=28KIPO_14=29?=) Date: Thu, 20 Dec 2007 13:14:56 +0100 Subject: maximum file descriptors not higher than 983 Message-ID: Marek and Alex, thank you very much for your answers! I changed the parameters as you specified: ================================== Here is what I do for Ubuntu 2.6.15-26-server: 1) Edit /etc/security/limits.conf: * soft nofile 16384 * hard nofile 16384 2) If you compile Polygraph on this box, then edit /usr/include/linux/posix_types.h and /usr/include/bits/typesizes.h to #define __FD_SETSIZE as 16384 ================================== - logged out and logged in again for the limits change to be picked up - compiled it and ran it on the same box => voila and heureka, worked! === snip === FDs: 16384 out of 16384 FDs can be used; safeguard limit: 15878 === snip === Thank you again - I did the most of the changes before, but missed to adjust posix_types.h . Cheers and have a quiet holiday season! Mathias