Archive for the 'Experiments' Category
There are so many browsers out there, with Internet Explorer, Firefox, Chrome, Safari and Opera just being the most popular ones. Internet Explorer has been the king of all browsers regarding the market share, but mainly because it was pre-installed on all Windows versions after Windows 95. But over the last months, Internet Explorer’s marketshare has decreased to only slightly above 60% while Firefox almost managed to break the magical 25%-barrier, and even Chrome can claim more than 6% although it was released just one and a half years ago.

Since more and more users seem to consider switching from Internet Explorer to other browsers, they all have the tough choice of finding the right browser. I created this browser roundup to compare the latest versions of all major browsers and show their strengths and weaknesses.
The Contestants
I used the latest available final versions of all these browsers. Beta or Alpha versions are not considered as they may be unstable and thus do not qualify for everyday use. Internet Explorer was running in 64-bit, all other browsers in 32-bit.
The Benchmark System
This is the system used for benchmarking all these different browsers. All other tasks were terminated during the benchmarks except for Avira AntiVir.
- Processor: AMD Phenom II X4 955 (3.2GHz)
- Mainboard: Gigabyte GA-MA790XT-UD4P
- Memory: 2×2GB A-Data DDR3-1333 (CL 7-7-7-24 2T)
- Graphics: Gainward Nvidia GTX 260 (680/1400/1150MHz)
- Hard Disk: Samsung Spinpoint F3 1000GB (7200RPM, 32MB cache)
- Operating System: Windows 7 Ultimate 64-bit
The Features Tested
- Performance – JavaScript and Rendering tested with Sunspider, Peacekeeper, Dromaeo, V8
- Standards Conformity – Compliance to HTML, CSS and JavaScript standards tested with Acid3, CSS3 Selectors Test
- Loading Speed – Time to load websites tested with Numion Stopwatch on three websites
- Startup Speed – Time it takes the browser to launch
- Memory Usage – The amount of memory used with 1, 11 and 25 tabs
- Customization – The amount of addons and themes available
- Security – Vulnerability to different hacks, block rate of malicious websites
Testing the security was a really hard job. The only reliable data was the block rate. All browsers passed the hacking tests and the amount of vulnerabilities over the last years does not allow to judge the security. Data for the mean time of patch release was not available.
The Results – Overview
I analyzed and created charts for every single test, but these detailed statistics won’t be interesting for most people, so here are the overall results. A German version of this summary can be found on PCMasters.de.

The results of all tests have been summed up and weighted in order to create these final results. Further details on the weighting can be found below. All results based on time (Loading Speed and Startup Speed) and the memory usage are inverted so that higher scores are always faster. Security is left out due to the reasons mentioned above. Please remember: All tests were executed on the system named above. Results on other systems may vary. Numbers (e.g. addons, themes, vulnerabilities) were current at the time of creation of this benchmark (14th of April 2010) and may increase in the future).
The Results – Analysis
Performance: This measurement of performance indicates how fast websites can be drawn, scrolled or zoomed after all the content have been loaded, and how fast complex applications such as Google Docs are running. Opera and Chrome are clearly leading regarding the JavaScript and rendering performance, closely followed by Safari. The popular Firefox browser is quite slow compared to the ones named before, and Internet Explorer is really much slower than the others. This aspect is especially important for slow computers like netbooks.
Standards Conformity: There are some standards like HTML and CSS that define how the website is supposed to look like. Web developers should write their HTML-Code according to the standards so the website can be displayed correctly. But when the browser used by a visitor does not comply to these standards, the website may not be displayed correctly or some buttons may not work at all. This really slows down web development because developers have to create different versions of their scripts and have to test all browsers which is quite costly. Low standards conformity in Internet Explorer 6 caused Google to dis-continue support for this browser in order to force users to migrate to better ones. All browsers except Internet Explorer 8 comply quite well to the web standards, just Firefox takes a little hit by scoring just 95% on Acid3. Users should really choose a browser that scores high in this section in order to be able to view and use every website perfectly.
Loading Speed: This comparison shows how long it takes browsers to load websites using the same internet connections. As you can see there isn’t much difference between all browsers, Internet Explorer is slightly faster than the rest, but only by a few percent. Opera and Chrome could perform better using their features Opera Turbo or Chrome DNS Prefetching, but these features were disabled during the test.
Startup Speed: Determines how long it takes the browser to start up and load the front page (google.com in this case). Internet Explorer 8 is the fastest one here, but regarding the absolute values this doesn’t count much: Internet Explorer needs 0.8 seconds while Firefox, the slowest starting browser takes 2.4 seconds. Assuming the average user would start his browser 10 times a day, using Internet Explorer over Firefox would only save 16 seconds.
Memory Usage: Loading a website and rendering its contents always needs some of your system memory (RAM). But different browsers use their memory more or less efficiently, as the chart above is showing. Firefox and Safari were most efficient, Internet Explorer least efficient. Considering the fact that Internet Explorer used 521MB with 25 tabs open and 291MB with 11 tabs open, most users with modern computers (having 2-4GB of memory) won’t notice this much. Older and slower computers or netbooks mostly have limited memory (512-1024MB) and thus are more dependent on memory-efficient browsers like Firefox.
Customization: This includes the amount of addons and themes available for each browser. Many users don’t like the default interface of their browser and want to change it, or just want to add more features such as ad-blocking or notificiations (Facebook, Mail, etc) to their browser. This can be provided by using addons. The more addons and themes are available, the higher is the probability of finding just the ones you need. Firefox is most customizable with more than 12000 addons and 400 themes. Chrome and Opera with 4000/1400 addons and 400/120 themes can be adjusted as well, but Internet Explorer and Safari don’t offer many options here.
There is no way of summing up all these points to come to the conclusion “this is the best browser, this is the worst one”, because every user considers the aspects differently. Thus I will try to give some recommendations who should use which browser. I won’t recommend Internet Explorer anywhere due to its bad implementation of web standards and the shortcoming regarding performance.
The Results – Recommendations
Netbook-User: Netbooks have quite slow processors and thus need a browser with high performance, given by Opera and Chrome. But most Netbooks also have very limited memory, thus the browser should be quite memory-efficient like Firefox and Safari. Firefox is performing quite bad in all the performance tests, so Opera, Chrome or Safari would be the best choice for Netbook users.
Poweruser: If you surf the web every day for a long time using many different tabs you really need performance and memory efficiency. Again, Opera, Chrome and Safari offer these features in combination with perfect implementation of web standards. Safari’s loading speed is slightly better than Opera’s and Chrome’s, but Opera and Chrome have their Turbo and DNS Prefetching technologies respectively to boost page loading. It’s a difficult choice.
Customizer: If you want your browser to look exactly the way you need it, every button to be at the right place, and every feature to be directly available inside the browser, Firefox would be the choice. This browser offers more than 12000 addons and 400 themes for users for whom performance doesn’t matter that much.
Average User: The average user surfs the web only occasionally to check mails, research something or watch some video on YouTube. He doesn’t need any fancy features or designs and just wants to enjoy his web experience. Here almost every browser would fit, but most of them have a lot of features nobody actually needs. Chrome offers good performance, a simple interface with just the buttons required to do normal surfing and comfortable features such as an integrated history search inside the URL box.
The Results – Detailed Statistics and Analysis
The following part will show detailed statistics of the different tests and explain some results. All raw-data is stored in an Excel file you can download here, containing the exact scores and timings, URLs of tests and websites used and comments regarding errors or settings.
Performance:

Opera is leading regarding the performance, directly followed by Chrome and Safari. Firefox isn’t performing that well, but Internet Explorer clearly looses this battle. Its performance is far below the other browser’s, and the Internet Explorer 8 wouldn’t even start the Dromaeo test due to its bad implementation of web standards. Sunspider results are inverted to show runs per minute. On the testing system Opera was fastest with 6174 points in Peacekeeper and 434.52 in Dromaeo. Safari leads with an average of 595.4ms in Sunspider, and Chrome with 4397 points in V8.
Standards Conformity:

In order to check whether a browser complies to web standards, the Acid3 and CSS3 Selectors Test were used. Opera, Chrome and Safari pass Acid3 with 100%, Firefox scores 92% and Internet Explorer only 20%. All browsers except Internet Explorer passed the CSS3 test with 100%, Internet Explorer just passed 349 of 578 tests.
Loading Speed:

In order to measure how fast a browser can load different websites, the numion’s StopWatch was used. Loading speed was tested on three different websites and recorded as the average of two tests. Loading times for ESPN range from 2.2 to 3.5 seconds, from 0.5 to 0.9 seconds for Google and from 2.1 to 4.5 for this website. As you can see, the results are not really homogeneous, so one can’t conclude that one browser is loading faster than the other one.
Startup Speed:

When looking at the startup speed (starting the browser and loading the homepage google.com), Internet Explorer is clearly the winner and Firefox clearly the looser. But when considering the time it actually takes the browser to launch, from 0.8 seconds for Internet Explorer and 2.4 seconds for Firefox, this doesn’t really affect the browsing experience and can be neglected.
Memory Usage:

In order to measure the real memory usage (which can be quite difficult for browsers like Chrome who run multiple processes) the total memory usage of the whole system was measured before browser launch, after 1 tab, 11 tabs and 25 tabs. The memory usage results are inverted to show lower usage as higher score. Running one tab with just google.com in it, all browsers except Safari required between 55MB and 61MB, while Safari took only 32MB. Running more tabs, Firefox clearly leaves the concurrents behind with just 165MB for 11 tabs (others between 219MB and and 291MB) and 271MB for 25 tabs (others between 372MB and 521MB). For calculating the total score the memory usage for 25 pages was weighted only 50% because most users never open that many tabs. You can find the list of pages opened in all browsers here.
Customization:

To compare the ways of customizing the different browsers, the amount of addons and themes was assessed. Firefox has more than 12000 addons and, followed by Chrome with only above 4000. Similarly, Firefox has most themes with more than 400, closely followed by Opera. Internet Explorer and Safari didn’t have many addons and no official way of customizing the interface or theme. There were some third-party applications to chance their looks but they can’t be considered as official themes.
Security:

Comparing the security of different web browsers was a really hard job. The company scanit released a test that tries to crash browsers using various security leaks, but every browser managed to resist all of them. Then the block rate of malicious websites was considered: Internet Explorer blocks 85% of all malicious links tested, followed by Firefox and Safari with 29%, Chrome with 17% and Opera with only 1%. Just blocking links doesn’t make the browser safe from hacker attacks, so this does not really show the security of a browser. Then the public security vulnerabilities (leaks that are known to the browser developers and hackers that were not closed by a patch before being known publicly) were counted (inverted in the diagram). There was no data available for Chrome, and since Safari only had 4 of these vulnerabilities it is clearly leading here. The last diagram shows the amount of vulnerabilities found for each browser in the NVD. But since some browser exist for a very long time (e.g. Firefox and Internet Explorer) and some just for a few years (Chrome), I can’t really compare the amount of vulnerabilities ever found. This is why there is no total security score in the summarized diagram.
I hope this browser roundup gives an overview over the features and possibilities offered by each browser. If there are any suggestions, please comment! Screenshots to prove all results are available, but too big to be uploaded here. If you want me to prove any of the results, just comment or write an email and I will send the screenshots.
VN:F [1.0.7_345]
Rating: 7.8/10 (27 votes cast)
9 Comments »
In this series, I’m going to focus on comparing different Virtual Machines running Windows and their performance regarding different tasks such as single-threaded CPU-only applications, multi-threaded programs or even games requiring hardware 3D acceleration.
This article will show you when and for what to use VMware Player.
VMware Player is quite similar to Sun Virtual Box. You can also configure almost everything, from CPU count over memory to graphics acceleration. VMware Player can’t assign more cores than the computer actually has to the VM, but features better hardware graphics acceleration and up to 256MB of video memory. This also enables Windows 7 to run Aero and the glass effects smoothly.

I installed Windows 7 64-bit in the VM and compared the performance to my native Windows 7 64-bit. Like in VirtualBox, hardware acceleration is supported, but not required. The installation is even easier than in VirtualBox: Tell VMware Player which OS you plan to install, and it automatically suggests hardware configuration and manages the installation process by clicking the right buttons. After installation, it will install the VMware tools that include 3D driver support and other programs that make using the VM more comfortable.
A nice function that both VirtualBox and VMware Player support is the option to assign devices either to the host OS or the virtual one. This enables the user to connect two mice and keyboards and assign them to host and virtual OS. Now the virtual OS can be moved to a second screen and both users can use the computer simultaneously.
Performance:
Settings:
CPU count: 2
RAM: 1500MB
GPU acceleration: yes, 256MB, DirectX 9
First of all, the Windows 7 System Rating shows that both CPU and GPU performance in the VM are quite good, only the memory is a bit too slow:

To test how strong the VM really is, I ran SuperPI and got these results: It took the VM 0.773 seconds longer to complete the calculation, which equals a performance loss of 3.3%. This is a quite good result, similar to Microsoft Virtual PC, but not as good as VirtualBox.

Since the graphics acceleration really seems to work here, I tried some games to prove it. Older games such asCall of Duty, Couter-Strike 1.6 and Civilization were running nicely, Warcraft 3 had some texturing problems, and quite new games like Call of Duty 5 – World at War didn’t really run (I got around 4 FPS).

All in all, VMware Player is quite good in all fields: CPU performance, GPU performance and ease of use (installation and VMware tools). Moreover, working with it felt smoother than in VirtualBox or Virtual PC, but that may be due to Aero. This means one can work with VMware Player and even play older games. Regarding the possibility to connect keyboard and mouse to the VM and moving it to a second screen basically enables you to create a second, virtual computer that allows another user to work, play or watch movies on the same hardware at the same time.
VN:F [1.0.7_345]
Rating: 8.5/10 (4 votes cast)
1 Comment »
Sunday, February 21st, 2010, 12:28 pm |
Computer,
Experiments,
Gaming,
Hardware,
Software,
Tutorials,
Virtual Machines,
WindowsIn this series, I’m going to focus on comparing different Virtual Machines running Windows and their performance regarding different tasks such as single-threaded CPU-only applications, multi-threaded programs or even games requiring hardware 3D acceleration.
This article will show you when and for what to use Sun VirtualBox.
For these tests, I used a quite uncommon configuration: I ran a virtual Windows 7 on my native Windows 7. Most users probably won’t do this, but there is a reason why I chose this OS configuration: Sun VirtualBox allows you to use more CPU cores than you actually have.

The OS installation with Virtual Box is quite easy, just insert your install DVD into the real drive, create a new VM with the hardware configuration you like and tell VirtualBox which OS you’re planning to install. Then allocate your DVD to the VM and start the installation. Worked greatly with Linux, Windows XP and Windows 7 and VirtualBox automatically installed its tools to enable automatic mouse grabbing and this kind of stuff.
In contrast to Microsoft Virtual PC, VirtualBox comes with GPU acceleration, but only allows you to use up to 128MB of video memory. Moreover, the drivers are still beta, so the performance is not as good as you would like it to be.
Performance:
For this test, I didn’t choose settings that any serious user would try, but decided to test the option of using 8 cores.

Settings:
CPU count: 8
RAM: 2048MB
GPU acceleration: yes, 128MB video memory
I searched for a benchmarking program that can use any number of threads and found wPrime. Since it can be scaled to 4 or 8 cores, it was capable of running on both my real quad-core and on the virtual octo-core and still using all the cores.


The virtual octo-core was 0.303 seconds slower, which equals 1.9% performance loss. This is quite surprising when you consider that four of the cores are just simulated and the real OS and processor have to split up the work somehow. These results are even better than the ones I got from Microsoft Virtual PC where the performance loss was about 3.9%.
Hardware graphics acceleration should be there, but don’t expect too much. The drivers are still beta, the video memory is just 128MB and the graphics performance of VMs has never been close to the CPU performance. Unfortunately, I couldn’t get the DirectX acceleration to work, neither on Windows 7 64-bit nor on Windows XP 32-bit. That’s a pity because the only VM supporting graphics acceleration is VMware Player then.
All in all, VirtualBox is a really nice tool due to its possiblities of configuration such as using 8 cores, its easy installation and the CPU performance. There is no such feature as direct integration into the host OS as with Virtual PC, but nobody would expect such a feature, and the graphics power isn’t that awesome either, but still better than other VMs supplying just a standard VGA adapter without hardware acceleration or DirectX support.
VN:F [1.0.7_345]
Rating: 6.3/10 (3 votes cast)
1 Comment »
In this series, I’m going to focus on comparing different Virtual Machines running Windows and their performance regarding different tasks such as single-threaded CPU-only applications, multi-threaded programs or even games requiring hardware 3D acceleration.
This article will show you when and for what to use Microsoft Virtual PC and the XP mode that comes with Windows 7.
The first thing to mention is the fact that Virtual PC requires hardware-assisted virtualization which must be supported by both CPU and mainboard. Many older and mainstream mainboards do not include this function and thus render the user unable to use Virtual PC. Most other Virtual Machines can profit from virtualization, but do not require it.

A nice feature Virtual PC has is that it can be directly embedded into the host OS (Windows 7). Like in other VMs, you can launch XP Mode normally in its own window with its own desktop and stuff, but all the programs you installed in XP Mode will be directly available from the Windows 7 start menu. Just click the shortcut, wait a few seconds for the VM to boot, and you will see your application running in an Windows XP environment, but the window is on your normal Windows 7 desktop.
Performance:
Settings:
CPU count: 1 (not adjustable)
RAM: 512MB (not adjustable)
GPU acceleration: no
Basically, Virtual PC doesn’t leave you the option to change any settings for your Virtual Machine, but if you really want to do so, you can edit the configuration file manually. Just open it with notepad and change the settings: C:\Users\Lennart\AppData\Local\Microsoft\Windows Virtual PC\Virtual Machines\Windows XP Mode.vmc
Since there is just one CPU and no graphics acceleration, I decided to test the only thing I can, CPU performance. I ran SuperPI first on the VM and then on my native Windows 7 and here is what you get:

The virtual Windows XP took just 0,848 longer than the native Windows 7, meaning a performance loss of 3.9%. This are really good values that basically enable you to work with applications running in the virtual machine as if they were running natively and you shouldn’t feel any slowdown (except for multi-threaded work such as video encoding).
All in all, Microsoft Virtual PC enables you to run old programs that can’t run on Windows 7 for some reason without any major loss in performance. Since there is no GPU support, you can’t use it for gaming, not even some very old games I tried were running. But if you just want to work, XP Mode will be a good choice.
VN:F [1.0.7_345]
Rating: 8.5/10 (2 votes cast)
2 Comments »
Opera claims on its own website that its latest beta version, Opera 10.50b, is the fastest browser the world has seen so far. This statement is based on test results from different browser benchmarks published on the official Opera blog.

As Google Chrome has been the fastest browser for a while and the alpha version of Opera 10.50 caught up quite well with Chrome’s performance but didn’t beat it yet, I decided to check the benchmark results given in the blog post by Opera. I ran all the benchmarks with the same settings as Opera did and also tested all four browsers. The only difference is that I used Chrome 5 (alpha) instead of Chrome 4 which is justified since Opera is also using non-stable builds of their browser. I summed up all the benchmark results in a diagram quite similar to the one used by Opera in order to make comparison easier:

The diagram published by Opera looks like this:

As you can see, the latest version of Opera really beats Chrome in Peacekeeper and Dromaeo, but Chrome is far ahead in both Sunspider and V8. I ran all the benchmarks several times to verify my test results and they are perfectly valid, but still differ from the ones published by Opera somehow. Now one has to ask why there is such a big difference regarding Sunspider and whether Opera faked its scores or the latest version of Chrome really improved in this sector.
All in all, it’s quite clear that Opera is really trying to beat all other browsers when concerning JavaScript performance and manages to catch up with Chrome. It will be interesting to see whether the final version of Opera 10.50 will beat Chrome in all tests or not.
In contrast to Opera, I want my benchmark results to be rock-solid and not to be challenged, so I took screenshots of each result and also created an Excel file that contains all results and the calculations made to create the diagram. You can download the screenshots and the Excel file to check my results.
EDIT:
I spoke to the Opera development team and after some tests, we came to the conclusion that the missing support for SSE4.1 and 4.2 is what makes my Phenom slower than the Core 2 Duo in the Sunspider benchmark.
VN:F [1.0.7_345]
Rating: 7.0/10 (3 votes cast)
9 Comments »
If you have a Google account and use the Google search while logged in, the search engine will try to improve your results by relying on keywords you searched for before and on the websites you visited. In the official help file, they describe this personalized search as follows:
When you search using Google, you get more relevant, useful search results, recommendations, and other personalized features. By personalizing your results, we hope to deliver you the most useful, relevant information on the Internet.
If you use personalized search and have the new beta search interface enabled (enable the new Google Search Interface), Google will show this message on the bottom of each search results page:

VN:F [1.0.7_345]
Rating: 0.0/10 (0 votes cast)
1 Comment »
For some time, the developers at Google were working at a solution to make their search engine faster. Now you can test the new search architecture called “Caffeine” yourself.
Obviously, they reached their goal of increasing the search speed, but didn’t change the search behavior. When searching for normal terms, you can feel a speed increase of up to 75% in my tests, but when using more complex searches with quotes, there is almost no difference.
You can test the new Caffeine search here: http://www2.sandbox.google.com/
Some speed tests:

As you can see, when using quotes, the difference is not that big.
VN:F [1.0.7_345]
Rating: 0.0/10 (0 votes cast)
No Comments »
Just a few weeks ago Futuremark, a company known for creating benchmark programs for Windows computers (3DMark and PCMark), released a new benchmark called “Peacekeeper“. Peacekeeper tests various browser functions such as JavaScript arrays, DOM functionality, rendering and other things often used by today’s modern websites like YouTube, Facebook and GMail.
Why would you need a browser benchmark? The better a browser performs on your system, the faster websites are shown and can interactively been used. This is especially needed when browsing Web 2.0 websites, and on low-end PCs such as netbooks the difference can really be a barrier. I experienced this using my favourite browser Firefox 3.0 on my Asus Eee PC 900: When typing and address into the address bar, the “intelligent search” feature needs so much computing power that the whole browser is stuck. Also using GMail or Facebook doesn’t make fun when you have to wait for a second before you can click, scroll, type, etc… That’s why I switched to Google Chrome. Jukka Mäkinen, Head of PC Products and Services at Futuremark, said:
“People have more choice now in how they experience the internet than ever before. But they may not realize that performance between browsers can vary dramatically, especially on lower-end PCs. With Peacekeeper, it’s simple to compare different browsers and see which one offers the best performance on your PC.”
I compared all the major browsers on my computer (Pentium 4 3.2GHz with Hyper-Threading, onboard S3 graphics) and got quite interesting results:

[poll id="6"]
Continue reading…
VN:F [1.0.7_345]
Rating: 4.0/10 (2 votes cast)
2 Comments »
I created a C# class that allows you to use more than one mouse in your XNA game. Of course this is also working with normal Windows applications, but I specially prepared it to work with XNA. This gives you new possibilities for multiplayer games on a single computer! Currently, it’s only working for mice, but I will add keyboard support soon.
Download MultiInput.dll Version 0.1
I also created a game demonstrating how to use this class and what multiple mice can be used for. I think there are many games that could make use of more than one mouse to enable a cool multiplayer mode. Currently the game is in Alpha stage and doesn’t have many features. It supports up to 6 players (if that many mice are plugged in) who have to stop zeppelins from reaching the other side of the screen by shooting them down. Although there isn’t much to do except shooting the zeppelins, it’s quite funny already.
UPDATE: NEW VERSION AVAILABLE: Download Airship Assault here!
Download MultiInput Sample Game Alpha Version 0.1
Download and install the necessary XNA Framework 3.0 here

Each crosshair can be controlled by one mouse/player. The number in brackets on the bottom is the amout of shots you’ve left in your magazine. Leftclick to shoot, rightclick to reload. When a zeppelin reaches the other side, you will lose a life.
I tested the game only with USB mice, they’re working fine, but it should also work with PS2 mice. If you encounter any errors, please tell me!
Continue reading…
VN:F [1.0.7_345]
Rating: 9.1/10 (14 votes cast)
44 Comments »
Hey guys,
Just yesterday I started a new site with the best receipes for milkshakes and cocktails. I write it only in German, but the Google Translation isn’t that bad actually. I hope you like it and enjoy the drinks!
Original (German) site: http://www.multimolti.com/rezepte/
English Google Translation: Link

VN:F [1.0.7_345]
Rating: 7.5/10 (93 votes cast)
No Comments »