Thursday, February 18, 2010

Getting Started With VDI

The idea of running some of your desktops inside a secure data center has a lot of appeal, but the costs for building the right infrastructure can consume the savings that VDI promises to generate. Here are some guidelines for dealing with these challenges.

Virtual desktop infrastructure (VDI) offers both big promises and big challenges for IT managers. On the plus side, the idea of running some of your desktops inside a secure data center has a lot of appeal, particularly to the generation that grew up during the mainframe computing era and wishes to return to those simpler days. Data and applications can be better protected; endpoints can be more easily patched, cloned and supported; and users can access their desktops from anywhere there is an Internet connection and a Web browser.

On the other hand, the costs for building the right infrastructure can be a real burden and can quickly consume the savings that VDI promises to generate.

As an extreme example, a demonstration held at various trade shows last fall by VDI VAR Green Pages showed a very high density of virtual desktops running from a single Cisco Unified Communications switch. Each desktop had more than 90GB of applications, and streaming a combination of Symantec Workspace Virtualization applications, VMware ESX hosts and VirtualStorm specialized drivers, they were able to run 400 desktops from each of six blades on the switch.

“It required a perfect balance between the desktops, the infrastructure, the virtualization, and the management of the desktops and their applications in order to scale to thousands of desktops in a single environment,” Erik Westhovens, one of the engineers from VirtualStorm.com, wrote on a blog entry about the demonstration.

Let’s look at several challenges to using VDI—and some of the lessons learned by those who are doing it well.

What desktop devices should I use?

Whether you end up using thin or thick clients—or repurposing older PCs—you probably won’t save on capital costs, but you will save on the ongoing operations, support and maintenance costs. “If we have a security breach on a desktop, we just reprovision and it goes away,” says Alan Deloera, the director of technology for the city of Temple, Texas.

The number of thin-client vendors is staggering, from specialized vendors such as Wyse and Priam.com to mainstream vendors such as Hewlett-Packard and Sun. JetBlue Airlines standardized on HP thin clients and claims to have saved millions in its desktop deployment. Plus, there are different XP-based deployments, including some using an embedded XP OS called Windows Fundamentals for Legacy PCs.

J&B Group, a food wholesaler and manufacturer based in St. Michael, Minn., migrated its Citrix Presentation Server terminal services environment to a VDI solution “because we wanted a more consistent look and feel, like our local XP environment,” says Chuck Ballard, network and technical services manager. “We also had a lot of complaints from associates about not being able to browse their local directories and printers, and the support contracts were getting expensive to renew.”

J&B chose Quest Software’s vWorkspace clients and rolled it out to several remote office locations to make it easier to support and deploy applications. “We wanted to extend the use of our older PCs, which saves us about a $1,000 or so per desktop,” Ballard says. “Also, our support staff no longer has to spend time troubleshooting hardware. When we have a problem, we just swap out a spare PC, and our associates are back up and running quickly. Plus, I don’t need to extend warranties for any of this gear: If one breaks, I just replace it.”

Experience Needed

How much experience should I have with virtual machine image management and deployment tools?

If you’ve never used virtualization, now is the time to gain some experience, because a successful VDI rollout will need to build on this experience. The major VM vendors offer tools that make it easier to make wholesale changes across your desktop images, so you can avoid patching individual desktops one at a time.

VMware offers vSphere and vComposer, and Microsoft’s System Center has various plug-ins to work with Hyper-V and its various VDI elements. There are also third-party tools, including LiquidWareLabs.com and VDIworks.com.

Do I have to beef up my network or storage infrastructure to handle the additional traffic demands of virtual desktops?

You need to plan for worst-case scenarios, such as the beginning of a workday when everyone boots up their virtual desktop. That’s when you have to ensure that there’s enough network capacity to send all these bits down the wire. Some VDI solutions, such as Ericom and Synchron, don’t require storage area networks (SANs) right away for smaller deployments.

With the right deployment of SAN technologies, you can save storage costs by deduplicating the virtual images that are stored on them. This is what J&B Group ended up doing with their NetApp arrays, which saved them a lot of storage capacity since most of the VDI images use similar data structures.

What remote control protocol will I use between the virtual desktop and the client device?

Part of this decision is in understanding your network and the tools that are called “connection brokers,” which determine how to marry a particular remote protocol and a desktop host machine. These tools include Citrix Desktop Broker for Presentation Server, LeoStream Virtual Desktop Connection Broker, Ericom and Quest Software’s Virtual Access Suite.

At the University of Rennes, in northern France, they use the Leostream broker to connect more than 500 virtual desktops across the campus. They deploy a variety of operating systems, including both Windows XP and Linux desktops, and these can boot in a minute because of the way they’ve designed the network. The Leostream broker can also quickly scale up as demand for more connections increases, and it integrates with the university’s single sign-on system. “Our users have to authenticate only once when they connect to our portal,” says Humberto Duarte, the IT department co-director.

Will my users be able to access certain legacy hardware that they are accustomed to using from their PCs?

VDI solutions are notorious in their spotty support for these kinds of applications, and only now are we seeing some improvements that will provide the same rich experience that standard PC users take for granted. “For audio and video using Windows Media Player, our VDI solution works fine,” says Duarte. “But if you are playing a Flash video or using another player, it isn’t that good from either our remote desktops or the thin clients.”

Sometimes, a single application can create deployment problems. Jeff Keith, senior network engineer with Redlands Community Hospital in California, says they “initially went with a thin-client device at the desktop to reduce support costs, but ran into a performance issue with a fetal monitoring application. The driver and connection broker client needed on the virtual machine caused high CPU utilization with this application, so we replaced several thin clients with desktop PCs running this app.”

Since then, the hospital has migrated its VDI solution to a high-performance SAN and will replace its PCs with thin clients. “We don’t anticipate any further performance issues,” Keith adds. “We will continue to evaluate new thin clients and technologies as we move forward with our VDI plan.”

If your plans call for supporting these applications, make sure whatever VDI solution you evaluate can address this issue.

Do I understand all the moving parts of my solution?

Finally, make sure you have scoped out your project and detailed all the parts that will make up your VDI implementation. For example, Microsoft’s VDI solution requires four different Remote Desktop servers: Virtualization Host server, Connection Broker, Remote Desktop server itself and Remote Desktop Web Access server. While these can run concurrently on a single piece of hardware, there’s a lot to keep track of.

Microsoft also requires special licensing, called the Windows Virtual Enterprise Centralized Desktop license, in addition to standard enterprise licenses. VMware’s VDI solution is just as complex because a number of different products must work together. That’s when having a VDI VAR can come in handy.

One alternative is to investigate a “starter kit,” which some vendors have assembled to make deploying VDI easier. These include products from HP, Ericom, Synchron and Quest.

We looked at others, but Ericom’s ease of use, technical support and Microsoft integration were big reasons we went with them,” says Larry Pickard, director of IT for the San Francisco Theological Seminary. It’s using 80 VDI clients with HyperV, System Center and, eventually, Wyse thin clients.

Lots of Vmware Links....

I've been collecting Vmware related links for a while and thought I would post them here for others who might like them. (also Oreeh keeps bugging me to post them), so here they are...

Backups:
Virtual Machine Backup Guide - http://www.vmware.com/pdf/vi3_vm_backup.pdf
Consolidated Backup in Vmware Infrastructure 3 - http://www.vmware.com/pdf/vi3_consolidated_backup.pdf
Vmware Consolidated Backup Best Practices, Tips and Tricks - http://download3.vmware.com/vmworld/2006/bct4540.pdf
Backup and Recovery of Virtual Servers - http://download3.vmware.com/vmworld/2006/mdc9870.pdf
Hot Backups and Restores - http://download3.vmware.com/vmworld/2006/tac9816.pdf
Non-disruptive Backups of Vmware Environments Using Veritas Netbackup - http://download3.vmware.com/vmworld/2006/tac9912.pdf
Vmware Consolidated Backup for Disaster Recovery - http://download3.vmware.com/vmworld/2006/labs2006/vmworld.06.lab01-VCB-PRESENTATION.pdf
Perl Backup Script for Vmware ESX - vmbk.pl ( free ) - http://www.vmts.net/vmbk.htm
ESX Ranger ( not free ) - http://vizioncore.com
esXpress ( not free ) - http://esxpress.com
Backup scripts - http://www.rtfm-ed.co.uk/?p=23 and http://www.rtfm-ed.co.uk/?p=156
Shell script - http://www.vmware.com/community/thread.jspa?messageID=475244&#475244
Perl script - http://www.vmware.com/community/thread.jspa?threadID=70253&start=0&tstart=0
Oracle backups - http://www.vmware.com/community/thread.jspa?threadID=76746&messageID=601703#601703
Vmware Consolidated Backup Technology: Today and Future - http://download3.vmware.com/vmworld/2006/bct4539.pdf
Implementing Effective Backup Strategies for Disaster Recover - http://download3.vmware.com/vmworld/2006/bct9502.pdf

Books/Documentation/Learning Resources:
http://www.lulu.com/content/712361
http://www.vi3book.com
http://www.vmguru.com/
Vmware VI3 documentation - http://www.vmware.com/support/pubs/vi_pubs.html
Configuration Maximums for VMware Infrastructure 3 - http://www.vmware.com/pdf/vi3_301_201_config_max.pdf
Vmworld presentations - http://www.vmware.com/vmtn/vmworld/
ESX on non-supported hardware to learn with - http://www.vmware.com/community/thread.jspa?threadID=77560

Citrix
Optimizing Citrix Presentation Server on Vmware ESX Server - http://download3.vmware.com/vmworld/2006/med0115.pdf
Citrix and Vmware - http://download3.vmware.com/vmworld/2006/tac9728.pdf

Cloning:
Newsid - http://www.microsoft.com/technet/sysinternals/Security/NewSid.mspx
Sysprep - http://www.microsoft.com/technet/prodtechnol/winxppro/deploy/duplication.mspx
Sysprep - http://www.vernalex.com/guides/sysprep/

Clustering:
Setup for Microsoft Cluster Service - http://www.vmware.com/pdf/vi3_vm_and_mscs.pdf

Converter/P2V:
Boot.ini file - http://mirror.href.com/thestarman/asm/mbr/bootini.htm
Guide to P2V 2.x - http://www.rtfm-ed.eu/docs/vmwdocs/admin-p2v-2.0.pdf
Vmware P2V Assistant Best Practices - http://download3.vmware.com/vmworld/2006/tac9886.pdf
Converter tutorial - http://www.petri.co.il/virtual_convert_physical_machines_to_virtual_machines_with_vmware_converter.htm
Introducing the Next Generation of P2V: Vmware Converter 3.0 - http://download3.vmware.com/vmworld/2006/tac9453.pdf
Converter FAQ - http://www.vmware.com/products/converter/faqs.html
Converter Manual - http://www.vmware.com/pdf/VMware_Converter_manual.pdf
Converter Release Notes - http://www.vmware.com/support/converter/doc/releasenotes_conv3.html
Converter Data Sheet - http://www.vmware.com/pdf/converter_datasheet.pdf
Converter download - http://www.vmware.com/download/converter/
Import of physical machine fails - http://www.vmware.com/community/thread.jspa?messageID=567860&#567860
Ultimate P2V - http://www.rtfm-ed.co.uk/?page_id=174
EZ P2V - http://www.ezp2v.net/
VMware P2V and Virtual Machine Importer - http://download3.vmware.com/vmworld/2006/labs2006/vmworld.06.lab09-P2V.VMImporter-MANUAL.pdf
What machines should not be converted - http://www.vmware.com/community/thread.jspa?threadID=73357
Remove non-present devices from converted system - http://www.oreilly.com/catalog/winxphks2/chapter/hack116.pdf
http://support.microsoft.com/kb/315539
http://www.vmware.com/support/p2v21/doc/updatedevices7.html
Linux conversion - http://virtualaleph.blogspot.com/2007/04/cloning-linux-machine-with-converter.html
Linux conversion - http://www.vmware.com/community/thread.jspa?messageID=562582&#562582

Domain Controllers/Active Directory:
Virutalization of Active Directory - http://www.vmware.com/community/thread.jspa?messageID=352424&#352424
Considerations when hosting Active Directory domain controller in virtual hosting environments - http://support.microsoft.com/kb/888794
Virtualizing a Windows Active Directory Domain Infrastructure - http://download3.vmware.com/vmworld/2006/tac9710.pdf
How to detect and recover from a USN rollback in Windows 2003 Server: http://support.microsoft.com/kb/885875/
How to detect and recover from a USN rollback in Windows 2000 Server: http://support.microsoft.com/kb/875495/
P2Ving Domain Controllers - http://www.vmware.com/community/thread.jspa?messageID=390630

ESX:
Disabling Web access on the ESX Server - http://www.vmware.com/community/thread.jspa?threadID=59508&tstart=0
Using SCP to Copy Files to or from an ESX Server System - http://kb.vmware.com/kb/1918
Using SCP to Copy Files to or from an ESX Server System - http://www.vmware.com/community/thread.jspa?messageID=599300&#599300
ESX Server 3.0 Tips and Tricks - http://download3.vmware.com/vmworld/2006/tac9567.pdf
Change VM swap file path - http://www.vmware.com/community/thread.jspa?messageID=530426
Change VM swap file path - http://www.vmware.com/pdf/vi3_esx_resource_mgmt.pdf (Page 141)
Vmimages obsolete - http://www.vmware.com/community/thread.jspa?messageID=503192
Vmimages obsolete - http://www.vmware.com/community/message.jspa?messageID=530228
3.0.1 restart bug - http://www.vmware.com/community/thread.jspa?messageID=597633&#597633
3.0.1 restart bug - http://www.vmware.com/community/thread.jspa?threadID=75462&tstart=0

General:
Server product comparison - http://www.vmware.com/products/server_comp.html
Introduction to ESX 3.0.1 and VirtualCenter 2.0.1 - http://www.vmware.com/pdf/vi3_intro_vi.pdf
Tips and tricks for implementing infrastructure services on ESX server - http://www.vmware.com/pdf/tips_tricks_infrastructure_services.pdf
Virtual Infrastructure Implementation Best Practices From A to Z - http://download3.vmware.com/vmworld/2006/adc0051.pdf
Vmware Infrastructure 3 Customer FAQ - http://www.vmware.com/pdf/vi3_customer_faq.pdf
Server Consolidation with VMware ESX Server - http://www.redbooks.ibm.com/redpapers/pdfs/redp3939.pdf
Virtual Machine Cost Calculator spreadsheet - http://www.ronoglesby.com/downloads/vmoglator1.1.xls
TCO Calculator - http://www.vmware.com/products/vi/calculator.html?

HA/DRS:
Automating High Availability (HA) Services with Vmware HA - http://www.vmware.com/pdf/vmware_ha_wp.pdf
Effective DRS and HA in Production - http://download3.vmware.com/vmworld/2006/tac9413.pdf
Resource Management with Vmware DRS - http://www.vmware.com/pdf/vmware_drs_wp.pdf
Resource Management in Vmware ESX Server 3 - http://download3.vmware.com/vmworld/2006/tac9726.pdf
Intel & AMD with HA & DRS - http://www.vmware.com/community/thread.jspa?messageID=526615

Hardware:
Vmotion CPU Compatibility for Intel processors - http://kb.vmware.com/kb/1991
Vmotion CPU Compatibility for AMD processors - http://kb.vmware.com/kb/1992
Vmotion - How to override CPU masks due to cpu mismatch - http://kb.vmware.com/kb/1993
Vmotion requirements - http://www.vmware.com/pdf/vi3_admin_guide.pdf (Chapter 14)
Vmotion between Apples and Oranges: Understanding CPU Compatibility Restraints for Vmotion - http://download3.vmware.com/vmworld/2006/tac1356.pdf
Vmotion and CPU Compatibility - http://www.vmware.com/community/thread.jspa?messageID=452231&#452231
Vmotion Info tool - http://www.run-virtual.com/?page_id=155
HP Management Agents for VMware ESX Server 3.x version 7.7.0 - http://h18023.www1.hp.com/support/files/server/us/download/26407.html
Vmotion and VM Compatibility Matrix for Dell PowerEdge Servers - http://www.dell.com/downloads/global/solutions/vmotion_compatiblity_matix.pdf
Vmotion and VM Compatibility Matrix for HP Proliant Servers - ftp://ftp.compaq.com/pub/products/servers/vmware/vmmotion-compatibility-matrix.pdf
HP Vmotion Compatibility Matrix - http://h18004.www1.hp.com/products/servers/software/vmware/hpvmotion-compatibility-matrix.html
Production Consolidation using VMware and the AMD Opteron Processor - http://download3.vmware.com/vmworld/2006/adc9743.pdf
IBM Insights in Sizing Hardware for Virtualization - http://download3.vmware.com/vmworld/2006/tac4057.pdf
HP Virtualization Management Software - http://h18013.www1.hp.com/products/servers/proliantessentials/valuepack/vms/index.html
10K vs. 15K & iSCSI - http://www.vmware.com/community/thread.jspa?threadID=75202
To vSMP or not to vSMP - http://www.vmware.com/community/thread.jspa?messageID=298150&#298150
Best Practices using Vmware Virtual vSMP - http://www.vmware.com/pdf/vsmp_best_practices.pdf
Hardware recommendations to build a cheap ESX server - http://www.vmweekly.com/articles/hardware_recommendations_to_build_cheap_esx_server/1/
White box/Home ESX system - http://www.vmware.com/community/thread.jspa?messageID=620124&#620124

Licensing:
Vmware licensing page - http://www.vmware.com/download/licensing.html
Server-based License File Checker - http://www.vmware.com/checklicense/
Pricing, Packaging & Licensing Overview - http://www.vmware.com/pdf/vi_pricing.pdf
Install License File - http://www.vmware.com/community/thread.jspa?threadID=76518
Microsoft Virtual Machine Technology FAQ - http://www.microsoft.com/licensing/highlights/virtualization/faq.mspx
Windows Server Virtualization Calculator - http://www.microsoft.com/windowsserver2003/howtobuy/licensing/calculator.mspx
Licensing Microsoft Server Products with Virtual Machine Technologies - http://download.microsoft.com/download/6/8/9/68964284-864d-4a6d-aed9-f2c1f8f23e14/virtualization_whitepaper.doc

Linux:
Getting a DHCP Address in a Red Hat Linux Virtual Machine - http://kb.vmware.com/kb/977
Windows to Linux roadmap - http://www-128.ibm.com/developerworks/linux/library/l-roadmap.html
Windows to Linux roadmap post on Vmtn - http://www.vmware.com/community/thread.jspa?threadID=77279
Install Vmware Tools in a Linux VM under ESX Server 3.x - http://kb.vmware.com/kb/5242329
From DOS/Windows to Linux HowTo - http://www.tldp.org/HOWTO/DOS-Win-to-Linux-HOWTO.html
Universal Command Guide for Operating Systems - http://www.allcommands.com/

Memory:
Host Mem and Guest Mem % - http://www.vmware.com/community/thread.jspa?messageID=620581&#620581
http://www.stanford.edu/~stinson/cs240/cs240_1/revs/esx.txt
The Role of Memory in ESX Server 3 - http://www.vmware.com/pdf/esx3_memory.pdf
Memory resource management in Vmware ESX Server - http://www.vmware.com/pdf/usenix_resource_mgmt.pdf
Understanding memory usage in Windows 2000 - http://www.microsoft.com/technet/prodtechnol/windows2000serv/tips/w2mem.mspx
Operating System Extensions to Support Host Based Virtual Machines - http://www.eecs.umich.edu/techreports/cse/2002/CSE-TR-465-02.pdf
Memory performance - http://www.vmware.com/community/thread.jspa?threadID=65293
Memory Shares/Limits/Reservations - http://www.vmware.com/community/thread.jspa?threadID=73411
RAM, Virtual Memory, Pagefile and all that stuff - http://support.microsoft.com/?kbid=555223
Understanding the Impact of RAM on Overall System Performance - http://www.windowsnetworking.com/articles_tutorials/Understanding-Impact-RAM-Overall-System-Performance.html
RAM, Virtual Memory, Pagefile and all that stuff - http://members.shaw.ca/bsanders/WindowsGeneralWeb/RAMVirtualMemoryPageFileEtc.htm
Pagefile thread - http://www.vmware.com/community/thread.jspa?threadID=79080&messageID=617876#617876
Resizing Memory With Balloons and Hotplug - https://ols2006.108.redhat.com/reprints/schopp-reprint.pdf

Networking:
VMware ESX Server 3 802.1Q VLAN Solutions - http://www.vmware.com/pdf/esx3_vlan_wp.pdf
Networking Virtual Machines - http://download3.vmware.com/vmworld/2006/TAC9689-A.pdf
Networking Scenarios & Troubleshooting - http://download3.vmware.com/vmworld/2006/tac9689-b.pdf
Duplex Mismatch Primer - http://www.happyrouter.com/content/view/32/1/
3rd party software and the new Service Console Firewall - http://kb.vmware.com/KanisaPlatform/Publishing/302/2143_f.SAL_Public.html
Firewall and Netbackup - http://www.vmware.com/community/thread.jspa?messageID=477399&#477399
DMZ & VLANs - http://www.vmware.com/community/thread.jspa?messageID=347532&#347532
ESX & DMZ - http://www.vmware.com/community/thread.jspa?messageID=233918&#233918
ESX & DMZ - http://www.vmware.com/community/thread.jspa?messageID=344471&#344471
ESX VM’s in the DMZ - http://www.vmware.com/community/thread.jspa?forumID=21&threadID=19402&messageID=222399#222399
Second Service Console NIC - http://www.vmware.com/community/thread.jspa?messageID=536518&#536518
NIC teaming and VLAN trunking - http://blog.scottlowe.org/2006/12/04/esx-server-nic-teaming-and-vlan-trunking/
Which NIC is used in cold migration - http://www.vmware.com/community/thread.jspa?messageID=555404&#555404
Esxcfg-firewall - http://72.14.205.104/search?q=cache:do0cm-wxcWsJ:download3.vmware.com/vmworld/2006/labs2006/vmworld.06.lab05-SECURITY-MANUAL-APPENDIX.pdf+esxcfg-firewall&hl=en&ct=clnk&cd=6&gl=us
Service Console and Vmotion NIC sharing - http://www.vmware.com/community/thread.jspa?messageID=146348&#146348
Configure multiple IP addresses to a NIC in Linux - http://handsonhowto.com/virt.html
Configure a static MAC address for a VM - http://virtrix.blogspot.com/2007/04/vmware-configuring-static-mac-address.html
Rename a vSwitch - http://www.vmware.com/community/thread.jspa?threadID=80075&tstart=0
Rename a vSwitch - http://www.vmweekly.com/ask_an_expert/how_can_I_rename_a_virtual_switch/1/
Changing the MAC address of a virtual machine - http://kb.vmware.com/selfservice/microsites/search.do?cmd=displayKC&docType=kc&externalId=507

Patches:
Patch Management for ESX Server 3 - http://www.vmware.com/pdf/esx3_esxupdate.pdf
Download - http://www.vmware.com/download/vi/index.html
ESX patches - http://www.vmware.com/download/vi/vi3_patches.html#c4310
Virtual Center 2.0.1 Patch2 - http://www.vmware.com/support/vi3/doc/vc-201-200702-patch.html
Autopatching ESX host - http://virtrix.blogspot.com/2007/03/vmware-autopatching-your-esx-host.html
Patching and updating Vmware ESX Server 3 - http://download3.vmware.com/vmworld/2006/tac9858.pdf
Automated download of ESX patches - http://www.vmware.com/community/thread.jspa?messageID=600341
Patch Script: - http://www.vmprofessional.com/material/esx-autopatch.pl
Pre-compiled patchlist.txt - http://www.vmprofessional.com/material/3.0.1/patchlist.txt and http://www.vmprofessional.com/material/3.0.0/patchlist.txt
Patch order - http://www.vmware.com/community/thread.jspa?threadID=80531 amd http://www.vmware.com/community/thread.jspa?threadID=80296

Performance:
VMware ESX Server guest performance tips Pt .1 - http://searchservervirtualization.techtarget.com/tip/0,289483,sid94_gci1231666,00.html
VMware ESX Server guest performance tips Pt. 2 - http://searchservervirtualization.techtarget.com/tip/0,289483,sid94_gci1231917,00.html
VMware ESX Server guest performance tips Pt. 3 - http://searchservervirtualization.techtarget.com/tip/0,289483,sid94_gci1235138,00.html
Top 12 ways to Improve Guest Server Performance under VMware ESX Server - http://download3.vmware.com/vmworld/2006/mdc9700.pdf
Vmware ESX Server 2 Performance Tips and Tricks - http://www.vmware.com/pdf/esx_performance_tips_tricks.pdf
Performance Tuning for VI3 - http://download3.vmware.com/vmworld/2006/tac9872.pdf
Performance Troubleshooting - http://download3.vmware.com/vmworld/2006/labs2006/vmworld.06.lab04-PERFORMANCE-MANUAL.pdf
Performance Tuning Best Practices for ESX Server 3 - http://www.vmware.com/pdf/vi_performance_tuning.pdf
ESX Server 3.0 Tips and Tricks - http://download3.vmware.com/vmworld/2006/tac9567.pdf
Performance Monitoring and Capacity Planning - http://download3.vmware.com/vmworld/2006/adc0199.pdf
A Performance Comparisopn of Hypervisors - http://www.vmware.com/pdf/hypervisor_performance.pdf
Using esxtop to troubleshoot performance problems - http://www.vmware.com/pdf/esx2_using_esxtop.pdf
ESX Workload Analysis: Lessons Learned - http://download3.vmware.com/vmworld/2006/adc9398.pdf

RTFM Guides:
Upgrade Guide to ESX 3 and VirtualCenter 2 - http://www.rtfm-ed.eu/docs/vmwdocs/esx3.x-vc2-upgradeguide.pdf
Guide to ESX 3 Service Console - http://www.rtfm-ed.eu/docs/vmwdocs/esx3.x-vc2.x-serviceconsole-guide.pdf
Guide to ESX 2.x Administration I - http://www.rtfm-ed.eu/docs/vmwdocs/admin-01-esx2.x.pdf
Guide to ESX 2.x Administration II - http://www.rtfm-ed.eu/docs/vmwdocs/admin-02-esx2.x.pdf
Beyond the Manual - VMware ESX 2.x - http://www.rtfm-ed.eu/docs/vmwdocs/esx2.x-beyondthemanual.pdf
ESX 2.x Service Console Quick Command-Line Guide - http://www.rtfm-ed.eu/docs/vmwdocs/esx2.x-serviceconsolecommands.pdf
Guide to vCenter 1.x Administration - http://www.rtfm-ed.eu/docs/vmwdocs/admin-vcenter1.2.pdf

Scripting:
Simplifying Administration with Scripting APIs - http://download3.vmware.com/vmworld/2006/labs2006/vmworld.06.lab12-Scripting.VI3-MANUAL.pdf

Security:
Vmware as a secure and leak resistant sandbox environment - http://www.vmware.com/community/thread.jspa?threadID=66085&tstart=0
Security Design of the Vmware Infrastructure 3 Architecture - http://www.vmware.com/pdf/vi3_security_architecture_wp.pdf
Vmware Infrastructure 3 Security Hardening - http://www.vmware.com/pdf/vi3_security_hardening_wp.pdf
VI3 Securing and Monitoring - http://download3.vmware.com/vmworld/2006/labs2006/vmworld.06.lab05-SECURITY-MANUAL-APPENDIX.pdf
Vmware ESX Server – Providing LUN Security - http://www.vmware.com/pdf/esx_lun_security.pdf
Vmware and NSA - http://www.vmware.com/company/news/releases/nsa_pr.html

Service Console:
Common Linux commands on the service console - http://www.vmts.net/article/linuxcommand.htm
Command Line Interface Tips and Tricks for Vmware ESX Server 2 and 3 - http://download3.vmware.com/vmworld/2006/tac9685.pdf

Snapshots:
Snapshots take long time to commit - http://www.vmware.com/community/thread.jspa?threadID=74669
Snapshots take long time to commit - http://www.vmware.com/community/thread.jspa?messageID=584324&#584324
Snapshots take long time to commit - http://www.vmware.com/community/thread.jspa?threadID=73553
Beware the long snapshot - http://www.vmwarez.com/2006/11/beware-long-snapshot.html

Storage:
SAN Configuration Guide - http://www.vmware.com/pdf/vi3_esx_san_cfg.pdf
SAN System Design and Deployment Guide - http://www.vmware.com/pdf/vi3_san_design_deploy.pdf
Extending a VMFS3 data store - http://www.vmware.com/community/thread.jspa?threadID=65156&tstart=0
LUNS - http://www.vmware.com/community/thread.jspa?messageID=333672&#333672
HBA load balancing - http://www.vmware.com/community/thread.jspa?messageID=342918&#342918
HBA Redundancy - http://www.vmware.com/community/thread.jspa?messageID=428932&#428932
Configuring iSCSI in a Vmware 3 environment - http://www.vmware.com/pdf/vi3_iscsi_cfg.pdf
iSCSI , NAS and IP Storage Configuration for Vmware ESX Server - http://download3.vmware.com/vmworld/2006/tac9722.pdf
ESX Server Raw Device Mapping - http://www.vmware.com/pdf/esx25_rawdevicemapping.pdf
Unofficial list of SATA controllers that will work with ESX - http://vmprofessional.com/index.php?content=sata_faq
Running Vmware ESX on SATA disks - http://www.virtualization.info/2006/02/tech-running-vmware-esx-server-on-sata.html
Install ESX on SATA - http://www.vmware.com/community/thread.jspa?messageID=554936&#554936
Fibre channel paths - http://www.vmware.com/community/thread.jspa?threadID=76763&messageID=601390#601390
http://www.vmware.com/support/esx2/doc/esx20admin_multipath_disks.html
http://www.vmware.com/support/esx21/doc/esx21admin_multipath_disks.html
VMFS volume symblic links/uuid - http://www.redhat.com/docs/manuals/enterprise/RHEL-3-Manual/sysadmin-guide/ch-devlabel.html
VMFS volume symblic links/uuid - http://www.vmware.com/community/thread.jspa?messageID=606588&#606588
Choosing and Architecting Storage for your Environment - http://download3.vmware.com/vmworld/2006/adc0135.pdf
Using multi-pathing in ESX Server - http://www.vmware.com/support/esx21/doc/esx21admin_multipath_disks.html
Vmware Infrastructure 3, HP StorageWorks best practices - http://h71019.www7.hp.com/ActiveAnswers/downloads/VMware3_StorageWorks_BestPractice.pdf

Time sync:
Configuring windows time service (not in ESX) - http://www.windowsnetworking.com/articles_tutorials/Configuring-Windows-Time-Service.html
Vmware time sync and windows time service (understand windows time first) - http://kb.vmware.com/kb/1318
Time sync - http://www.vmware.com/community/thread.jspa?forumID=21&threadID=16115&messageID=186017
Timekeeping in VMware virtual machines - http://www.vmware.com/pdf/vmware_timekeeping.pdf
Clock in a Linux guest runs more slowly or quickly than real time - http://kb.vmware.com/kb/1420

Troubleshooting:
Troubleshooting Vmware ESX Server 3 and Vmware VirtualCenter 2 - http://download3.vmware.com/vmworld/2006/mdc9694.pdf
Kernrate viewer - http://www.microsoft.com/downloads/details.aspx?familyid=d6e95259-8d9d-4c22-89c4-fad382eddcd1&displaylang=en
VI3 Network Scenarios and Troubleshooting - http://download3.vmware.com/vmworld/2006/tac9689-b.pdf
VirtualCenter 2 Diagnostics - http://download3.vmware.com/vmworld/2006/tac4096.pdf
Tips for Troubleshooting Vmware ESX Server Faults - http://download3.vmware.com/vmworld/2006/tac0028.pdf
Vm-support options - http://www.vmug.nl/modules.php?name=Content&pa=showpage&pid=2&page=15
When disaster strikes Vmware - http://www-128.ibm.com/developerworks/linux/library/l-vmware/
Troubleshoot high CPU on ESX with top command - http://www-1.ibm.com/support/docview.wss?rs=180&context=SSEQTP&q1=mustgather+cpu&uid=swg21132699&loc=en_US&cs=utf-8&lang=en

Upgrade from ESX 2.x to ESX 3.0:
Virtual Infrastructure 3: Beta to Production - http://download3.vmware.com/vmworld/2006/mdc5173.pdf
Understanding Virtual Infrastructure Upgrade Moving to the new ESX 3.0/VC2.0 Release - http://download3.vmware.com/vmworld/2006/tac9809.pdf
Details of What's New and Improved in VMware Infrastructure 3 - http://www.vmware.com/support/vi3/doc/whatsnew_esx301_vc201.html
Vmware Infrastructure 3 Release Notes - http://www.vmware.com/support/vi3/doc/releasenotes_esx301_vc201.html
Planning a Upgrade to Vmware Infrastructure 3 - http://www.vmware.com/pdf/vi3_upgrade_plan.pdf
http://www.rtfm-ed.co.uk/docs/vmwdocs/ESX3.x-VC2-upgradeguide.pdf

Utilities:
Vmware utilities - http://petruska.stardock.net/Software/VMware.html
WinScp - http://winscp.net/eng/index.php
Vmount 1.1 for Vmware - http://www.abinsight.com/vm/
FastSCP - http://www.veeam.com/veeam_fast_scp.asp

Virtual disk (VMDK):
Repair VMDK - http://www.vmware.com/community/thread.jspa?threadID=77535&messageID=606523#606523
Extend boot volume of Windows 2003 VM - http://vmprofessional.com/index.php?content=2k3resize
Resizing Windows VM disks - http://djberen.googlepages.com/resizingvmwarepartitions
Defragging virtual disks - http://www.vmware.com/community/thread.jspa?threadID=77661&tstart=0
Resizing Windows VM disks - http://www.vmprofessional.com/index.php?content=2k3resize
Resizing Windows VM disks - http://h0bbel.p0ggel.org/2007/04/10/howto-expand-vm-boot-partition/
Resizing Windows VM disks - http://linux.softpedia.com/get/System/Recovery/System-Rescue-CD-188.shtml
Unable to log on if the boot partition drive letter has changed - http://support.microsoft.com/kb/249321/en-us
How to restore the system/boot drive letter in Windows - http://support.microsoft.com/kb/223188/en-us

Virtual Center:
VIrtualCenter Technical Best practices - http://www.vmware.com/pdf/vc_technical_best.pdf
VirtualCenter Monitoring and Performance Statistics - http://www.vmware.com/pdf/vi3_monitoring_statistics_note.pdf
VirtualCenter 2.X Using Database Views - http://www.vmware.com/pdf/vc_dbviews_2x.pdf
SQL Server database as a VM Guest - http://www.vmware.com/community/thread.jspa?messageID=577459&#577459
SQL 2005 support - http://kb.vmware.com/kb/6565318
SQL 2005 Express edition support - http://www.vmware.com/community/thread.jspa?threadID=67175
SQL 2005 support - http://www.vmware.com/community/thread.jspa?threadID=75222
Operation timeout - http://www.vmware.com/community/thread.jspa?threadID=75010
Managing remote servers - http://www.vmware.com/community/thread.jspa?messageID=593730&#593730
Running VirtualCenter in a Virtual Machine - http://www.vmware.com/pdf/vi3_vc_in_vm.pdf
Template Usage and Best Practices - http://www.vmware.com/pdf/vc_2_templates_usage_best_practices_wp.pdf
Virtual Center and remote ESX servers - http://www.vmware.com/community/thread.jspa?messageID=593730&#593730
Managing Vmware VirtualCenter Roles & Permissions - http://www.vmware.com/pdf/vi3_vc_roles.pdf

Virtual Machine:
VMware disk files explained - http://www.petri.co.il/virtual_vmware_files_explained.htm
What Files Make Up a Virtual Machine? - http://www.vmware.com/support/ws5/doc/ws_learning_files_in_a_vm.html
Installing Windows XP on ESX - http://www.vmware.com/community/thread.jspa?threadID=61099&tstart=100
SQL Server virtualization and multi-instancing - http://www.microsoft.com/sql/howtobuy/virtualization.mspx
How to virtualize SQL Server on Virtual server - http://www.microsoft.com/technet/community/events/vs/add-62.mspx
Configuring swap files on Windows 2003 VM - http://www.vmware.com/community/thread.jspa?messageID=326236
Deploying Microsoft Exchange in Vmware Infrastructure - http://www.vmware.com/pdf/exchange_best_practices.pdf
Change vswp file location - http://www.vmware.com/community/thread.jspa?messageID=530426

Vmware Server:
10 ways to increase performance on a Vmware system - http://www.petri.co.il/virtual_increase_vmware_performance.htm
Vmware Server Tips and Tricks - http://download3.vmware.com/vmworld/2006/dvt4696.pdf

Websites:
Mike Laverick's RTMF Education - http://www.rtfm-ed.co.uk
Vmware Technology Center - http://www.vmware.com/vmtn/technology/
Australia and New Zealand's Premier Virtualisation Community - http://www.ozvms.com/
VM Professional - http://vmprofessional.com/
Virtual Tricks - http://virtrix.blogspot.com/
http://www.vmweekly.com/
http://x86virtualization.com/
http://sanbarrow.com/
http://www.virtualization.info/
http://www.run-virtual.com/
http://www.vmwareprofessional.com/
Vmwarez - http://www.vmwarez.com/
Virtual Strategy Magazine - http://www.virtual-strategy.com/en/home
http://blog.scottlowe.org/
http://trivore.com/vmware/esx25.html
Virtual Infrastructure 411 - http://www.vi411.org/