Drive Even More Value from Virtualization: Write VMware Applications that Automate Virtual Infrastructure Management Companies running VMware have already achieved enormous gains through virtualization. The next wave of benefits will come when they reduce the time and effort required to run and manage VMware platforms. The VMware Infrastructure Software Development Kit (VI SDK) includes application programming interfaces (APIs) that allow developers and administrators to do just that. Until now, there has been little documentation for the APIs. In VMware VI and vSphere SDK, software architect Steve Jin demystifies the entire VMware VI and new vSphere SDK and offers detailed, task-based coverage of using the APIs to manage VMware more efficiently and cost-effectively. Jin walks you through using the VI SDK and cloud-computing vSphere SDK to manage ESX servers, ESX clusters, and VirtualCenter servers in any environmentno matter how complex. Drawing on his extensive expertise working with VMware strategic partners and enterprise customers, he places the VI SDK in practical context, presenting realistic samples and proven best practices for building robust, effective solutions. Jin demonstrates how to manage every facet of a VMware environment, including inventory, host systems, virtual machines (VMs), snapshots, VMotion, clusters, resource pools, networking, storage, data stores, events, alarms, users, security, licenses, and scheduled tasks. Coverage includes Understanding how the VI SDK fits into your VMware VI and Cloud Ready vSphere Environment Discovering the VI and vSphere SDK from the bottom up Using the authors new VI Java API to write shorter, faster, and more maintainable code Managing VI and vSphere inventory and configurations Moving running VMs and storages across different physical platforms without disruption Optimizing system resources, hardening system securities, backing up VMs and other resources Leveraging events, alarms, and scheduled tasks to automate the system management Developing powerful applications that integrate multiple API features and run on top of or alongside VMware platforms Using the VI SDK to monitor performance Scripting with the VI SDK: building solutions with VI Perl, PowerShell, and Jython Avoiding the pitfalls that trip up VMware VI developers Integrating with and extending VMware platforms using VI SDK This book is an indispensable resource for all VMware developers and administrators who want to get more done in less time; for hardware vendors who want to integrate their products with VMware; for ISV developers building new VMware applications; and for every professional and student seeking a deeper mastery of virtualization.
Complete Hands-On Help for Securing VMware vSphere and Virtual Infrastructure by Edward Haletky, Author of the Best Selling Book on VMware, VMware ESX Server in the Enterprise As VMware has become increasingly ubiquitous in the enterprise, IT professionals have become increasingly concerned about securing it. Now, for the first time, leading VMware expert Edward Haletky brings together comprehensive guidance for identifying and mitigating virtualization-related security threats on all VMware platforms, including the new cloud computing platform, vSphere. This book reflects the same hands-on approach that made Haletkys VMware ESX Server in the Enterprise so popular with working professionals. Haletky doesnt just reveal where you might be vulnerable; he tells you exactly what to do and how to reconfigure your infrastructure to address the problem. VMware vSphere and Virtual Infrastructure Security begins by reviewing basic server vulnerabilities and explaining how security differs on VMware virtual servers and related products. Next, Haletky drills deep into the key components of a VMware installation, identifying both real and theoretical exploits, and introducing effective countermeasures. Coverage includes Viewing virtualization from the attackers perspective, and understanding the new security problems it can introduce Discovering which security threats the vmkernel does (and doesnt) address Learning how VMsafe enables third-party security tools to access the vmkernel API Understanding the security implications of VMI, paravirtualization, and VMware Tools Securing virtualized storage: authentication, disk encryption, virtual storage networks, isolation, and more Protecting clustered virtual environments that use VMware High Availability, Dynamic Resource Scheduling, Fault Tolerance, vMotion, and Storage vMotion Securing the deployment and management of virtual machines across the network Mitigating risks associated with backup, performance management, and other day-to-day operations Using multiple security zones and other advanced virtual network techniques Securing Virtual Desktop Infrastructure (VDI) Auditing virtual infrastructure, and conducting forensic investigations after a possible breach informit.com/ph www.Astroarch.com
Edward L. Haletkys Complete, Solutions-Focused Guide to Running ESX Server 3.5, vSphere, and VMware 4.x Extensively updated and revised, this is the definitive real-world guide to planning, deploying, and managing VMware ESX Server 3.5, VMware vSphere Hypervisor (ESXi), or VMware vSphere 4.x cloud computing in mission-critical environments. Drawing on his extensive experience consulting on enterprise VMware implementations, renowned expert Edward L.Haletky offers a soup-to-nuts collection of field-tested best practices and solutions. He illuminates the real benefits, issues, tradeoffs, and pitfalls associated with VMwares newest platforms, using real-world examples that draw upon both VMware and third-party products. This edition features detailed coverage of new vSphere features such as Storage IO Control, Network IO Control, Load-Based Teaming, Distributed Virtual Switches, ESXi, hardware and processors, and a significantly expanded discussion of auditing and monitoring. Haletky offers new or enhanced coverage of VM Hardware, virtual networking, VMsafe, and more. All new coverage is thoroughly integrated into Haletkys insightful discussion of the entire lifecycle: planning, installation, templates, monitoring, tuning, clustering, security, disaster recovery, and more. Haletky consistently presents the most efficient procedures, whether they use graphical tools or the command line. Youll learn how to: Assess VMware datacenter and infrastructure hardware requirements Understand technical, licensing, and management differences between ESX/ESXi 3.5 and 4.x Plan installation for your environment and identify potential gotchas Select, configure, utilize, and support storage cost-effectively Manage key operational issues associated with virtual infrastructure Adapt existing network and security infrastructure to virtualization Configure ESX from host connections Configure ESX Server from Virtual Centers or hosts Create, modify, and manage VMs (with detailed Windows, Linux, and NetWare examples) Troubleshoot VM issues with eDirectory, private labs, firewalls, and clusters Utilize vSphere 4.1s improved Dynamic Resource Load Balancing (DRLB) Implement disaster recovery, business continuity, and backup Plan for vApps and the future of virtualization VMware ESX and ESXi in the Enterprise has long been the definitive single-source guide to VMware planning, deployment, and management. For todays VMware architects, administrators, and managers, this edition will be even more valuable.
The main purpose of this thesis is to compare the performance overhead of the virtualization infrastructures KVM and VMWare. All the experiments are carried out by using the Red Hat Enterprise Linux(RHEL) Operating System version 6.1. The study focuses on the performance of disk I/O operations, memory operations and CPU operations. The benchmarking tools used are Iozone for disk I/O, Ram Speed for memory and UnixBench for CPU. \n\nFirst a set of benchmarking tests are carried out by using a Bare Metal installation of RHEL 6.1 on a Dell Poweredge R710 server. Next the exact same set of benchmark tests are run after installing RHEL 6.1 on a single virtual machine running on KVM on the same server. Finally VMWare ESXi 5.0 is installed on the server and RHEL 6.1 is installed on a single virtual VMWare machine. In this way the performance overhead of the two virtualization infrastructures KVM and VMWare is measured and compared. Each benchmarking test is run in each of the three cases sufficiently many times to produce statistically significant results. \n\nThe VMWare I/O disk performance is mostly from 20 to 30% better than KVM, with a few exceptions. And generally the VMWare I/O performance is 10-15% less than the Bare Metal performance. The memory performance overhead is relatively smaller. KVM performs better than VMWare for block sizes of 4MB and less, while the results show the opposite for block sizes larger than 4MB. When testing pure ALU usage, there is almost no virtualization overhead. There was some overhead for the other UnixBench CPU tests and in all these cases VMWare was performing better than KVM. Our general conclusion is that the virtualization overhead is less for VMWare than for KVM.
Virtual machines were developed by IBM in the 1960’s to provide concurrent, interactive access to a mainframe computer. Each virtual machine is a replica of the underlying physical machine and users are given the illusion of running directly on the physical machine. Virtual machines also provide benefits like isolation and resource sharing, and the ability to run multiple flavors and configurations of operating systems. VMwareWorkstation brings such mainframe-class virtual machine technology to PC-based desktop and workstation computers. This paper focuses on VMware Workstation’s approach to virtualizing I/O devices. PCs have a staggering variety of hardware, and are usually pre-installed with an operating system. Instead of replacing the pre-installed OS, VMware Workstation uses it to host a user-level application (VMApp) component, as well as to schedule a privileged virtual machine monitor (VMM) component. The VMM directly provides high-performance CPU virtualization while the VMApp uses the host OS to virtualize I/O devices and shield the VMM from the variety of devices. A crucial question is whether virtualizing devices via such a hosted architecture can meet the performance required of high throughput, low latency devices. To this end, this paper studies the virtualization and performance of an Ethernet adapter on VMware Workstation. Results indicate that with optimizations, VMware Workstation’s hosted virtualization architecture can match native I/O throughput on standard PCs. Although a straightforward hosted implementation is CPU-limited due to virtualization overhead on a 733 MHz Pentium R III system on a 100 Mb/s Ethernet, a series of optimizations targeted at reducing CPU utilization allows the system to match native network throughput. Further optimizations are discussed both within and outside a hosted architecture.
The VMware Workstation virtualisation software is widely used by antivirus researchers for malware analysis. However, a large amount of current generation malware employs various anti-VMware techniques in order to resist analysis. To make things worse, these anti-VMware techniques are applied not only in the payload itself, but also in the runtime packer that is used to disguise the malicious code. Fortunately, at the present time, there is not a wide variety of anti-VMware methods in use, so the assembly code which describes the operation is quite characteristic. The issue therefore becomes exactly at what stage of the execution should one look for such code, since the actual anti-VMware code is normally heavily obfuscated. Sometimes it may only be decrypted shortly before it is executed. This paper shows that judicious automated control of a debugger can successfully be used to slither around anti-VMware detections even in sophisticated packers, such as Themida.
A new and updated edition of bestselling Mastering VMware vSphere 4 Written by leading VMware expert, this book covers all the features and capabilities of VMware vSphere. You'll learn how to install, configure, operate, manage, and secure the latest release.Covers all the new features and capabilities of the much-anticipated new release of VMware vSphereDiscusses the planning, installation, operation, and management for the latest releaseReviews migration to the latest vSphere softwareOffers hands-on instruction and clear explanations with real-world examples Mastering VMware vSphere is the
VMware Workstation Pro is one of the most popular end-user desktop virtualization solutions used by enterprise IT personnel. It allows IT engineers to build and test real-world-like virtual machines and network devices from their own PC/laptop. Learning to build a fully functioning and integrated virtual lab on a single computer and master Python network automation basics on a single PC is this book’s underlying goal. This chapter is designed to teach you the basics of the most popular and versatile VMware product, VMware Workstation 15 Pro, and basic virtualization concepts. After reading this chapter, you will gain the following knowledge: you’ll understand the difference between Type-1 and Type-2 hypervisors, understand various IT vendors offering different desktop virtualization solutions, learn how to install VMware Workstation, learn how to perform general administration on VMware Workstation, and understand how VMware Workstation’s network adapters operate.
This article describes the historical context, technical challenges, and main implementation techniques used by VMware Workstation to bring virtualization to the x86 architecture in 1999. Although virtual machine monitors (VMMs) had been around for decades, they were traditionally designed as part of monolithic, single-vendor architectures with explicit support for virtualization. In contrast, the x86 architecture lacked virtualization support, and the industry around it had disaggregated into an ecosystem, with different vendors controlling the computers, CPUs, peripherals, operating systems, and applications, none of them asking for virtualization. We chose to build our solution independently of these vendors. As a result, VMware Workstation had to deal with new challenges associated with (i) the lack of virtualization support in the x86 architecture, (ii) the daunting complexity of the architecture itself, (iii) the need to support a broad combination of peripherals, and (iv) the need to offer a simple user experience within existing environments. These new challenges led us to a novel combination of well-known virtualization techniques, techniques from other domains, and new techniques. VMware Workstation combined a hosted architecture with a VMM. The hosted architecture enabled a simple user experience and offered broad hardware compatibility. Rather than exposing I/O diversity to the virtual machines, VMware Workstation also relied on software emulation of I/O devices. The VMM combined a trap-and-emulate direct execution engine with a system-level dynamic binary translator to efficiently virtualize the x86 architecture and support most commodity operating systems. By relying on x86 hardware segmentation as a protection mechanism, the binary translator could execute translated code at near hardware speeds. The binary translator also relied on partial evaluation and adaptive retranslation to reduce the overall overheads of virtualization. Written with the benefit of hindsight, this article shares the key lessons we learned from building the original system and from its later evolution.
One of the most important technologies in cloud computing is virtualization. This paper presents the results from a performance comparison of three well-known virtualization hypervisors: KVM, VMware and XenServer. In this study, we measure performance in terms of CPU utilization, disk utilization and response time of a large industrial real-time application. The application is running inside a virtual machine (VM) controlled by the KVM, VMware and XenServer hypervisors, respectively. Furthermore, we compare the three hypervisors based on downtime and total migration time during live migration. The results show that the Xen hypervisor results in higher CPU utilization and thus also lower maximum performance compared to VMware and KVM. However, VMware causes more write operations to disk than KVM and Xen, and Xen causes less downtime than KVM and VMware during live migration. This means that no single hypervisor has the best performance for all aspects considered here.
This paper analyzes the part of VMWare in the multi-vector attack on SolarWinds. After infecting hundreds of companies’ networks through the supply-chain attack on SolarWinds, hackers were able to use a VMware exploit on a number of the infected networks to propagate their attack further. The adversary specifically targeted command injection, used after free and privilege escalation to access VMWare platforms. Although the hackers were not able to gain control of the machines, they were able to steal sensitive information. Without the VMware exploit, attackers may not have gotten access to the VMs and thus could not easily pivot to other servers. This paper provides details on the specific zero-day vulnerabilities used in this attack and outlines the possible defense against this attack.
VMware ESX Server in the Enterprise Planning and Securing Virtualization Servers The Most Complete, Practical, Solutions-Focused Guide to Running ESX Server 3 VMware ESX Server in the Enterprise is the definitive, real-world guide to planning, deploying, and managing todays leading virtual infrastructure platform in mission-critical environments. Drawing on his extensive experience consulting on large-scale ESX Server implementations, Edward L. Haletky brings together an unprecedented collection of tips, best practices, and field-tested solutions. More than any other author, he illuminates the real issues, tradeoffs, and pitfalls associated with ESX Serverand shows how to make the most of it in your unique environment. Haletky covers the entire lifecycle: planning, installation, system monitoring, tuning, clustering, security, disaster recovery, and much more. Throughout, he supports his recommendations with examples from real-world deployments. He also provides detailed checklists for handling crucial issues such as caching, networking, storage, and hardware selection. Many of his techniques and practices apply to all current virtualization platforms, not just ESX Server. This book will be an indispensable resource for every network architect, administrator, and IT professional who works with virtual servers. ESX Server newcomers will find the soup-to-nuts introduction they desperately need; experienced users will find an unparalleled source of field-tested answers and solutions. In this book, youll learn how to: Identify key differences between ESX v3.x.y and ESX v2.5.x and their implications Perform a complete installationwith automated scripting techniques and samples Efficiently audit, monitor, and secure ESX Server Discover SAN storage pitfalls and solutionswith detailed guidance for specific SANs, switches, and fibre-channel adapters Understand ESX Server networking: NIC teaming, vSwitches, network lag, and troubleshooting Configure ESX Server via the Management User Interface, Virtual Center client, and command line interface Install Windows, Linux, and NetWare VMs: prepare media images, place configuration files, handle sizing and swap files, and more Use Dynamic Resource Load Balancing to consistently achieve utilization goals Implement effective backup and disaster recovery procedures Edward L. Haletky owns AstroArch Consulting, Inc., a consultancy specializing in virtualization, security, and networking. He has been rated by his peers on the VMware Discussion Forums as a virtuoso for his work in answering VMware security and configuration questions. Prior to establishing AstroArch, Haletky was a member of Hewlett-Packards Virtualization, Linux, and High-Performance Technical Computing teams. He holds a degree in Aeronautical and Astronautical Engineering from Purdue University.
Virtualization became a commonly used technology in datacenters during the last decade. Live migration is an essential feature in most of the clusters hypervisors. Live migration process has a cost that includes the migration time, downtime, IP network overhead, CPU overhead and power consumption. This migration cost cannot be ignored, however datacenter admins do live migration without expectations about the resultant cost. Several research papers have discussed this problem, however they could not provide a practical model that can be easily implemented for cost prediction in VMware environments. In this paper, we propose a machine learning approach for live migration cost prediction in VMware environments. The proposed approach is implemented as a VMware PowerCLI script that can be easily implemented and run in any vCenter Server Cluster to do data collection of previous migrations statistics, train the machine learning models and then predict live migration cost. Testing results show how the proposed framework can predict live migration time, network throughput and power consumption cost with accurate results and for different kinds of workloads. This helps datacenters admins to have better planning for their VMware environments live migrations.
Anomaly detection refers to identifying the patterns in data that deviate from expected behavior. These non-conforming patterns are often termed as outliers, malwares, anomalies or exceptions in different application domains. This paper presents a novel, generic real-time distributed anomaly detection framework for multi-source stream data. As a case study, we have decided to detect anomaly for multi-source VMware-based cloud data center. The framework monitors VMware performance stream data (e.g., CPU load, memory usage, etc.) continuously. It collects these data simultaneously from all the VMwares connected to the network. It notifies the resource manager to reschedule its resources dynamically when it identifies any abnormal behavior of its collected data. We have used Apache Spark, a distributed framework for processing performance stream data and making prediction without any delay. Spark is chosen over a traditional distributed framework (e.g., Hadoop and MapReduce, Mahout, etc.) that is not ideal for stream data processing. We have implemented a flat incremental clustering algorithm to model the benign characteristics in our distributed Spark based framework. We have compared the average processing latency of a tuple during clustering and prediction in Spark with Storm, another distributed framework for stream data processing. We experimentally find that Spark processes a tuple much quicker than Storm on average.
VMware ESX Server is a thin software layer designed to multiplex hardware resources efficiently among virtual machines running unmodified commodity operating systems. This paper introduces several novel ESX Server mechanisms and policies for managing memory. A ballooning technique reclaims the pages considered least valuable by the operating system running in a virtual machine. An idle memory tax achieves efficient memory utilization while maintaining performance isolation guarantees. Content-based page sharing and hot I/O page remapping exploit transparent page remapping to eliminate redundancy and reduce copying overheads. These techniques are combined to efficiently support virtual machine workloads that overcommit memory.
Cloud computing platform relies on principle of sharing of resources. VMware products and OpenStack are the cloud platforms being used extensively in the industry. Of which OpenStack is the new competitor, which provides support for hybrid cloud environment. We compare features of VMware products and OpenStack in this paper. Resources in cloud include computing resources, storage and network. These resources should be allocated and scheduled in a way that user should get the better performance as well as provider should achieve high resource utilizations. In this paper, we describe VMware Distribute Resource Scheduler and OpenStack nova-scheduler.
As more scientific workloads are moved into the cloud, the need for high performance accelerators increases. Accelerators such as GPUs offer improvements in both performance and power efficiency over traditional multi-core processors, however, their use in the cloud has been limited. Today, several common hypervisors support GPU passthrough, but their performance has not been systematically characterized. In this paper we show that low overhead GPU passthrough is achievable across 4 major hypervisors and two processor microarchitectures. We compare the performance of two generations of NVIDIA GPUs within the Xen, VMWare ESXi, and KVM hypervisors, and we also compare the performance to that of Linux Containers (LXC). We show that GPU passthrough to KVM achieves 98 -- 100\% of the base system's performance across two architectures, while Xen and VMWare achieve 96 -- 99\% of the base systems performance, respectively. In addition, we describe several valuable lessons learned through our analysis and share the advantages and disadvantages of each hypervisor/GPU passthrough solution.
This work exposes further vulnerabilities in virtualized cloud servers by mounting Cross-VM cache attacks in Xen and VMware VMs targeting AES running in the victim VM. Even though there exists a rich literature on cache attacks on AES, so far only a single work, demon-strating a working attack on an ARM platform running a L4Re virtualization layer has been published. Here we show that AES in a number popular cryptographic libraries including OpenSSL, PolarSSL and Libgcrypt are vulnerable to Bernstein’s correlation attack when run in Xen and VMware (bare metal version) VMs, the most popular VMs used by cloud service providers (CSP) such as Amazon and Rackspace. We also show that the vul-nerability persists even if the VMs are placed on differ-ent cores in the same machine. The results of this study shows that there is a great security risk to AES and (data encrypted under AES) on popular cloud services. 1
We have developed and managed a virtual laboratory environment by deploying the VMware vCenter Lab Manager and the VMware vSphere vCenter on a load-balanced cluster of eight ESX 3.5 servers and a storage area network of 10.8 Tera bytes. This system has been in use to conduct hands-on laboratory experiments in undergraduate education for computer security and system administration. Lab Manager provides remote access through the Internet using a common Web browser, such as Internet Explorer and Mozilla Firefox. The way in which the Lab Manager manages and controls virtual machines and networking components provides additional convenience for instructors to implement laboratory exercises and for students to finish their experiments. In this article, we present the design of the system, introduce some of the features of the virtual environment, and discuss the experiences we have gained from developing and using this system. Compared with other existing virtualization platforms, Lab Manager provides more useful features and additional flexibility for the use in the education for information technology (IT), although there is still room to improve.
VMware vSphere 6.7 builds on previous generations of VMware's enterprise-grade virtualization products that have been leading the industry since 2001. This chapter helps administrators to identify the role of each product in the vSphere product suite, recognize the interaction and dependencies between the products in the vSphere suite, and understand how vSphere differs from other virtualization products. VMware vSphere is a comprehensive collection of products and features that together provide a full array of enterprise virtualization functionality. vSphere Update Manager is a component of vCenter Server that helps users keep their ESXi hosts and select virtual machines (VMs) patched with the latest updates. With profile-driven storage, vSphere administrators can use storage capabilities and VM storage profiles to ensure VMs reside on storage that provides the necessary levels of capacity, performance, availability, and redundancy.