At this year’s VMworld 2012, held in San Francisco, the “software-defined data center” was a major topic. The idea is appealing: make the entire IT infrastructure completely fluid so that all resources–compute, network, and storage–can be quickly and easily allocated or reclaimed to meet dynamic business requirements, thereby extending the flexibility and cost savings benefits virtualization provides across the entire IT infrastructure.
If you take what the server hypervisor did for compute resources as the analogy –allowing a single control point to manage the dynamic allocation of CPU and memory resources that are consistently used very efficiently – this part of the puzzle has been “software-defined” and solved. A solution to this problem for the network side is well on its way to being solved. VMware’s recent acquisition of Nicira and Brocade’s purchase of Vyatta, are steps towards allowing the networking infrastructure to be managed as purely virtual resources directly from the server hypervisor.
It’s clear that this same transformation needs to happen with storage. In essence, software-defined storage is the missing link, the last major hardware bridge to cross on the path to the software-defined data center.
What is software-defined storage?
What is “software-defined storage”? Drawing on the analogy with the server hypervisor and what it did for compute resources, storage virtualization is clearly part of it but is not sufficient by itself. Server hypervisor technology not only made compute resources fluid and much easier to manage, it also significantly increased the utilization of those resources to cut the costs of the compute hardware infrastructure. For servers, it was the server consolidation that virtualization enabled that provided this huge boost in utilization, effectively allowing customers to support the same application workloads with much smaller and less costly compute infrastructure.
The VM I/O blender issue…
Storage resources clearly do have to be virtualized to solve this problem, but the “improved utilization of existing resources” question manifests itself a little differently. Those familiar with virtual environments already know that storage performance suffers in most virtual deployments relative to expectations based on experiences with storage on physical servers. This “VM I/O blender” issue has been widely discussed in the industry so I won’t go into it here, but the 50 percent or more storage performance slowdown that virtual administrators experience in these environments touches not only runtime performance, but also the ability to use storage capacity optimization technologies like thin provisioning, valuable operational features like snapshots and clones, and instant provisioning of high performance storage on demand.
Case in point: in physical computing environments, 15K RPM disks generally handle around 180 I/Os per second (IOPS), assuming some RAID overhead and a random workload that includes 15-20 percent writes. The more random and the more write-intensive an I/O workload is, the poorer spinning disks perform. Analysis of these disks in use in virtual environments often indicates that, from a guest VM’s point of view, they are only delivering somewhere between 30-45 IOPS. Virtual workloads are much more random and much more write-intensive–often as much as 80 percent or more in certain use cases like virtual desktop infrastructure (VDI)–than most physical workloads, which accounts for part of the slowdown. But if other potentially interesting technologies like thin provisioning (to make more efficient use of storage) and snapshot/clone technology (to feed a variety of supplemental but required administrative operations like backup, test/dev, maintenance, and versioning) are in use, they will often drop the IOPS per disk spindle to well below 30.
There is a pure software response to improving the performance of existing disk by as much as 10x, and it is the log architecture that has been shipping for decades in enterprise-class database products. A log effectively removes all the randomness from writes, effectively enabling the log device to operate in sequential mode for a large percentage of the time. What’s most interesting about this is that the storage system behind that log appears to operate at the speed of the log from the point of view of guest VMs submitting those writes. If a log architecture could be built into the storage layer, then existing storage in virtual environments could support lower write latencies and up to 10x the throughput without requiring any additional hardware purchases.
Yet that same disk, if handling close to 100 percent sequential writes, can often deliver 2000 or more IOPS. Given this order of magnitude greater potential performance potential, how can the innate power of storage hardware be unlocked and harnessed to the benefit of virtual environments? And it’s not just a pure performance issue. To fully deliver on the promise of the software-defined data center, we need to be able to provision high performance storage as fast as we can create a new VM (in a couple of seconds), we need that storage to exhibit the same type of space-savings efficiency that compute resources do when managed by a server hypervisor, and we need to manage that storage in a manner that is intuitive to virtual administrators who think in terms of VMs, not storage LUNs.
Can software improve performance?
That is the other challenge that software-defined storage must address. It has to not only virtualize heterogeneous storage resources, but it also has to unlock the potential these devices have to deliver high performance, space-efficiency, rapid provisioning, and ease of management. And it should do this with a software layer (we call it software-defined storage for a reason) that does not require–but can accommodate and improve–higher performance storage devices incorporating flash memory technology.
The crucial impact of software & data services in SDN
The word “software” is indeed critical in this definition. Central management consoles like VMware vCenter, Microsoft Systems Center, and Citrix XenCenter are designed to comprehensively manage virtual environments. The software-defined storage capabilities should integrate seamlessly into the hypervisors and management products around which each of these environments are based and look like native storage objects (VMDKs for vSphere, VHDs for Hyper-V, etc.) to take maximum advantage of the wealth of existing tools and utilities these environments have to offer for live migration, failover, monitoring, quality of service, workload balancing, and other services.
One parting comment: data services must be a critical part of the software-defined storage offering. If data services like thin provisioning, de-duplication, snapshots, clones, encryption, auto-recovery, replication, tiering, and others can be applied as needed to reliable, heterogeneous storage, then storage pools can be defined to meet certain production requirements and VM classes can self-identify the storage they need as they are created. Automation and orchestration is a critical part of the data center of the future if we are indeed to believe that cloud-scale computing will be mainstream. This is where virtual computing is headed to deliver that reality.
[...] most most likely, fail. Even with a superb architecture, if that architecture is not nicely underst “This new edition is brighter, shinier, more complete, more pragmatic, more focused than the prev…title="Documenting Software Architectures: Views and Beyond (2nd Edition)" [...]
[...] Software-Defined Storage is the Missing Link in the Software-Defined Data Center [...]
is enough to garner sufficient attention.all said…
and done, article writing is something, which must come from within. our articles must be so powerful that they must actually transport the readers to the imaginary world that we wish to create. if you want to be a good writer,…
footwear…
Very good article. I will be experiencing many of these issues as well…..
their staffs pay attention to minute details….
planning for the boss’s trip to houston, a limousine blog will teach the skilled assistant how to assure that the boss’s wall street journal and morning starbuck’s are in the back seat waiting for him as the comfortable lincoln town car…
the blog isn’t a priority.your blog may…
only be an add onto your main site, something else to help boost the visits to your site.again, your priorities may be to other parts of your site or business, and having a blogger write for you means you site’s blog…
guidelines, mostly. after accepting their bid and…
tasks, you quickly realize it knew nothing. â· if you would be so unlucky to hire a bunch of writers who are naturally not creative, they will produce low quality, boring, rewritten content. â· if you get a bunch of losers…
guidelines, mostly. after accepting their bid and…
tasks, you quickly realize it knew nothing. â· if you would be so unlucky to hire a bunch of writers who are naturally not creative, they will produce low quality, boring, rewritten content. â· if you get a bunch of losers…
advertising, you should find out a particular…
niche. you should then create a website around that niche. in this form of advertising, the products’ images and prices are also shown along with the description of products. this type of advertising can prove to be very lucrative.4. blog sponsorsanot…
the same time. this way you’ll be…
able to focus on both of them rather than working in a stop start fashion, switching from one to the other; which will cause you to waste time, remembering where you’d reached and what needed doing next when you stopped.conclusionif you’re…
you continue to focus on higher priority…
aspects of your business. running a business can be a very time consuming occupation. because of the way you need to market your site, you often spend far more time doing this, than actually creating the content for your site.time becomes…
a website writer you might be making…
a mistake. unless your web designer is a skilled writer you could end up with content that doesn’t make much sense to readers of search engines. it is quite usual that professional webmasters work together with website writers to get the…
them.4. use an exclamation point or question…
mark in your headline. it stresses emphasis. it’s important to stress excitement if you want to write a good headline.5. be very clear – no guesswork. tell the reader exactly how your product will help them. important: you are writing to…
post.another thing you could do is read…
a chapter of a related book, and jot down the top 10 points that you read about. then simply rewrite what you just read in your own words and turn it into a blog post. coming up with new blog ideas…
you don’t have to sell anything; you…
will just help people or companies to promote their products, business, services or site. there are a lot of affiliate marketing programs online. study them and select which earning plan is favorable to you.dany cooper an online presence is important t…
method of finding out if the topic…
of your expertise is profitable or not. because if the niche is not profitable why are you wasting your time, money and effort. but niche research often throws up additional benefits that are not always apparent on the first review.during my…
a “share” module to your articles, you…
make it easy for visitors to forward your articles to others. they can “like” your articles and then, their second and third tiered contacts can also view your content in order to further grow your internet traffic following. as your blog…
become a blogger and make money with…
ads.however, if you want to make good money with blogging, you need a lot of visitors to you blog. that means you should know how to market your blog (or website) online.now that you know your options, find out more about…
van zandt songs are found here, with…
highlights being “poncho and lefty,” “loretta,” and “mr. mudd and mr. gold.” for those who (like me) purchased the deluxe edition, there is a companion album called “townes basic” which, for me, is the reason this album makes the top 5….
you run out of topics to post,…
days go by without anything new. then days turn into weeks.better that you space out your posts (once you have a core of at least 10-20 published) to just one or two a week but to sustain that pace over the…
pdf format for your readers. alternately, if…
you’ve integrated social media buttons (a facebook ‘like’ or google +1 feature) on your site, you can allow visitors to share your best articles or blog posts with others and generate more web visibility for your site for earning lots more…
them to gain more information and to…
want more information regarding what you are blogging about. this will then allow you to write a series of blogs that people would love to read and will eventually benefit you and your business in the end.if you feel that you…
and compelling contentin too many cases, blog…
posts fall flat on the faces because they don’t provide anything new to think about or discuss. a great way to drag in audience is to write on topics that are relevant, timely, fresh, exciting and engaging at the same time.a…
can also be intimidating and overwhelming. you’ve…
got to figure out how and where to start. the 5 beginner blogging tips below are enough to help you get up and running.get your own domain namethis is essential, and it’s not really an option these days if you want…
you can just bold the sentences or…
phrases in the same font, or else italicize the words or just show them in a different font type so that they will catch the reader’s eyes. highlighting the words or sentences in the web content will provide an idea about…
one wants to read a badly designed…
blog, on blogger and wordpress you can customize your blog and change the colors background picture and fonts and sizes as you please putting thought,time,and effort into making a suitable design will make your site look more professional and people wi…
specific articles or reports, there are services…
that are available to all those who would like to utilize them. one of the biggest aspects of writing that can set up, effectively advertise, or inform about a business or service is getting the right amount of details in the…
online business. words can make and can…
demolish the reputation of a company. good content will always compel the search engine to rank it in the top ranking. seo content writer should be well aware about how the search engine works? search engine crawls the pages of website…
will advertise for you. if you ask…
them to, they will leave a comment on your blog telling you what they think about your blogs. you should have them tell their friends about it as well.the ultimate secret to becoming successful and famous in the blogs is the…