In today’s technology world everything is getting smaller and smaller. And, with the cloud, some things are simply disappearing! Many data centers struggle to make their capacity work without exceeding it but, as expansion occurs, infrastructure changes and more racks are needed, data centers often find themselves outgrowing their space. This leaves them in the frustrating position that they must then relocate which can be tricky and often leads to downtime. Racks-on-chips have become a hot topic of conversation because it can help slow down overgrowth in a data center. Racks-on-chips are essentially a condensed version of a server rack while maintaining processing power and capacity but packaged in a much smaller package – a chip.
The critical component of racks-on-chips that makes them possible is that the capacity of chips must be increased so that they can store as much as server racks can. Racks-on-chips can be achieved but data centers must be retrofitted to make them possible because racks-on-chips have to be networked together with optical circuit switching and electronic packet switching. New data center builds that are forward thinking will plan ahead and have these system in place so that racks-on-chips will be possible. By switching to racks-on-chips the amount of server racks used in a data center can be dramatically reduced and once of the biggest benefits of this aside from freeing up physical space in a data center is that is also significantly reduces the amount of energy needed for heating and cooling. This means that a data center using racks-on-chips will be far more energy efficient, which is not only more green but will save a significant amount of money. While racks-on-chips are a potential ideal solution for data centers space and energy issues, Motherboard explains that it is still in the early stages and much still needs to happen for the benefits to be truly realized, “But the meat and potatoes of Yeshaiahu Fainman and George Porter’s server-rack-on-a-chip vision is really about taking the existing framework for a server rack and recreating it at the nano-level. They say that miniaturizing all server components so that several servers can fit onto a computer chip would increase processing speed. Making circuit systems to support all these mini-components using advanced lithography is already feasible, but scientists have yet to realize nano-transceivers and circuit-switchers—the key components that transmit data. And while silicon chips are increasing being used to transmit data-carrying light waves in fiber optic networks, efficiently generating light on a silicon chip is still early in its development. The researchers offer some solutions, like including light generating nanolasers in the chip design.”
DCIM, or data center infrastructure management, is incredibly important for any data center. If infrastructure is not managed properly in a data center many problems can arise. Proper management is challenging for even the most experienced data center managers because technology is constantly evolving, power density is constantly added to racks and cooling needs shift as well. One of the best ways to improve data center infrastructure management is to utilize software to collect information rather than manually collecting information. DCIM software is a central location to aggregate and analyze data that has been collected so that performance and uptime can continue to be improved.
To properly manage capacity, data about the following must be collected: power usage, rack space, cooling and more. As this data is collected data center managers will be able to see how much rack space is being used so that they can determine whether or not they want to add more density to a rack. With this data, managers will know if rack density maximum capacity is being used properly or too close to being exceeded. If it is being underutilized too much energy may be used to cool it and it is likely better to increase density or condense server racks to maximize space and efficiency. This is important because proper management of rack density allows for improved energy efficiency and a reduction of downtime. But, without a sophisticated DCIM software, a data center manager may not even realize if a rack density is being under or over-utilized. Often, what data center managers experience is that, over the life of a data center, more systems are added, equipment is added or adjusted and suddenly there is a general lack of knowledge about power density. DCIM software helps prevent a lack of knowledge from occurring by ensuring that data center managers, and support staff, all have the most current information about what is happening in a data center. DCIM software will not only analyze rack utilization but power management as well. As data is collected data center managers can see how and where power is being used. This will help pinpoint areas in need of improvement and allow managers to make changes as quickly as possible. DCIM software can even be set up with automatic notifications so that the most current information is being provided at all times. With such current information it is easy to micromanage or become overly concerned with finite details but it is better to instead look at trends over time. By analyzing charts and graphs to see trends you will be able to see if something was a fluke or if it is a consistent pattern. Once consistent patterns are known it is easier and more effective to make permanent changes and improvements to a data center so that efficiency and data management can be optimized.
Many data centers operate with high density server racks for a variety of reasons. Perhaps they want to maximize their space by increasing the density of their racks so that they do not outgrow their data center walls. Perhaps it is a strategy to concentrate power, and therefore heat, in an attempt to more specifically cool areas as an attempt at improved cooling efficiency. No matter the reason , many data centers have extremely high PDUs, sometimes without even realizing it, and without realizing it, it can be incredibly challenging to appropriately cool a data center. This dilemma is often the source of outages and downtime, two things no data center wants to experience. No doubt about it, the pressure is on data center managers to run a high density data center that are also highly efficient and able to sustain their power needs. No small or simple task by any means.
So, what is a data center manager to do? How can you achieve high density, high efficiency and high efficacy all at once? Is it even possible? Yes, but data center managers must make it their priority to have a full working knowledge of their data center, power density capacities, best practices when it comes to cooling and more and then devise a strategy with contingencies so that if the unexpected arises there is a plan in place.
First and foremost, a data center manager must have knowledge of what a data center’s rack power density maximum capacities because without this knowledge first a data center will always be playing catch up. Catch up leads to outages and downtime so it is simply unacceptable. Once a data center manager has knowledge of power density maximum capacity they can work to ensure it is not exceeded. This alone will prevent a significant amount of problems. Additionally, by understanding maximum capacity a data center manager can make appropriate cooling arrangements. They will also be able to accurately determine what backup power and redundancies are needed to mitigate downtime. With a full working knowledge of data center power densities and cooling needs, alternative cooling methods can be explored to determine whether or not they would be more efficient or effective. If power density maximums are being pushed or exceeded additional server racks or space may be needed because pushing or exceeding the limits may temporarily save space but it will create major problems going forward. Outages, downtime, damage and more could be experienced if power density maximums are exceeded so the temporary solution was never really a solution at all. Once a strategy and plan is in place, the entire data center team and all other appropriate personnel should be well informed and trained because without communication problems will continue to arise. High density racks are a good strategy for data centers who want to maximize space and efficiency but for it to be effective a full working knowledge of data center abilities and capacities must be known and appropriate cooling methods must be executed.
Posted in Back-up Power Industry, computer room construction, Computer Room Design, data center cooling, Data Center Design, data center equipment, Data Center Infrastructure Management, DCIM, Power Distribution Unit
Tagged data center cooling, data center design, data center equipment
Data centers run a lot of software, applications, and more in order to perform all of the necessary tasks a data center completes. For a data center to run properly there is not just one program to get everything done, there are many. And, over time, more and more are added as technology and data center priorities change. Data center infrastructure management, or DCIM, is a top priority for data center managers because without access to and analysis of the most current data regarding data center infrastructure, programs and applications, devastating problems can and will arise. A data center manager that is not well informed may not know rack density maximums are and may not realize they are going to exceed them until it is too late. What happens when it is too late – power outages and downtime. Downtime can be devastating for any size business so it must be avoided at all costs. Due to the urgency and importance of effective DCIM, many data centers and managers are on a quest to get their DCIM on a “single pane of glass.” If they can see everything they need to see on a single pane of glass then they do not need to change applications or go rooting around for various data, it is all in one easy to access place. But, can it really be achieved? Can everything a data center manager needs to know be located on a single pane or is this a fruitless quest?
A single pane of glass for DCIM can be achieved but, most likely, application consolidation may need to take place. Consolidation is a cost-effective, efficient and effective way to achieve a single pane of glass approach. There are service providers who can consolidate applications and achieve a unified framework, and thus, unified view of applications. A single pane of glass may be able to fit everything that a data center manager needs to monitor operations but can they maintain and optimize their data center from a single pane? If not, how effective is it really? By hiring a service provider experienced in consolidation and optimization you can work closely with them for a smooth transition that does just lead to more headaches, confusion and miscommunication. If the approach is achieved effectively, all of the software tools can utilize data to offer the most current information about the function of a data center but in the attempt to make the transition some data centers realize that the compilation of so much data into an effective database for analysis often leads to errors. While a single pane of glass is possible it may be difficult to achieve but with the help of an experienced professional, time and patience your data center manager can get the view they hope to achieve to improve DCIM.
Data centers perform an invaluable job but that comes at a cost. Data centers use a significant amount of energy and, while many are making efforts to be more energy efficient, the fact of the matter is that there are still many data centers that consume a dramatic amount of energy each year. This of course is not only costly but not friendly for the environment. The digital world has some very real and tangible energy side effects. While it may not all be felt immediately, there is an environmental impact occurring as a result of data centers. Time discussed just how much energy is being used by data centers and what to expect going forward, ” IT-related services now account for 2% of all global carbon emissions, according to a new Greenpeace report. That’s roughly the same as the aviation sector, meaning all those Netflix movies the world is streaming and the Instagram photos they’re posting are the energy equivalent of a fleet of 747s rumbling for takeoff. Unless something is done to green the cloud, we can expect those emissions to grow rapidly—the number of people online is expected to grow by 60% over the next five years, pushed in part by the efforts of companies like Facebook to expand Internet access by any means necessary. The amount of data we’ll be using will almost certainly increase too. Analysts project that data use will triple between 2012 and 2017 to an astounding 121 exabytes, or about 121 billion gigabytes. ‘If you aggregated the electricity use by data centers and the networks that connect to our devices, it would rank sixth among all countries,” says Gary Cook, Greenpeace’s international IT analyst and the lead author on its report. “It’s not necessarily bad, but it’s significant, and it will grow.'”
The fact of the matter is that data centers consume energy, a lot of energy, and that will not change. But there are ways to reduce energy consumption and find more clean ways to use energy that leave less of an environmental footprint. Most data centers use a lot of energy but they also waste a lot of energy and that is simply unacceptable. Energy efficiency must be made a priority in a data center and a plan of action must be immediately implemented on a full scale. Consolidation must take place, fewer servers means less space and less to cool. But, with a high density rack, cooling can be focused so that cooling efforts are not wasted. Additionally, containment such as hot aisles and cold aisles is one way to help improve energy usage. Another and more green option in terms of cooling is to house your data center in a cooler climate that can take advantage of natural cooling elements and reduce cooling needs within a data center. Additionally, as more and more moves to the cloud, physical infrastructure can be reduced in data centers which helps reduce cooling needs. Data centers need to examine their energy usage and look for ways to not only reduce but for green options that are more environmentally friendly so that a sustainable data center future can be achieved.
Data center migration. Those three words could probably send any data center manager running for the hills. Alas, when a data center has outgrown its current facilities or has to be moved for any other reason, data center migration is a necessity. A data center migration is a significant undertaking fraught with potential risks and hidden problems. So, how does anyone ever accomplish it? Through proper research, planning that is complete factors in contingencies, careful instruction to ensure that everyone is on the same page, and a lot of patience, a successful data center migration can be achieved. When anticipating a data center migration there is no avoiding it, you simply have to face the fact that there will be surprises along the way.
For any data center, the primary concern with a migration is downtime. Even seconds of downtime can be incredibly costly so reducing or completely eliminating downtime is the name of the game. While certain things can be moved during off-peak hours, some things still may occur during peak business hours. For this reason it is very important to keep everyone well informed and on the same page at all times. End users, support teams and anyone impacted by the migration should be informed of the time table, schedule and anticipated plans regarding the migration. Next, it is important to research what existing infrastructure there is, what legacy systems are in place, and what will be making the migration. Once you have a thorough idea of what will be making the migration, it is important to anticipate what additional infrastructure and equipment will be needed in the new location so that a layout can be planned. Plan a layout based on best practices in the new data center so that you can accommodate growth as needed. Scalability is important for the lifespan of any data center so while you are making the move it is an ideal time to ensure the new data center will be scalable. When anticipating scalability you must see beyond current needs and standards and look forward to future rack density expectations. With all of these things being considered, you may want to also consider what option is best for efficient cooling. Cooling a data center is often one of the biggest expenses a data center experiences so when determining layout you may want to think about implementing hot aisles/cold aisles and whether or not there are other layouts that may serve your data center best. The final part of any data center migration is the migration itself. For most migrations it is a good idea to use the help of an experienced project manager with knowledge and expertise about data center migrations to ensure everything goes smoothly and that once the migration has occurred, everything runs as it should.
Designing and constructing a data center is no small undertaking. Heating and cooling, energy efficiency, infrastructure management and scalability must all be considered. A data center must be designed to meet current needs while being able to scale up or down in the future as needed. The tricky part of that with a data center is that if you build a data center that is far bigger than current needs it may not be energy efficient. But, if you build a data center that is just barely big enough and you expand over time you may quickly outgrow your space and find yourself looking to move which is costly and difficult. So, how does one build the illusive immortal data center? Do not fear, it can be achieved.
First thing is first, you have to determine the goals of your data center when designing an immortal data center. One of the most important things to consider is scalability. Without scalability, most data centers will outgrow themselves with time. A data center must have dense server racks, do not run racks on only 50% capacity. Increase the density of racks to maximize space. But, you cannot increase rack density without having sufficient cooling options. Some data centers prefer to employ hot aisles and cold aisles to help more efficiently heat and cool a data center. By creating hot aisles and cold aisles, or specific zones for certain infrastructure, it can drastically improve energy efficiency and reduce energy expenses. If hot aisles or cold aisles are not ideal for your data center, consider adding a high density room where cooling energy can be focused to the most demanding area and the rest of the data center can be kept at a warmer temperature. This will help keep costs down while still efficiently cooling high density server racks. Additionally, when designing an immortal, future-proof data center, it is wise to look at green and more efficient methods of cooling. By implementing green methods you can save significantly over time while still effectively cooling a data center. The last consideration for all data centers is the cloud. The cloud is really the way of the future and many data centers are converting to more and more cloud usage to reduce physical infrastructure. This helps free up additional room in a data center and reduce heating and cooling needs. The cloud is infinitely scalable so it offers immense potential for the future and is a significant tool to keep any data center remain immortal.
Data centers use a lot of power, have a lot of equipment and run around the clock. With so much going on in data centers, circuit breakers have a lot to manage and can easily become overloaded without proper attention, maintenance and regulation. When a circuit breaker gets overloaded, an arc flash can occur. If you are not familiar with what an arc flash is, you should be. Why? They are very dangerous and pose significant risk to data centers. The Workplace Safety Awareness Council explains what an arc flash is and why it should be avoided at all costs, ” Simply put, an arc flash is a phenomenon where a flashover of electric current leaves its intended path and travels through the air from one conductor to another, or to ground. The results are often violent and when a human is in close proximity to the arc flash, serious injury and even death can occur.” This is an understandable concern for data center managers because an arc flash could endanger data center employees and possibly damage data center equipment and infrastructure.
To best achieve circuit breaker protection and prevent arc flashes from occurring you have to begin by protecting the circuit breaker from overload. You have to assess the load, and then size the load to what each circuit breaker can manage. With monitoring and the use of today’s technology the load the circuit breaker is experiencing can be assessed, monitored and tweaked as needed. While this is a small solution, it is not a complete solution because it does protect from significant arc flashes. Next, protection must be implemented for branched circuit breakers to ensure that there is no upstream or downstream problems if a circuit breaker is tripped. Through the use of tools like ZSIs, or zone selective interlocking systems, circuit breakers can better communicate with each other. Upstream and downstream circuit breakers communicate with each other so that, should a problem occur downstream, it can send a message to upstream circuit breakers to wait until the problem has been cleared. When you better manage circuit breakers you protect your data center from downtime as well as other significant concerns such as injury to workers and damage to property. All of these things cannot have a price tag put on them, they are truly invaluable. In addition to implementing effective systems to protect circuit breakers from becoming overloaded or experiencing arc flashes, it is important to properly train personnel so that they know how to assess and maintain circuit breakers and know what to do should a problem occur.
Corporate IT departments are complex and critical to the success of any business. In today’s world, technology is constantly evolving, more and more is being done in the online environment and customers are demanding constant uptime. A corporate IT department, run by a CIO, needs to stay on the cutting edge and meet demands to stay effective and successful. The successful CIO will undoubtedly be a trendsetter by nature, driven by technology and all of its constant changes. To be anything else will leave the CIO, and the entire IT department, reactive in its approach.
Because IT departments demand a lot of time and money for any business, their expenses and budget are often under great scrutiny. Infrastructure changes often which leads to constant expense and, in the corporate world, the expense could be significant, particularly for companies with hundreds or thousands of employees. One step to achieving a successful corporate IT department is to try to limit IT infrastructure expenses to around 50% of the budget, as opposed to the more common 70% of the budget. In today’s workforce most companies are dealing with a wide-range of technology knowledge amongst their employees but, the great majority, are relatively tech-savvy. This means that when a corporate IT department does not perform as it should, employees are more than aware. But, that does not mean that there are not individuals in the workforce that are significantly less tech-savvy. So, how does a corporate IT department manage such a wide employee knowledge and skill base? CIOs have an important task when choosing a product suite for their business to suit the needs of their employee demographic while pushing technology and infrastructure forward to stay current. But, when choosing infrastructure the budget must be an important consideration as well so that infrastructure costs do not become astronomically out of proportion to the rest of the budget. As more and more IT departments and data centers move towards automation and cloud computing, infrastructure can be greatly reduced which frees up more money in the IT department budget. This is something that not only the CIO can be happy about but that the CFO and rest of the management will be happy about. To truly have the most successful IT department in a corporate setting, the CIO must lead the ship and carefully direct the path of the department through careful consideration of all products, well-executed management and training of corporate personnel, an eye on the bottom line of the budget, and, ultimately, a technology-driven, cutting edge perspective that is focused on innovation.
Data centers are supposed to be technology driven and on the cutting edge of technological advances. But, when technology changes in the blink of an eye, data center infrastructure and programs can very quickly become outdated. A data center is the core of any IT department and when things are outdated they no longer run smoothly or independently and become quite problematic. As a way to mitigate these issues and hopefully avoid them altogether, many data centers are making the move toward automation to support cloud computing. When automation works as it should, processes run smoothly and, ideally, on their own, to perform desired tasks and keep a data center functioning as it should.
When it comes to automation, testing, more testing and, yes, even more testing is critical. Everything must be checked to ensure that it is running properly before full implementation. When automation is done correctly, it allows a data center to be more scalable so that load can be actively balanced and more efficient which increases response time. Because efficiency is the name of the game, more and more data centers are finding ways to reduce and better improve infrastructure and ultimately reduce overhead and overall data center expenses. Cloud computing, coupled with automation, provides an opportunity to do so, lowering expenses and remaining more competitive without sacrificing quality of service. By automating a data center personnel are able to have control of all resources at both the software and hardware level. Data Center Knowledge provides a great description of the different layers of automation available and what that means for data centers:
The automation and orchestration layers
- Server layer. Server and hardware automation have come a long way. As mentioned earlier, there are systems now available which take almost all of the configuration pieces out of deploying a server. Administrators only need to deploy one server profile and allow new servers to pick up those settings. More data centers are trying to get into the cloud business. This means deploying high-density, fast-provisioned, servers and blades. With the on-demand nature of the cloud, being able to quickly deploy fully configured servers is a big plus for staying agile and very proactive.
- Software layer. Entire applications can be automated and provisioned based on usage and resource utilization. Using the latest load-balancing tools, administrators are able to set thresholds for key applications running within the environment. If a load-balancer, a NetScaler for example, sees that a certain type of application is receiving too many connections, it can set off a process that will allow the administrator to provision another instance of the application or a new server which will host the app.
- Virtual layer. The modern data center is now full of virtualization and virtual machines. In using solutions like Citrix’s Provisioning Server or Unidesk’s layering software technologies, administrators are able to take workload provisioning to a whole new level. Imagine being able to set a process that will kick-start the creation of a new virtual server when one starts to get over-utilized. Now, administrators can create truly automated virtual machine environments where each workload is monitored, managed and controlled.
- Cloud layer. This is a new and still emerging field. Still, some very large organizations are already deploying technologies like CloudStack, OpenStack, and even OpenNebula. Furthermore, they’re tying these platforms in with big data management solutions like MapR and Hadoop. What’s happening now is true cloud-layer automation. Organizations can deploy distributed data centers and have the entire cloud layer managed by a cloud-control software platform. Engineers are able to monitor workloads, how data is being distributed, and the health of the cloud infrastructure. The great part about these technologies is that organizations can deploy a true private cloud, with as much control and redundancy as a public cloud instance.
- Data center layer. Although entire data center automation technologies aren’t quite here yet, we are seeing more robotics appear within the data center environment. Robotic arms already control massive tape libraries for Google and robotics automation is a thoroughly discussed concept among other large data center providers. In a recent article, we discussed the concept of a “lights-out” data centerin the future. Many experts agree that eventually, data center automation and robotics will likely make its way into the data center of tomorrow. For now, automation at the physical data center layer is only a developing concept.