Its important to choose who you want as a Customer

March 20th, 2013

Customers may choose you, but its also important to choose who you want as a customers. For years, I have been telling people that one secret to success in the datacenter business is be picky when it comes to what kind of customers you decide to provide service to. This may go counter to popular ideas about business, that is, anyone willing to pay should be a customer of mine. That may hold true is you sell hamburgers, but when you sell datacenter space and IP backbone access, its very important that you stay away from certain types of customers.

Customers I traditionally avoid:

  1. Gamers
  2. Adult Sites
  3. Email Marketers
  4. Proxy Providers

Why should the above group be avoided? Lets look at the four factors that make a customer undesirable. First, can they pay their bills reliably. Second, will they be a long term customer. Third, will they require a lot of customer service. Fourth, will they impact your resources negatively.

Gamers fail three of the four key criteria, they are bad at paying bills, they are not long term clients, they dont require a lot of assistance, but they do negatively impact network utilization and are more prone to DDoS attacks. Adult Sites can be good payers and can be long term clients, but they also require a lot of assistance and have a negative impact, adult sites get DDoS attacks frequently, their bandwidth usage is highly volatile, and their actions of handling illegally copyrighted material cause major headaches and liabilities. Email Marketers fail all four criteria, they’re short term clients, are not good payers, abuse IP resources, and are strong DDoS targets because everybody hates spammers. Proxy Providers are interesting, they are good payers and long term clients, but they have a lot of baggage since proxy providers can’t control what the users behind the proxy do. In our experience, proxy providers cause a lot of headaches and generate a ton of abuse complaints from their proxy clients doing everything from sending spam to running botnet attacks.

Your are the company you keep….

The type of people you have in your datacenter should reflect who you are as a business. I run a very stable, reputable business, so as such, I prefer that my customers be stable, reputable businesses. In the long term, this philosophy has worked very well for me.

Choosing a local VOIP Provider for your Business Phone

February 19th, 2013

We recently switched over to a new VOIP provider for our phone services. In the past we were using one of those large national providers, service was okay, but it could be much better. Telecom is normally treated as a commodity, that is, if all the features are there its a matter of who has the lowest price. Yes, everyone has the same features, and prices can vary, but there are several intangible aspects that you cant easily identify.

We decided to use a local VOIP provider who is in our area because we felt that having local access to the company would be beneficial. The provider, Essenz, Inc., is based in Lafayette Hill, PA – just 20 miles or so from our offices. Their business phone solution had all the features we were looking for and the price was very competitive. Best of all, the phones were personally delivered to our location and setup by a technician – this is free and included in their service. Because they are local, they also offer same day (4 hour response) hardware replacement if the phone fails.

These bonus features make all the difference, and trust me, if your phone dies, waiting 1-2 business day for a replacement to be shipped is not ideal. I encourage people to look locally first, you’ll be amazed how many great providers are right in your backyard.

Influx of Colocation in Philadelphia post Hurricane Sandy

December 4th, 2012

We have seen a dramatic increase in colocation activity in the Philadelphia area following Hurricane Sandy.  Sandy effectively knocked out several North Jersey and Lower Manhattan facilities for over a week.  The Whitehall St. facility in Lower Manhattan was without power for over a week.  Then there were datacenters that had power but lost IP connectivity when their circuits from Manhattan went down.

On top of all of this, a local Philadelphia facility (Voicenet) decided to shut down its colocation operations.  We have actually moved in over 5 clients just from Voicenet alone, and another 6 clients from various providers on the Metro NYC area.

What did we learn from Hurricane Sandy?

1. Don’t put your datacenter in a building with a below grade electrical room.

2. Don’t put your datacenter in an area without diverse IP POPs.

The first rule is obvious, or so you would think, but amazingly people in NYC build telecom operations in buildings that have below grade electrical rooms. In the case of Whitehall, not only was the electrical room below grade, but so were the fuel pumps for the generators.  The second rule is broken all the time.  I can’t tell you how many facilities claim to be multi-homed with multiple carriers, but when you look closely, you find out that all those carriers come in via a single fiber ring that runs to a single POP.

There was one datacenter in Boston that had fiber running to Whitehall St. in Lower Manhattan, so when Whitehall went dark, the facility in Boston lost all IP connectivity. Boston has local IP POPs, why get all your connectivity out of Whitehall in NYC? Answer is cost.  It’s cheaper to put everything on one big pipe and send it to a heavily trafficked POP like Whitehall, but like the old saying…. you get what you pay for.

 

 

Voicenet Outage – Northeast Philadelphia

October 19th, 2011

Another local datacenter outage to report. Voicenet facility located in Northeast Philadelphia had a major network outage last night. Reports from a collegue of mine that manages equipment there indicates the outage lasted for about 45-60 minutes. The outage even took out Voicenet’s phone system so customers who have equipment in the Voicenet Datacenter couldn’t even call in and complain.

I cant say it enough… Dont colocate equipment in datacenters that dont have true diverse network connectivity. Voicenet claims redundant fiber, but its just a single fiber ring. Yes, a ring has redundant fiber and two paths to prevent a fiber breakage, but its still a single ring operated by a single entity, with an equipment SPOF (single point of failure) at the other end. The only thing a ring protects against is back-how digging up the street or a tree falling down. Datacenters needs to have true diverse fiber. That means separate fiber paths coming in via separate entrances, and the fiber itself must be owned and operated by separate entities with completely separate routing platforms.

The scary thing is there are serveral datacenters in the Delaware Valley that operate off fiber ring topologies. Stay away from these datacenters, its just an outage waiting to happen.

Why did my Data Center UPS Fail?

October 7th, 2011

I hear this all the time. Most people move out of a datacenter because something bad happened, and its usually a major power failure that causes the most trouble. In this article, I am going to outline and analyze a power failure event that occurred at an unnamed facility. This is a true story.

About 2 years ago I fielded a call from someone who lost power at their current data center provider. In addition to being down, they also had some equipment failures (power supplies and some RAM went bad in a few systems). Their provider told them that nothing was wrong with the UPS, rather, it was an issue with the utility caused by a brown out. As soon as I heard this, I told the person that this explanation was completely bogus.

Lets recap the cardinal rules of a good UPS:

1. An online UPS setups should always provide clean line power regardless of supply.

2. If an online UPS fails, an auto-sync transformer bridges line power and utility within 1 Hz and no power is lost, only backup capability is lost.

And lets recap what you need to do in order to make sure the above rules always apply:

1. Check your batteries every 3 months.

2. Replace a battery as soon as its internal resistance rises by 10%

3. Replace a battery as soon as its 4 years old, even if its internal resistance is still within spec.

4. Provide suitable cooling to the UPS.

5. CHECK THE BATTERIES.

I cant stress enough how important batteries are. The entire UPS is built around the concept of having working batteries. Almost every line-effecting outage of a UPS is due to a battery problem. At Quonix, we use Liebert Series 300 UPS systems that have had inverter boards fail, induction coils burn out, and input filter short out, and we NEVER lost output line power. That’s why the Liebert’s cost so much, they are designed to handle failures, but it requires good batteries.

Getting back to the story about the brown out. Any UPS that experiences a brown out or any kind of dirty power, would immediately engage batteries in order to provide clean power while it activates the GENSET cut-over. This requires the UPS to run on batteries for 5-7 seconds. If the batteries cant hold, the UPS will drop offline into bypass mode and auto-sync to utility line power. Once a UPS goes into bypass and syncs to utility power it no longer provides power protection or line conditioning. So all the dirty power goes straight through. If power was lost, GENSET power now comes straight through. And when utility power returns, the GENSET cuts out causing another small blip. This is why the server power supplies and RAM went bad. The dirty, and possibly surging power came right through the UPS into the rack cabinet.

Many providers dont properly maintain their batteries. They just assume the batteries will last 4-5 years. Not the case. I’ve seen brand new battery cabinets have 1 battery go bad after as little as 1 year. Sometimes its just a random manufacturer defect. And in many cases, all it takes is 1 bad battery to foul the entire array.

Want to be sure if your provider is on top of things? Easy, just ask for a copy of their UPS and battery preventative maintenance contract. If they have one, and they should, it should be easy to fax or email you a copy. You can even request a battery report. At Quonix, the vendor we use for our battery maintenance sends us a detailed graphical report with the health of each battery – voltage, impedance, internal resistance, temperature, and age.

Repairing Tate Access Floor Tiles

October 6th, 2011

How to repair floor tiles?

For this article I am referring to the newer style of Tate access floor tiles. The newer style has a single piece of laminant that runs from edge to edge. The older style tiles had the laminant end about a quarter inch short of the edge with the remaining space filled with a black edging strip that frequently snapped off.

The new style is great, but over time the laminant will start to pull away, especially in data centers with low humidity. Its simple to repair.

The laminant is held in place by contact glue, similar to a kitchen countertop. Contact glue can be loosened and re-hardened with heat.

To reattach your Tate laminant get a standard clothing Iron – the kind with a non-stick bottom. Set the iron temperature to medium and turn off the steam. Obviously, do this repair work outside the datacenter. Place the iron on the tiles laminant surface and slowing move it around. The laminant surface needs to be heated for at least 2 minutes. After properly heated use a surface roller to apply even pressure over the top of the laminant and press it down hard to the tiles underlying metal frame. Continue to use the roller until the surface has cooled down. At this point your laminant will be 100% re-attached.

 

Why local hosting providers are better…

March 17th, 2011

We all hear how its good to buy our produce locally, but what about buying web hosting services locally. Interestingly, your company will be better off if you host with a local provider, and it has nothing to do with better support and everything to do with search engines and regionality.

Search Engines such as Google or Bing like LOCAL results

When you do an internet search, the search engine knows where you are and in turn will display search results that are close to your region. For example, if you do a search for lawyers, Google will undoubtedly return results for law offices in your area. It does this using IP geography. From your IP address, Google has a rough idea of why you are in the world.

The same technology that determines where you are located can be used to determine where a website/company is located. Now lets be honest, search engines know that most websites are hosted outside their served region. However, if your website is hosted from an IP with a geographic footprint of say Ohio, and your business is in Ohio and mentions this in the indexable content on your site (mailing address, area code, ectc.,.), the combination of these two things is very positive. It tells Google you are physically local to that area and cyber local to that area. All of this is good stuff for your ranking.

So go ahead and host your website with a local provider!

Cloud Computing and VPS Confusion

February 24th, 2011

I hate terminology. I especially hate terminology when people gets things confused and use it improperly. My latest annoyance is the confusion and miscommunication of the terms Cloud Computing and VPS (Virtual Private Server).

The problem is that some hosting providers use the term cloud computing synonymously with VPS, and as a result the public now thinks they are one in the same. People call me sometimes asking if I do Cloud services, and I know they are talking about VPS, but they have been convinced that Cloud services is what they need. They mainly do this because Cloud Computing sounds better then VPS, and much of the mass media lately has started to emphasize “The Cloud” as a viable product for everyone.

What is VPS?

VPS is virtualization, the concept of running multiple server OS’s inside a single physical server. If you have a small hosting environment, VPS is ideal. Your VPS will sit on a single server with 10-15 other VPS’s that belong to other customers. You and those other customers all share the resources of a single server. VPS is not Cloud, because everything resides on a single physical machine, that machine always provides your VPS with CPU cycles, RAM, and storage.

What is Cloud Computing?

Cloud computing has been around for years. True cloud computing is the concept of a large pool of servers that work together to provide CPU cycles for computation. End-users send computational work into the cloud, the cloud processes it very quickly, and then it returns the computed result. From a fiscal standpoint, you only pay for the brief amount of time the cloud needed to work on your computations.

Cloud computing is obviously not VPS. The majority of VPS is used to host data. Data hosting has absolutely no need or application to Cloud computing since hosting is inherently very light on CPU processing.

Why does my datacenter feel warm?

November 8th, 2010

As soon as November approaches I start hearing this question more and more. Someone will come in from the outside and walk into the datacenter and immediately say, “It feels warm in here, is something wrong?”

The answer is NO, nothing is wrong.

When you drive home from work, and get of your car and walk 10 yards to your front door (in 30 degree F weather), as soon as you get inside, the first thing that probably goes through your head is… “Ahh… Its nice and warm inside”. And that is with your house thermostate set to 70 degrees F.

A good datacenter will hold a solid 72 degrees 35% relative humidity year round. So yes, in the winter months, when you come in from the outside cold (30-40 degrees F) and walk into a 72 degree F room that happens to be a datacenter you should feel warm. But warm is a relative sensation by our bodies. When its 80 degrees F outside and you walk into the same datacenter, the first thing you say is… “Ahh… Its nice and cold in here”.

The datacenter is always 72 degrees F but in the winter that feels comfortably warm to our bodies after we were just exposed to 35 degree F outside temperatures. So relax, its not “warm” in the datacenter.

Bad Locations for a Datacenter

September 1st, 2010

Because I am a native of Philadelphia, I am very familar with the area and the history of certain commercial development areas. A few months ago, an outside firm started a Data Center Facility in the old Philadelphia Navy Yard. This is the worst place in Philadelphia to build a telecom facility. Since 1998, many local telecom companies have all looked at and passed on the Navy Yard. Why? For starters there is ZERO fiber optic access there. There aren’t even aerial poles. The copper service that does exists from the local LEC (Verizon) is underground and is heavily corrided due to flooding. Oh, yes, flooding, theres that too!

The new firm most likely took on a heavy expense of demarcing fiber into the building through the Navy Yard grounds. So they effectively have a single fiber entrance. Agauin, not ideal. Not very carrier diverse either since all the carriers will be on the same fiber trunks in the same conduit. And loop service access (DS-1 and DS-3 cross connects for MPLS) will be terrible.

Its a shame they didn’t reach out to local telecom experts, since the overwhelming concensus would have been to stay away from the Navy Yard. There are 3 solid carrier hotel buildings in Philly, all of which have diverse power, multiple diverse fiber entrance, and the list goes on. The Navy Yard was probably picked by this firm because off the low operating cost and tax incentives, but at the end of the day, not being in a true carrier diverse building will hurt over time.