ServePath Blog

If you answered NO to the question in the title of this article, then you run the risk of not being able to handle traffic loads as well as not have application or server redundancy with your architecture. Believe it or not, your customers DO have a requirement that your site or application be resilient or highly available…they just want it to work whenever they access it. To that end, your infrastructure must scale as well as be redundant, especially should your infrastructure encounter an issue rendering a server as unavailable.

With a properly architected load-balanced network, your site can handle spikes of load more elegantly, minimizing performance issues when the demand peaks. Similarly, if you want to maintain a high-availability website, server outages or issues should be minimized or hidden away from the end user. A correctly set up load-balanced network will automatically route traffic away from hardware that is having issues or not responding, thus preventing your users from seeing sluggishness or down-time.

At ServePath, we recognize the importance of providing solid and robust load balanced architecture offerings, part of the reason why we have chosen f5 to be our load balancing solution of choice.

We have recently revamped the Load Balancing page on the ServePath site in order to better explain the options available to you as well as provide some examples on how load balancing can (and should) be used. Some of the questions we answer are:

• What is a Load Balanced Server Network?
• How does a load balancer work?
• Who needs a Load Balanced Server Network?
• What are some examples of a Load Balanced Server Network?
• Why host your Load Balanced Network with ServePath?

What I like best about this updated section of the site are the different examples of Load Balanced Server Networks:

Simple Load Balanced Network

• F5 Load Balancing
• Web servers distributed across public switches

Load Balanced Network With a Firewall

Hybrid Load Balanced Network

• F5 Load Balancing Across ServePath & GoGrid Servers
• Cloud Connect
• Cloud Storage

Highly Available Load Balanced Network

• F5 Load Balancing
• High Availability Via Redundancy
• Gigabit Private VLAN

Remember, having a Load Balanced Network is only part of a “high availability” hosting solution. Frequently, you need to utilize other services (like backup & recovery, firewalling or replication) to ensure redundancy and resiliency of your server environment. You can even set up hybrid infrastructure environments that use Cloud Computing (with GoGrid) as your Web & Application environment and Managed Dedicated Servers (with ServePath) as your back-end database and high-I/O infrastructure.

We offer a variety of packaged or individual solutions to meet your hosting needs. Just ask one of our Sales Reps and they can definitely help you out.

Today we released a new Whitepaper written by Randy Bias, ServePath’s VP of Technology Strategy titled “Scaling Your Internet Business.” If you are a Web Application Developer or interested in learning about scalability, specific to how it relates to Web Applications in the Cloud, Dedicated, or Colocation environments, I recommend you download and read this whitepaper.

The whitepaper can be obtained here from the ServePath site.

Scalability is critical to the success of many organizations currently involved in doing business on the Web or who are providing information that may suddenly become heavily demanded. While there are many strategies that IT organizations can undertake, the way they are designed and implemented can make or break these businesses.

The ServePath whitepaper discusses the following topics:

• How web applications scale
• Scalability within different hosting scenarios
• Thinking through and choosing a scaling strategy
• GoGrid & ServePath scalability options

Scalability can come in all shapes, sizes and flavors. You can scale “up” (vertically) or “out” (horizontally). Choosing the right option can be tricky, if not daunting. Depending on what you want your strategy to be, you can choose “cloud-only”, “dedicated/colocated-only” or a “hybrid” approach.

If you are currently using dedicated or colocated hosting, you should potentially re-evaluate your current hosting strategy and architecture to see if it makes sense to use Cloud Computing or a combination of Dedicated and Cloud as a scalability option.

A “Hybrid” environment using Dedicated and Colocated servers in conjunction with a Cloud front-end using Cloud Connect.

“Businesses need more than just cloud computing to solve their scalability problems,“ says the whitepaper author Randy Bias. “Web operators and developers want to use the best tool for the job and, right now, cloud computing is one tool in their arsenal. GoGrid has pioneered the concept of cloudcenters, datacenters-in-the-cloud, which provide the full range of scalability tools needed for a growing business including cloud servers, managed dedicated database servers, private VLANs, VPNs, and even co-location for those who need their own hardware. This whitepaper describes how a growing business can use vertical and horizontal scaling techniques to the most advantage to save money and never miss a prospect, customer, reader or interaction.”

Companies interested in learning about Web Application Scalability, Cloud Infrastructure, hybrid hosting and scaling solutions available from GoGrid or ServePath are encouraged to download this whitepaper from either the GoGrid site or ServePath site.

Has the economy hit your IT budget hard? Are you looking for some additional savings when it comes to managed dedicated hosting? Well, we at ServePath are here to help you out! Starting March 1st, 2009, we have a few specials that won’t hurt your wallet much…but the thing to remember is, these won’t last! So you had better act quickly!

Note: as these are pretty HOT deals, available quantities may have already changed! Be sure to check the Special Offers page for availability.

Also, please note that these offers cannot be combined.

• Free extra 3 GB RAM with purchase of In Specs BusinessPath (total RAM = 4GB) with the following configuration:
  • 1U Core 2 Duo 2.13GHz processor
    • 4 GB RAM (regular RAM=1GB)
    • 80 GB SATA HD
    • 1500 GB data transfer
    • $199.99/mo and $249.99/setup fee (Operating systems licensing fee will be added when applicable)
• Free extra 1 GB RAM with purchase of any value servers with standard deployment time (total RAM=4GB
  • Limited quantities!
• 1-HOUR deployments – In Specs BusinessPath with the following configurations:
  • 1U Core 2 Duo 2.13GHz processor
    • CentOS 5.0
    • 4 GB RAM (regular RAM=1GB)
    • 80 GB SATA HD
    • 1500 GB data transfer
    • $199.99/month and no setup fee
    • Limited quantities!
  • 1U Core 2 Duo 2.13GHz processor
    • Windows 2008 Standard Edition
    • 4 GB RAM (regular RAM=1GB)
    • 80 GB SATA HD
    • 1500 GB data transfer
    • $249.99/month and no setup fee
    • Limited quantities!
• ProActive Monitoring Suite:
  • Description: ServePath Proactive Monitoring service allows you to outsource the management of your hosted server to certified ServePath system administrators. Our team of system administrators apply patches, monitor hardware and TCP/IP services. When a server problem arises, the ServePath system administration team proactively notifies you and resolves the problem.
  • URL: http://www.servepath.com/dedicated-servers/proactive-management-suite.php
  • $99.99/setup fee and $49.99/month for the first month, and get the next 6 months free with any dedicated server purchase
• Free Cloud Connect:
  • Description: Cloud Connect incorporates the elastic benefits of cloud computing with traditional dedicated hosting making it a powerful tool for building a hybrid infrastructure.
  • URL:  http://www.servepath.com/dedicated-servers/cloud-connect/index.php
  • No Set-up Fee for ServePath customers, if you sign up with a GoGrid account
  • No Set-up Fee for GoGrid customers when you buy any ServePath value server package

Remember, with every server that you get on ServePath, you receive the following FREE items:

• 25 GB NAS (Network Attached Storage)
• Remote Server Reboots
• Ping Monitoring with proactive response
• 16 IP Addresses¹
• Hardware replacement guarantee
• 24/7/365 Support
• Unlimited private VLAN bandwidth
• 10,000% SLA with 100% Uptime guarantee
• Fully managed DNS
• SAS 70 Type II Compliant San Francisco Data Center

Also, we have some great deals that are NOT listed on this blog post. Call Sales at 1.866.321.7284 (Worldwide: 1.415.869.7000) or start a Live Chat directly via the ServePath website.

1. IP justification form required if more than 4 IP addresses requested [↩]

ServePath has released version 2.3 of the Customer Portal located at https://my.servepath.com with immediate availability to all ServePath customers. While the entire portal continues to get enhancements and fine-tuning, there are a few items that I wanted to highlight that may be of greater importance and interest to ServePath customers. Namely:

• ServePath Backup & Disaster Recovery is now fully available within the Customer Portal
• Support Case creation now allows for “self-help” and “self case closure”
• DNS requests can now be managed directly from the ServePath Portal Dashboard

New My.ServePath.com Portal

The new Customer Portal has many of the often requested services now within the main dashboard page.

Quick Links include:

• Managed Backups – **updated** access the ServePath Backup & Disaster Recovery service (see below)
• Reboot Server – request for a server within your network be rebooted
• DNS Request – request DNS services
• Knowledge Base – view tips, suggestions, hints and other documentation within the Knowledge Base
• Security Scan – initiate a Security Scan on your environment
• Create a Case – **updated** Case creation tool (see below)
• View Existing Cases – view any open Support or Billing Cases
• View Invoices – view your most recent invoices and billing history
• Pro-Services – order a variety of services from the Professional Services & Consulting Division including:
  • OS Reloads
  • Server Duplication
  • LAMP setup
  • VPN configuration
  • Control Panel upgrades
  • Server Hardening
  • MySQL Configuration tuning
  • …and more!
• ServePath Status Blog – direct link to http://www.servepathstatus.com

Within the Dashboard you can also have the ability to see Network Status Updates, to initiate a Live Support Chat, Order Services & Hardware Upgrades and see headlines from the ServePath blog, among other things.

ServePath Backup & Disaster Recovery

ServePath offers a robust managed backup and disaster recovery service which is now accessible from within the ServePath Customer Portal. More details on this offering can be viewed here. Features and benefits include:

• Volume discounts for large storage requirements
• Easy to use web interface
• Server Cloning
• Restore specific files/folders within minutes
• Bare-metal restore and disaster recovery methods
• Thin provisioning – grow your storage allotment on-the-fly
• Disk-based data protection
• Point-in-time recovery
• Windows and Linux support
• Backup busy MySQL Servers without interruptions
• Customizable backup schedule (hourly/daily)

Schedule a backup:

Browse previous backups:

View details of your server:

View history of backups:

Create a Case

When you create a System, Billing, Professional Services or Network Case within the new ServePath Customer Portal, you now have the ability to fully drill down to a much more granular level within the same page. The process is simple: select a Category and subsequent Sub-Category. Then choose the Server(s) affected and the IP addresses of the server(s) in question. Add the additional Contact information (name, email, phone and anyone you want to copy on the case). Then be sure you create a detailed Description. Once you click the “Create Case” button, your case will be submitted to the appropriate division within ServePath. However, you will now also be presented with a list of Knowledge Base articles that may be related to the case you just created. Results are presented based on matching the Category, Sub-Category and Description. If you find a solution within that list, you can opt to close the case based on that suggested article. Note that the Knowledge Base can also be accessed without having to open a case.

We hope that you find this update to be useful and helpful. As always, we encourage feedback on this update and there is a “feedback” link within the top navigation bar of the Customer Portal.

So I’ve been thinking lately about the title “System Administrator.” This is our official job title (it says Systems Administrator on our business cards–I guess the extra s is a nod to the fact that we have some 2500 systems in the data center). This is a slightly misleading title, however. I’m not really a system administrator as much as I am a system medic. I only see servers when they’re sick, I do whatever it takes to fix them as fast as possible, and I (hopefully) never see them again.

From what I’ve seen (working for ServePath, but actually far more often on IRC), people tend to think this is what a system administrator does.

It isn’t.

Just because a server is online doesn’t mean it is properly administered. This is akin to saying that if you’re alive, you must be healthy.

There are two very broad areas a server needs to be tuned for after its services have been set up, security and performance.

If you’re a sysadmin for, say, a FreeBSD server, some questions I might have regarding security are

• Do you know what version of SSL/SSH you have installed? Do you know whether you need to upgrade? Do you know how to upgrade these without breaking anything?
• Do you know what ipfw is, and how to use it?
• Do you know what pf is, and how to use it?
• Do you know what termlog is, and do you use it? Why?
• What logs do you keep, and where do you keep them?
• Do you know what a jail is, and should you be using them?

For performance,

• Which processes take up most of your resources, and which resources (disk I/O, network, CPU, etc)?
• At what point is a process taking too many resources?
• Do you know what inodes are? Do you have enough? How would you get more? (I had a client run out of inodes on two different file systems.)
• Do you know why /usr, /, /tmp, and /var are all on separate slices by default? When might you want to change this?
• What would you do if directories are taking a long time to list their contents?
• What network services do you run, and what kind of network performance do you get? How could you adjust your network buffers to get better performance? What about your firewall rules?
• Do you know what RFC1323 is, and when you’d need what it specifies?

Ultimately a server needs rather a lot of attention to be performing well and be secure. If you just turn a server on and plop it online, you’re probably not getting out of it all that you could.

And you’re also probably hosting movies for kids on IRC, even if you don’t know it.

This morning at approximately 10:00 AM EDT Hosting Matters was hit by a massive DoS attack apparently directed at several conservative blogs hosting with them. Hosting Matters announced in their forum that a specific web site was the target of the attack but did not identify the target by name. The web site in question was isolated from the rest of the Hosting Matters network but the attack still managed to affect several conservative blogs such as Instapundit and LittleGreenFootballs. According to blogger Michelle Malkin, who has been the target of previous DoS attacks but was not affected by this one, the targeted blog was Aaron’s CC. Most of the blogs affected seem to be back up and running now, unlike the original target.

According to reports, the attack originated in Saudi Arabia, although that doesn’t necessarily mean that the perpetrators were Saudi, just that the computers they hacked were situated in Saudi Arabia.

At ServePath we were able to deflect a similar attack thanks to our Riverhead Networks equipment which did an excellent job protecting our network and our customers. At about 8:30 AM PDT we started getting alerts which indicated an inbound flood of over 500,000 packets per second. Fortunately, the Riverhead system took over the incoming flow to the attacked IP and started mitigation pretty much immediately. The attack is still going on as I type this, but seems to finally be tapering off.

Before I worked here I wasn’t exactly sure what this kind of job consisted of. Of course this made for a very awkward résumé, since I had to get across that I knew a lot about computers without implying I was best suited for a completely different computer job, such as database management. But even for a while after I joined, there were moments when I was surprised, because what I had been expecting wasn’t anything like what actually happens. So I imagine there may be a lot of you who are speculative or curious about what kind of issues can happen in a data center.

All the issues that I have to deal with can be split into three categories, hardware, software and networking. Since we sell only unmanaged servers and colocation, ideally I’d only be responsible for hardware and networking (a fourth category, environment, is important but not in any way under my purview). However, operating systems being what they are, those things break all the time and of course I have to fix them.

Hardware

The hardware issues we see most often are bad RAM and bad hard drives. Very rarely we have bad RAID cards or NICs, and once I had to replace a CPU. These are always fairly easy fixes, once the problems have been identified. The only real issue is when a customer loses data due to a failed hard drive. RAID can sometimes (but not always) prevent that, which is one of a million reasons why backups are so necessary.

Under hardware I’m also going to throw all the scheduled upgrades we do. Fooling with hardware is the easiest part of this job, except for inventory management, which gets tres annoying, but even that isn’t so bad. This is the same monkey stuff you did for your family when you were 14.

Network

I don’t think I’ve seen the network actually break, but customers fall off it all the time. 95% of the time, this is because of Red Hat Linux. Oh man, do I hate Red Hat. Don’t take this personal, if you like, use, work for, or are Red Hat (well, take it personal if you are Red Hat), but the network configuration in this OS is such a mess. So if you use Red Hat, and you reboot, and suddenly you can’t get on the network, it’s because the network scripts, which used to work just fine, thank you, decided they didn’t like where the default gateway was defined, and now expect it to be defined in another of the 735 different network configuration files, which lives in another directory from the file previously used. Haha!

This is, of course, only my opinion.

Usually network upkeep involves protecting our network from customers. If customers get cracked, they tend to become members of zombie networks, and the UDP floods they send out can slow things down for other customers. We tend to head those off by limiting the compromised customer’s connection.

Less often, but not rarely, customers become victims of DoS or DDoS attacks. In fact, there’s one going on right now. If you happen to know 208.185.250.11, tell him I said to knock it off. There are nearly always handled automagically by our network infrastructure, but it’s good to keep an eye on it.

Software

Oh boy. Broken software. Where to start?

Well, there are the usual suspects. By default, Windows will only allow two active Terminal Services sessions at a time (Windows 2003 allows you to connect to the console remotely, which can count as a third session). If you run out of these, and Windows doesn’t reset them for some reason, We have to visit the box to reset them manually.

Control panels have been known to become unstable. This seems to happen when a user tends to be familiar enough with the command line to use that, but also has a control panel installed. The CP can become confused if a file is edited manually. This is why Ensim (for example) changes the motd to inform users that, if they edit files, they have voided their warranty.

Remotely upgrading OSs is also a tricky issue, for example kernel upgrades.

Then there are the day-to-day surprises, like that time up2date got confused and uninstalled OpenSSH.

So there are a myriad of different software issues that actually crop up, but the best way to classify them would be in two categories: those that break the OS and access to it, and those that break the services the server provides. We probably have an 90/10 split between them. Very rarely will we get involved in customer setups; our customers generally prefer to have their own IT staff take care of it.

In a way it’s almost disappointing that we don’t get to do the real Sysadmin work (that is, configure client servers with actual solutions to actual problems, instead of just making sure they’re online). But that would be impractical for the number of clients we have, and they’d basically be paying for our on-the-job training as we learned about their (unique, sometimes bizarre) setups. So probably it’s just as good we don’t.

If you have been in our San Francisco data center recently, you may have seen 21 large screens being installed on the wall of our support area. Our new Network Operations center is now functional, and new monitoring systems are coming online to fill up the screens in the coming weeks.

The new ColoServe NOC builds on our existing internal and external monitoring by providing a state of the art way to display real time information for all ColoServe systems. Monitoring and alerting for all our network connections, power circuits, UPS systems, and air conditioning units and more will be displayed on the wall, and new screens have been added for special customer server and application monitoring. The ColoServe NOC is staffed 24/7 by a minimum of two systems administrators to provide our colocation customers with the highest level of service and technical expertise possible.

Last night ServePath completed the Phase II Upgrade of our edge/border routers from Cisco 12012 to Cisco 6509 routers. Phase I was completed on July 24th, 2005. Servepath’s Network team is constantly working to improve our infrastructure, and this latest upgrade is a major milestone.

The new routers include Cisco supervisor 720 modules that will provide enhanced hardware-based IPv4 and IPv6 and higher performance and scalability. The SUP-720 BXL is a third generation supervisor engine that addresses our growth and growing data-plane requirements. With its integrated switch fabric, the SUP-720 allows for more line cards per slot and the 40 Gbps per slot supports high-density Gigabit Ethernet and 10 Gigabit Ethernet ports. Servepath will now be able to take10 Gigabit handoffs, satisfying future bandwidth upgrades from our upstream providers. as our data center expands and our dedicated server customers demand increasing levels of bandwidth scalability.

ServePath has upgraded our private and public peering connections with the installation of new connections and equipment from IP Networks. This is the sixth fiber provider to install equipment into our San Francisco data center.

IP Networks operates a next generation optical access network that provides high bandwidth Ethernet services to hundreds of the most important buildings in the San Francisco Bay Area. Their architecture provides superior transport layer redundancy using MPLS and eliminates the bandwidth bottleneck in the last mile of many traditional telco circuits.

The new connection gives ServePath yet another Gigabit transport connection, as well as greater peering capacity so that routes to the most popular sites and ISPs are dramatically reduced.

ServePath’s Screaming-Fast Network Architecture

IP Networks, Inc.