« Ring! Ring! Hot News, 18th August 2008 | Main | Ring! Ring! Hot News, 26th August 2008 »

BBC iPlayer Bandwidth Wars

It’s August; not much going on in the telcosphere. But the summer calm was shattered this week by some news — and, despite what you’d read elsewhere, it wasn’t the Ericsson/STMicro merger. We documented, with a little help from Plusnet and their happy wurlitzer Ellacoyas, just how heavily the BBC’s iPlayer TV streaming service hit British ISPs. We also noted that even if the Beeb is sucking up a lot of bandwidth, it’s still not as big a deal as YouTube.

Now, it looks like a second wave of iPlayer-related disruption is heading for the British DSL providers’ bottom line. And the pattern is likely to repeat itself all over the world, since you have a misalignment of interests between media players (who want free or cheap online distribution), and ISPs (who want to sell ‘unlimited’ plans to users in the hope they never use any of the capacity sold). The answer will inevitably be a new more dynamic market for bandwidth and content delivery. In the meantime, we can watch the old industry structures strain and buckle. So what drives the economics of online video delivery? [Ed - We will be launching a major new research report into online video delivery this autumn, more details to follow.]

As so often, economic change on the Internet is manifesting itself as a peering war, or something like one. Peered networks mean no money changes hands between telcos; otherwise you have to pay or receive money for transit. Since receiving money is good, and paying out isn’t, this is core to the business model. Ma Bell grew up on the back of AT&T’s leverage over smaller local telcos when it came to interconnect with the long distance network.

The BBC has been criticised on this blog for an attitude to the ISP business model crisis you could characterise as neo-brutalist: we’re here with our vast video stockpile, like a massive concrete tower, and you’ll just have to deal with it. But compared to what is now being suggested, the BBC’s Internetworking policy under Ashley Highfield was relatively friendly.

First of all, the BBC made extensive use of content delivery networks (CDNs) to soften the blow, by caching the data nearer to users. Specifically, they contracted with Akamai Networks to outload their video content from their servers in ISP network operations centres. Secondly, the BBC encouraged direct peering between its own content network and UK eyeball ISPs, which like all peering tended to replace OPEX with CAPEX amortisation. If you’re connecting up with the BBC at LINX, for example, you’re almost certainly using your own equipment, so although it still costs you money, the connectivity is provided at cost. Further, once you’ve spent the money to run the cables, install the gear, and turn on the Ethernet port on the IX switch, you can be certain of the costs over the time it takes you to amortise them.

AS2818 Here’s a RIPE BGPlay visualisation of the BBC’s routing table just before the Olympic games. Note how the BBC has lots of direct connections (peers), rather than going via a few intermediaries.

However, tucked away in the announcement that the BBC is going to start streaming H.264 video as well as On2 VP6, it looks like there is a major change afoot. This means a leap in the bitrate from 300Kbps to 800Kbps, and the H.264 videos are not going to be served up from Akamai, but from Level(3)’s internal CDN. This instantly raises a major issue for other ISPs. Akamai peers at all its locations — it is, after all, the company’s raison d’etre. But Level(3), in its role as a tier-one backbone operator, gets all its own reachability through peering and charges lesser beings for transit over its wires. ISPs may be faced with a whopping transit bill to reach BBC CDN servers on Level(3).

But this is only part of the change; it’s also being rumoured that the BBC is itself going to terminate direct peering with downstream networks, or perhaps that it already has done “for the Olympics”, so everyone will have to go via Level(3), and drop the Akamai service for non-H.264 content as well. This may mean a major disruption of the UK ISP economy. The only ISP which won’t be affected is BT, being a global carrier that almost certainly peers with Level(3), and possibly Orange if their UK DSL infrastructure is integrated in France Telecom’s global IP activities, as Opentransit (France Telecom’s worldwide Internet backbone, AS5511) is in a similar position. This raises an interesting question.

Peering is negotiated at the level of networks, not companies — the unit of interest is a BGP session. Are the various small ISPs that became Orange (i.e. France Telecom), O2 (i.e. Telefonica), and BT divisions in a position to benefit from Daddy’s peering relationships? It would seem to be a big competitive advantage, especially if the BBC is indeed hopping into bed with Level(3), but then, British ISPs aren’t an obvious example of how to integrate acquisitions. As it happens, we checked, and all the national Oranges (subsidiaries of France Telecom) are downstream peers of AS5511, which is France Telecom’s global IP backbone. Telefonica’s Be isn’t obviously integrated in AS12956 (Telefonica Wholesale) although some small UK ISPs are. (However, they do peer with Level(3) in their own right.) It does increasingly look like you need a global telecom giant as a parent to be a viable ISP.

You have to wonder what the terms of the BBC-Level(3) contract are; in a sense, the BBC has entered into a Faustian bargain, because signing up with a tier-one network implies that its own peering activities are now in competition with theirs. Level(3) would obviously prefer more transit traffic from ISPs that it can bill for, and this new arrangement means more ISPs will have to buy transit from them to reach BBC content. Did they demand an end to direct peering with the BBC, or offer a discount in exchange for it?

But rather than just wondering, we looked up the route (132.185.0.0/16) which contains most of BBC Internet Services on RIPE BGPlay. Despite everything, there were practically no significant changes over the start of the Olympics, and the BBC was still only using Level(3) for some international transit networks. Whatever the politics, it looks like the rumours are just that. Rumours. As far as we can see, the BBC is still peering with all and sundry.

AS2818-3 Here’s another BGPlay visualisation, today. Note that there has been no wave of BBC routes announced from Level(3) (AS3356), so not much has really changed yet..

The pressure on the ISP cost base is only going to get worse. Not only will user numbers and usage keep going up, but higher video quality will multiply the total usage. And you can’t expect cooperative policies from major content networks, either. In moving the H.264 video to Level(3), the BBC has stepped some of its distribution costs off to the general UK Internet community. Whether or not they intend to change their peering policies, the existence of such fears should tell you all you need to know about the possible consequences.

To share this article easily, please click:

Comments

I was going to say that this story is a little speculative - but someone else has said it better.

http://blog.streamingmedia.com/the_business_of_online_vi/2008/08/news-repoting-o.html

Nick Reynolds (editor, BBC Internet blog)

The legacy content provider (still smaller than YouTube, next generation content aggregator) vs Telco incumbent attitudes to peering (retro-brutalist competition clobbering) battle is a two edged sword.

It can help network operators learn they can no longer bully smaller competitors with peering "charges" AKA "ratios" and they'll have to learn how to run a business charging their own customers, imagine that. The BBC's efforts to provide operator's customers content at a location where it can practically picked up at minimal cost is the right attitude. The rumour about selling out to Level(3), or any exclusionary IX or CDN, is not.

Regrettably this lesson comes at the cost of reinforcing for some that the Internet is a broadcast transmission medium, asymmetric and needing regulatory intervention like historically pervasive scarce transmission resources.

Well, I'm sure you're pleased we put so much effort into debunking the rumour you were going to cut off eyeball peering. Nobody else seems to have bothered to look up the BGP data.

If an ISP is already directly peering with the BBC, what incentive does the BBC have to discontinue that peering relationship which is "free" vs paying for Level3's CDN ??

So it seems the true test will be how future ISP connections will be handled .

In other words, where will the ISPs connect for iplayer content who had previously "peered" with Akamai?

Theoretically, this could have been a quid pro quo for lower prices for the actual CDN service, but it's a stretch.

Unfortunately this article is wildly inaccurate and speculative (the BBC has taken down zero peering sessions for the olympics) and confuses two separate issues (iPlayer != Olympics streaming).

Also, there's absolutely no point in checking the prefix you've mentioned for either iPlayer or live streaming services. The content will be served from within the CDN (hint : Akamai uses DNS as it's magic sauce to ensure the correct IP address [in Akamai's IP space] is returned).

Secondly, the H.264 content on iPlayer is already verifiably coming from the L3 CDN (watch a H.264 video, start up wireshark, collect the IP address and look up the address block ownership via whois.)

Of course, this shouldn't mask the fact that the changes to L3 will have a massive impact on ISPs bottom line. Transit from L3 is going to be more expensive than peering with Akamai even if this is only for a small amount of content (Read:traffic) (currently).

We know the BBC hasn't taken down any peering sessions; we demonstrated it.

Also, there's absolutely no point in checking the prefix you've mentioned for either iPlayer or live streaming services. The content will be served from within the CDN (hint : Akamai uses DNS as it's magic sauce to ensure the correct IP address [in Akamai's IP space] is returned).

No, we didn't check the prefix you mentioned for iPlayer; we checked it to verify if the BBC's policy on peering_with the BBC_ had changed, in order to debunk the rumour that they had pulled direct peering _with the BBC_.

Post a comment

(To prevent spam, all comments need to be approved by the Telco 2.0 team before appearing. Thanks for waiting.)

Telco 2.0 Strategy Report Out Now: Telco Strategy in the Cloud

Subscribe to this blog

To get blog posts delivered to your inbox, enter your email address:


How we respect your privacy

Subscribe via RSS

Telco 2.0™ Email Newsletter

The free Telco 2.0™ newsletter is published every second week. To subscribe, enter your email address:

Telco 2.0™ is produced by: